When editing a virtual address, select users assigned to the address. The users in the right list are already assigned. Available users are listed to the left. Use the arrow keys to move a user from one list to the other.
Click Update to save all changes.