The contacts in your account are all held under a MASTER List.
Adding a contact to a group will only add a 'Flag' to the contact to indicate they also belong to this particular Group.
Deleting a GROUP or un-assigning a contact from a group will only remove this 'Flag' and will not delete the contact from the MASTER List.