oh ok. well you are using the same group on both sites, so if you remove a user from one site it will remove from the other (since its the same group). a site collection has common user groups that can be used in all it's subsites. if i were you i would create SharePoint groups for each subsite (SiteA Visitors, Site A Contributors, Site A Owners, Site B Visitors, Site B Contributors, ect). Add these groups to their respected subsites and give them correct permissions (do this under the site permissions link). Then you will have groups dedicated to each subsite instead of using the same groups for all.