Because people like you want to restrict certain other peoples rights, such as voting. Once you get your nose into the tent you'll want to bring your tail in also. It's not just race, it's economic discrimination and any other discrimination you choose as a criteria. Maybe people of Polish descent who live in Jersey should be omitted from the right to vote.
