"Rights" aren't natural. They're a human invention based on a collective experience. We grant rights, we limit them, we take them away, all based on what works for whatever society we live in.