Once rights are taken away, they aren't given back