Time was when human rights were rather a province of the left: you know, the liberals. As it is today they're still the province of those of us who are still liberals, those called the classical liberals, but the rest of the left seems to have moved on to other things. As in with the current attempts to restrict prostitution, even to criminalise either the buying or selling of sex between consenting adults. Canada has looked at this matter and has declared that actually, it's all a matter of those human rights, not the imposition of the usual puritan prodnosery:

Canada has removed all anti-prostitution laws after sex workers fought for safer working conditions following the serial killings of prostitutes by a pig farmer in British Columbia. The 9-0 Supreme Court ruling found that the laws violated the guarantee to life, liberty and security of the person but it will not take effect immediately because Parliament has a one-year reprieve to respond with new legislation. Prostitution isn't illegal in Canada, but many of the activities associated with prostitution are classified as criminal offenses.

That is indeed exactly how it should be of course. The acts themselves should be legal simply because they are indeed between consenting adults and they're not violating Mill's point about the swung fist and someone else's nose.

If the act itself is legal then so too should all ancillary activities, subject only to the laws that apply to all activities. We might well demand that streetwalking cease, on the same grounds that we might demand that any other public nuisance ceases. But only on exactly those same grounds. We might demand that those earning money pay their income taxes but again, only on the same grounds that anyone else earning does (and I know that HMRC has teams that do exactly that).

It is a human rights issue: we cannot allow people to limit the way in which others decide to live their lives just because the first group do not like that way of other people living their lives.