The creation and deployment of sex robots are accelerating. Sex robots are service robots that perform actions contributing directly towards improvement in the satisfaction of the sexual needs of a user. In this paper, we explore the potential use of these robots for elder and disabled care purposes,which is currently underexplored. Indeed, although every human should be able to enjoy physical touch, intimacy, and sexual pleasure, persons with disabilities are often not in the position to fully experience the joys of life in the same manner as abled people. Similarly, older adults may have sexual needs that public healthcare tend to ignore as an essential part of their well-being. We develop a conceptual analysis of how sex robots could empower persons with disabilities and older adults to exercise their sexual rights, which are too often disregarded in society.