Different people at different times suspect that the relationship is abusive for each one of them. With Matt you have people thinking he poor blind guy that can't defend himself. With Danny there is him being very naive, trusting, and easy to take advantage of. With Jessica there is one woman along with her past experience. With Luke there is the other three with their jobs and resources blackmailing him into a relationship.
The relationship is not abusive and is in fact healthy. Just with people's different thought patterns and prejudices, outsider can think that different people are being abused in the relationship.