Moral dilemma

My neighbour gave me 50 euros today.  He's lonely, lives in a precarious situation with a crazy wife and his only moment of freedom are those tuesday mornings when i take him shopping. He knows that I am poor so he gives me money whenever he has an excuse to do it. I try to give him the affection he needs. I love him in a way. outside of the money that gives me.But I need the money, so I don't say no.

The big question is: is right to accept money in exchange for affection that I would give him anyway?