have (one's) heart in the right place
To have benevolent intentions. The phrase is used especially when one's actions have negative results. Grandmom has her heart in the right place, but I would never wear any of the clothes she sends me.
have your heart in the right place
be sincere or well intentioned.