have (one's) heart in the right place
To have benevolent intentions. The phrase is used especially when one's actions have negative results. Grandmom has her heart in the right place, but I would never wear any of the clothes she sends me.
heart in the right place, have one's
Be well-intentioned, Her plan to reconcile them didn't succeed, but she had her heart in the right place. [Early 1800s]