with all (one's) heart
With one's sincerest feelings. I will love you with all my heart until the day we die. I just wanted to tell you, with all my heart, how proud I am of you.
with all one's heart
With great willingness or pleasure; also, with the deepest feeling or devotion. For example, I wish you well with all my heart. [Late 1400s]