get on (one's) horse
To prepare or get ready to leave. Well, I had better get on my horse. It was lovely to see you, as always. Time to get on my horse—I don't want to miss my train!
get on one’s horse
in. to prepare to leave. It’s late. I have to get on my horse.