come away with (one)
To travel with one. Often used in the sense of a romantic getaway. Come away with me to the islands, my darling. You're always welcome to come away with me to my vacation home.
come away with someone
to go away or travel away with someone. Come away with me for a ride in the country. Come away with me and we'll find a nice place to eat.