leave (one) to (one's) fate
To refuse to aid or assist one, instead allowing for whatever outcome was bound to occur naturally. I don't consider myself a hero. I just knew I couldn't leave those people to their fates in that burning building. I appealed to my father-in-law to loan me the money I needed to keep the business afloat, but he just left me to my fate.