In spite of the negative trait or issue the speaker is discussing. In this construction, the speaker indicates a specific person, followed by a problem or shortcoming they have experienced or exhibit. Yeah, she's not remotely punctual, and she gripes a lot, but for all her shortcomings, Elisa is a really great manager—her employees just love her. For all our difficulties buying a house, we still managed to get one that we absolutely love.