ruffle (one's) feathers
To annoy, irritate, or upset someone. Sarah's just teasing you. Don't let her ruffle your feathers like that! Harry's bombastic, arrogant demeanor tends to ruffle people's feathers, but he's a decent guy at heart.
ruffle its feathers
[for a bird] to point its feathers outward. The bird ruffled its feathers when it was annoyed. My parrot ruffles its feathers whenever it is ready to preen itself.