To irritate or exasperate. A noun or pronoun can be used between "brass" and "off." Let's leave John alone for now—I think we brassed him off a bit with our criticism.
brass someone off
tv. to make someone angry. (Primarily military. As angry as the “brass,” or officers, might get about something.) You really brass me off.