lose favor (with one)
To no longer be supported, accepted, approved of, or regarded highly by one. John lost favor with his boss ever since he managed to drive away the firm's most lucrative client. Those stupid toys are just a fad—they'll start losing favor sooner or later.
lose favor
(with someone) Go to fall out of favor (with someone).