It is better to act and do something that one may have to apologize for than to do nothing out of caution or politeness. The phrase prioritizes action over courtesy. I hope my supervisor isn't mad, but it's better to ask forgiveness than permission, right? Who cares if you offend someone—you need to get your music to the right people, and it's better to ask forgiveness than permission!