know otherwise
To understand or be certain that a particular statement or assertion is unfounded or incorrect. There's a common perception that being a stay-at-home parent is the easy option, but I know otherwise.
know ˈdifferent/ˈotherwise
(informal) have more information about something: She thought he was upset about the divorce, but I knew different.