Toronto is pretty progressive, but like anyplace, you will have racial backlashes.
When I have a "date night" with a lover, we go to areas where everyone is accepted for what they are. More or less. Mixed racial couples, gays, lesbians, are all accepted. Or at the least tolerated. Don't get me wrong, there are many areas where a backlash can be experienced. But since I'm going out for a good time, we avoid them.
I'll get sideways glances wherever we go though. Mostly from women. I like to think they are jealous.