It's a really big stigma for some to let another man, especially a Black Man, into the home. I know there's a difference between your "home" and bed", but that's fine. Let everyone wonder, unless you want to leave the windows open and rub their face in it.
We used to live in a redneck area of Virginia. There was tons of IR sex going on, but it had weird rules. It was very common to see mixed couples under 25 out at the shopping center or TGIFs. The girls never took the boys to their parent's home though. In the older (40+) crowd, you almost never saw IR relationships. We knew the older swingers who loved IR sex, but we also shut-up and listened politely when others derided the youngsters.
Now that we live in Cali, it's both better and worse. In some places, it's hard to find a Black Man. In others, it's hard to find one that's not a hardcore gangster. So, what's all this have to do with openly letting a Black Man into your home? It's easy.
1) Thumbs your nose at racists (if you can do so safely).
2) Encourages others and celebrates the lifestyle.
3) May give young Blacks a non-violent way to work out aggression on whites. I strongly advise a few hotel meets first, but if you find a strong young buck who gets the lifestyle, I recommend it.