The whole point is if someone finds the "sit in the back" phrase objectionable, then don't use it! Then people won't be motivated to return the insult. But the hypocrisy of "I can say the phrase to you but you can't say it to me" is absurd.
As for civil rights history, many Americans are well-versed in it. Here's a part that isn't publicized as much: