The difference is that the left's entire shtick is about not being 'prejudiced' against individuals because of their group identities.

I.e. not assuming they have slimy, horrible negative personal qualities because of the group they belong to.

When this is your 'thing' and main claim to legitimacy, it hits harder when you're hypocritical about it.