It means you buy into the narrative that hes racist. And when you believe that detail, then you can create a situation where those things might matter.
Has he passed any anti-black, pro-white policy?
No, I don’t have enough information to say he’s racist, but I do have enough to say that he’s wary of offending them. The lack of an anti-Black/pro-White policy isn’t indicative of him not being such given his stance towards other groups. In other words, I questioning why you believe I must view one as racist only when they target the specific group I identify. That doesn’t make any sense.