If only they were used in the narrow way you define.Honestly on the fence on this one and have wavered both ways over the years.
I think there's some element of a larger victimhood. If I batter you because I hate you, that's a me and you issue. If I batter you because you're *insert group here* I'm sending a larger message that your group is unwelcome to live here, shop here, whatever here. In some ways it's no different than battery on a law enforcement officer is a more serious crime because it's an assault on the rule of law as well as an assault on an individual, so broader victimhood.
Reasonable minds may differ, of course, and I'm still not sure exactly where I land on the topic myself.