The best way I can describe rap, is like wine. If you don't like wine, you haven't tasted enough of it. Jazz fans tend to like the jazz infused hip hop instrumentals, with no, or very little vocals.
And some people will never like wine, no matter how much they try. I've tried lots of wine... still not a fan.
On the other subject though... there have been a few that I've liked. But there are very few artists left that actually know how to write lyrics, across all genres.