Why not get the non-safety version, swap the trigger and sights, and sell the now stock safety model shield??? You'll be out $50 max. And you won't have to worry about that stupid safety.
I do sweep it since I usually shoot a 1911. I find it hard to believe that it's not easily defeatable. I would not think S&W reinvented the wheel to eliminate it.
But I am leaning towards what you suggest. Just keep it and move on. I'm still on the hunt for a high capacity option, lol.