Use to worry about it... now. meehh... that's their issue... Just tell them (if a stranger...) your off-work job is head of security for a very important family in <state your general location> . Hardly anyone ever asks who the family is... and if they do, its a great opening to say... "My own."
I will definitely use the above if ever outed