Knowledge is power. I doubt most understand what magick in its real nature is. It isn't casting fireball at someone, it's altering your world alongside nature's laws.
Once they find out, it will be embarrassing but it always wares off. It always will. Nobody holds these things for explicit periods of time, no, it's just not of human morality.
But if you really won't want anyone knowing, you can easily pan it off as worship to a special god or giving your sentiments and acknowledges to your deceased loved ones.
Magick isn't really something to be ashamed of though. Like I said. Knowledge is power. The more they understand, they more they know, the more they will be more intrigue rather than amused. Perhaps you could start a "magick renaissance" with those willing and wanting to study if found hot and properly informed.