I would suggest setting up your alter inside of a box so that it can still sit inside of your home untouched without disturbing those that may not understand. Another option is inside of a drawer or cabinet, or cover a shelf with a curtain. I have done all of them before. I feel that a sacred space in the home is important to maintain, and it shouldn't be packed away but merely put out of sight. My alter is always hidden. I have my bell, candles, and chalice out in the open in a way that merely appears decorative and the rest of the alter is tucked under in a cabinet that I can open up when practicing a ritual and then closed back up again.
I don't see it as hiding my altar from others but others from my altar. Thoughts and emotions are energy and the negative thoughts and emotions from someone that does not have the same faith can be damaging to your clean space. And if your deities or those you honor are at all vindictive, it could even be hazardous to any judgmental person that comes by! A personal altar is meant for you and no one else, so why should it be for anyone elses eyes?
Plus, when you have kids (like I do) you learn very quickly that your most precious possessions become the most desired playthings. Or they become a magnet for being knocked over/broken. Either way they are best left out of plain sight!
Hiding it is not a bad thing, it's a smart thing.