Look in second hand stores. You'll also be able to pick up some nice candle holders, bowls, a chalice (goblet/thick wine glass) and cloth for very cheap. A letter opener is a great inconspicuous ritual knife. Look for GoodWill stores too, that way your money goes to charity too. I've found an array of "treasures" at these places. Just be sure to clear, cleanse and charge them.
As for tarot, that might be more difficult to explain if they were found. I agree with the others on playing cards. Even though my mother actually gave me my first tarot deck, my first love of cards for divinition was cartomancy and it is done with a plain deck of regular playing cards. Nothing suspicious about that. And even laying down the cards in public merely appears as though you're playing an interesting game of solitaire.
If you want to write your spells and notes down, make your own alphabet. Keep it simple. Just write the english alphabet and draw your symbols under the letters. Memorize it, destroy the key, and write in a book labeled "journal" or "diary". If its questioned, all you need to say is that you created your own code to keep your thoughts private. =)