if there's no occult shop in your area, if you're in a city i'm sure there's one, but look at flea markets, or check out clothing stores for crystal jewlery. for herbs, you can buy many at grocery stores and health food stores. you can even buy seeds and grow your own, or go to garden centers and buy them. wands and brooms can be made. athame's can be any daggar/knife with a black handle so long as you purify it. [mine i bought at a flea market]
personally, grow the herbs, for the crystals, find a hoby shop, or a new age store, or anyplace with jewlery.
no problem. if you don't want them to know, tell them you're getting into stones. keep in mind eventually you have to tell them, but wait for the right time. if you don't feel comfortable, or fear they'll be mad, avoid the subject till later, but tell them one day.