if there's no occult shop in your area, if you're in a city i'm sure there's one, but look at flea markets, or check out clothing stores for crystal jewlery. for herbs, you can buy many at grocery stores and health food stores. you can even buy seeds and grow your own, or go to garden centers and buy them. wands and brooms can be made. athame's can be any daggar/knife with a black handle so long as you purify it. [mine i bought at a flea market]
personally, grow the herbs, for the crystals, find a hoby shop, or a new age store, or anyplace with jewlery.