Witches didn't have many if any fancy things. Their magick knife was commonly the knife they used for everything. Their wand was a stick. Their staff was a bigger stick. Their caldron was their pot.
Go to a few garage sales and second hand stores to find a good pot, an altar cloth/table cloth, incense holders, candles and candle holders. Walk through a wooded area to find a wand if you really want one. I prefer using natural objects though. For instance, I use a flat stone to burn incense on, I use a glass bowl with rocks or shells for stick incense. My first caldron was a coffee tin (I have upgraded since then). The earth direction on my altar is a broken piece of terracotta clay I painted with symbolism and words in various languages over the world that mean earth.
The things I craft from nature mean the most and work the best for me because I've focused on their purpose as I made them. When I take walks, I'm always aware of what is around me. I like to identify birds in the area and pick up feathers. Knowing what type of bird they came from helps. I pick up rocks that call to me. When I lived on the lake, I picked up tons of shells.
I like cutting out the pockets of old jeans and dress shirts for neat pouches, especially the ones that button shut, have flaps, or zip up. You can use cloth glue to prevent fraying at the top if its an open style pocket which are good for making drawstring bags. If you want a drawstring style, fold the top edge down and sew it around, leaving open ends at both sides/seams. Then feed a stiff string through the loop you've sewn. People love my hand made pouches and I usually end up giving some away because I have so many!
I think everyone has that one bedsheet that doesn't match the rest of their bedding. These make great altar clothes and you can use iron on designs or fabric paint to create your own design. Look for the iron ons that mock embroidery, not the big thick ones like they sell here that are bulky and bold. Most craft stores have the more subtle ones.
In kitchen magick, your tools are your kitchen supplies and ingredients. If you search "kitchen magick" on this site, you'll find a topic I posted on the subject awhile back.
The only "prized" fancy pieces I have is the jewelry I've collected for over ten years and an antique sterling silver topped, lead crystal bottom bell that I managed to snag at a second hand store for $3. I like unique pieces. =)
I went to a metaphysical shop in my area and was appauld that they were selling an incense holder I bought at Walmart for double the price! I don't even bother going there anymore. I'll take my business elsewhere, where I'm not being ripped off!
Even dollar stores are excellent sources for candles (I purchase their short emergency candles for one time spells/rituals) as well as glass candle holders although I prefer Ikea for candle holders because they're made well. You can make those too! When I was a kid and had no money for different candle holders but not all candles are made the same size. I commonly had problems with candles that would be too big or small for the candles I had. I filled a deep bowl with dirt or sand and stuck the candle in it. It was probably far safer than your average candle holder. Another thing I used was...yes, playdoh. Soft playdoh works great to hold candles and what kid or parent doesn't have playdoh sitting around somewhere? But I learned the hard way it is flamable and smells aweful if it burns! So playdoh is only good if you don't need to burn down the whole candle.
Many of those fancy things, while "pretty" are made cheaply. The ones that are worth it are extraordinarily expensive! I find second hand so much better because most people don't know the value of the things they sell. Just be sure to banish the energy out of the item, cleanse it and charge it with your own energy before using it.