When I started I had nothing, I picked up some books and did a lot of internet searching, I still have very little, I mostly use herbs and candles and a few stones.
What you need will be determined by the path that you choose to follow. Much of magickal practice can be done with very little. Find things in nature to help you, repurpose stuff you have, or things you can pick up cheap at yard sales or thrift stores. No need to spend $50 on a silver candle holder if you can find one for $5 at the thrift store.