If you want to use them in the craft you may want to get a magickal herb encyclopedia, but a good basis of herbs would be.
Chamomile, sage, lavender(if that counts), mint, etc.
You can usually find a good selection of herbs at your local garden centre, with enough variety to really get you started in herbs for both kitchen and magickal uses.
I have mint, chamomile, sage, catnip too. Also lemon balm, dill, and lavender. Have to be careful with plants like mugwort, broom, and belladonna that I hear about often here.
For some good beginner herbs, I'd suggest lavender, basil, and mint.
I'd also suggest looking into herbs that grow well in your climate zone and then picking up any that catch your fancy. Just besure to research each, their needs, common issues found in each plants, allergies to them, etc.
I also started my very first herb garden thingy few months ago. Previously I knew nothing of herbs, but google is a very good friend of mine. :) It's funny how almost every plant I've googled seems to have some kind of magical properties.
I'm growing lavender, dill, chervil, parsley, thyme, ivy and strawberries. You can also find many wild herbs if you just keep your eyes open.
mint is the best beginner herb in my opinion cause it grows like crazy and is hard to kill and is what i tell everyone to start with
and like said above rosemary and sage are good starters too.
all three will thrive in pots but be sure to separate mint carefully because it spreads like crazy and if you dont it will take over your garden
also be aware that it is august now and can be too hot for seedlings. depending where you live some herbs just wont make it at the moment. seed packets will have a chart on the back telling you prime planting times for you seeds in your state, and starting your plantings in biodegradable egg cartons is a great way to help them out (its what i do, i get them from the deli i work at)
and like Vaahtera said, there are lots of wild herbs and magical plants growing all around you. i know for sure that elder berry is fruiting around me in savannah right now and that stuff is amazing!
also think about planting non herbs in your garden, i know for a fact that marigolds keep away mosquitoes and look amazing among all the green of sage and chives