I would also recommend adding marshmallow (Althea officinalis). It has saponins which naturally create a "soapy" feel and mucilage which is moisturizing and could help your skin to decrease the amount of oils it makes because they are not needed. And plantain (Plantago major) as it is a detoxifier to help with any break outs and has properties to help the skin heal as well. It's traditionally used as a treatment for everything from shingles to bites and stings. Rosemary (Rosamarinus officinalis) is also another herb that is awesome for the skin. Also if you don't have the herbs you can add a few drops of the essential oil to the soap. Do make sure you check the official name (Latin binomial) to make sure you are getting the correct herb. There are many herbs that have the same common name but are completely different plants and have different properties. Lavender is a big one. The lavender Lavendin has more stimulating properties due to it's high camphor content where as "true" lavender, Lavendula, has more esters which create the calming effect lavender is known for.
Oatmeal and honey would probably help too.
I make a scrub of oatmeal, lavender (Lavendula officinalis, or angustifolia they are the same plant), plantain, and sometimes marshmallow that I use daily. I grind it fine and keep it dry until I'm ready to use it, then add just enough water to moisten it. Sometimes I also add honey to it and make it into more of a mask. The mixture, especially with honey, is also good for any type of infection (like from an injury) or bite.
You can also make a tea of the same herbs (except oatmeal) to treat the body from the inside out.