My thoughts exactly Mistress, though let me elaborate a tad more. :)
Children often are born with gifts; it is the very "growing up" that diminishes them. As you grow older your mind, as you know, will change drastically in short amounts of time. Such as puberty; when you start wanting to be older and older and possibly wanting to be a full adult. Children view their parents as the ultimate, ideal adults. And like many others you parents probably weren't all that knowledgeable in divination (psychic development), and they surely didn't want you to grow up crazy. Not having an innate drawing to anything like divination if they were interested... wasn't enough to keep you so interested that you were actually going to train and keep your powers up there with you rapidly changing mind. As everyone knows, powers will dissipate over time if you don't do anything or do enough to keep them fresh and strong.
Now then about the charm:
When someone uses or wears a charm for a long period of time their energy will- as said above- bind to that charm, or rather transfer to it in such large quantities that your body very nearly views it as a weaker limb. Yes, your chakras will start to make it stronger as if it's a part of you that has a bit of energy deprivation. Being the center of psychic powers, chakras do have limits. And as charms emit large amounts of energy into the Universe to fulfill their very reason; it will eventually being to use too much energy from your chakras as they're still pumping it like their your heart and the charms was cut off circulation for a long time. You take off that charm along with that part of your body that was circulating all that psi energy- you will feel the effects.
Energy circulates like blood; if your injured (in this case removing the charm after so long) your energy will flow freely for a while in large amounts from that injured area (where your charm used to be).
Meditation is a wonderful idea to help keep your strength.
I would also suggest a simple spell of concealment to that area cutting off the "circulation" to where your charm used to be.
Get your rest and do plenty of easy going, and relaxing meditation.