I know exactly what you're talking about.
In other spiritual planes, spirits/ghosts often go unheard of by humans. They're quite often shaken off and ignored, and when someone shows signs of noticing them, they will take advantage of it.
At the age of 9 I was a budding medium, and this is how spirits showed themselves to me after I started noticing them flitting around.
This is old at by now, as I'm full clairaudient/clairvoyant/claircognizant/whatever else. Usually spirits will come asking for help, and if you sense they are harmless or are not trying to interfere, you may help them move on "into the light" as I've done before. It's as simple as telling them it's safe to move on and you will protect them, then visualize a white portal opening up and the spirits departing into it. Then you can seal the portal shut and the spirit should be gone.
Other times the spirits will ask for help by just asking for clarification, asking you to help them find a family member, etc. It's okay that they're talking to you, it doesn't mean you've invoked something or drawn something toward you, they just noticed that you're different and they are embracing your power.