They usually know their own names-- so if somebody speaks it aloud they will pay attention and come over to see why somebody is saying their name. Just like people, actually, only some people see this as more "dangerous" because there is no distance on the astral. So, things you name will come over frighteningly quick.
To scream at it just because it was annoying you is kind of mean, especially if it's not a human spirit and just doesn't understand that it's hurting you. Since it's haunting you anyway (I wouldn't say possessed,) why not try to communicate with it, negotiate with it-- try for a little more understanding. If you don't have a very strong intuition, you can cast a circle around the board and invite it over by name to talk one-on-one with the board or pendulum and resolve things that way. Or you could just put the things away until it gets bored. You don't have to call everything that is not like us, "Evil."