If you want to get religious then you could say that most Christians, the faithful ones, wouldn't be affected by curses or hexes because their god protects them.
If you want to get logical then you could say that most of the people who aren't affected may have a kind of natural shield or protection about them, or the person trying to use energy to attack simply isn't that good at energy manipulation.
If you want to get scientific then there is a theory that when people see spirits the ones that aren't affected by the spirits actions aren't affected because they see the spirit as fake, unreal, and the ones that are affected are the ones that see it as real and thus feel pain because there mind tells them that the pain is there.
It can actually get very complicated if you hear every theory.
Nex, you need to start reading the entirety of the post you reply to and not use poorly worded metaphors. Physical attacks and energy attacks are entirely different because physical material and raw energy are two entirely different things. A physical object is made up of various elements (referring to the scientific periodic table of elements) whereas energy is not.