Black magic, white magic, pink magic, purple poka-dot magic....whatever label you want to throw at it, it won't change the fact that magic is magic and there is no good or evil to it. It is the manipulation of energy to accomplish a goal. The intent behind the magic is what is good or bad, depending on a person's personal perspective on the situation.
Saying a spell that can harm someone is evil is like saying a gun that could shoot someone is evil. The spell is a tool, it is the person who uses the tool that comes into question.
If you feel abhorred by magic that seems to have ill intent, then you have a natural aversion to spells with questionable intent.