Why not just tell him off? Clearly he doesn't love you or loved you if he's trying to ruin your life. (Unless you did something horribly wrong or he's just a vindictive person)
Just walk away from him. If you don't give him power over you then he can't bother you.
Why don't you put the situation on ice, literally. Write out the situation on paper, place the paper in an ice tray and freeze it. Once things calm down you can thaw out the ice cube and thereby undoing the spell. This doesn't harm anyone it just "freezes" or "suspends" the situation for a period of time so you and he can get some perspective. Sometime time is the best solution.