you can, just be careful what you wish for. you could do a spell to get him out of your life but if you word it wrong and it works, you could end up killing him instead of him moving away and you getting to live on your own. it comes down to intent and energy, but your wording is a major one too, like if you say
'i want him gone,
disappear never to return'
he could be kidnapped, get lost, go missing, so on. you can cast the spell, it'll be harder to do since it's involving another person, and it runs a higher risk of backfire, but it can be done.