If miscast these spells will banish you from their presence. What the difference is is quite simple. Assume you are going to a restaurant, the banished person will not be able to go.
What happens is that if the spell is miscast, you will be the one unable to go.
Banishment spells when used on people often isolate the person, as they are no longer able to be around you, or anyone else you are around.