Give people time to respond, I realize some posts are answered quicker than others but that's just the way things go. One of the issues is the word Fey, I'm not saying you are here but most people that use the word are role playing and I can see why it might not make the thread high on people's priority list.
In general however what most people think of or refer to as fey are actually just another kind of spirit so a simple banishing works brilliantly. There's a plethora of options to choose from here, smudging white sage is always sane advice and the LBRP (lesser banishing ritual of the pentagram) is a fairly popular method. Ultimately though pretty much anything you choose and rely on usually is golden.