how do you know its bad? spirits don't bring bad karma only you can effect your karma. bad luck, maybe, but thats usually a spiteful spirit wanting to upset you, not really your luck.
you can sprinkle sea salt around your house, then do a protection chant to keep it out. sage can also work to cleanse. the key is to visualize and feel the energy/spirit being washed away, and be focused.