It may or may not. A Ouija board itself is just a tool to communicate with spirits around you. People often make the mistake of thinking the spirit is either in the board (rofl) or that the board summons one. It is simply a way of communicating with them more effectively. If you feel there is a presence in your home, you could try communicating with it again.
If the idea of it being there upsets you, try a cleansing. This will get rid of many negative energies/entities. If the spirit is harmless it will most likely stay until it wishes to leave.
You can cleanse by doing a simple sage smudging. Burn a sage smudge stick (or loose sage of any variety) and walk from room to room. Since you feel it in your closet, I would start there. Fan the smoke so that it reaches every corner of your home. If you worship any deities, you can ask for their blessings. For an added touch of protection I add cedar, pine or willow to my smudging at the end. You can also sprinkle sea salt or pine needles in the windowsills and doors to ward off negativity. Hope that helps :)
They are not fake, and Brysing is right about them being dangerous. People think they are playthings and they are not. They are tools for spiritual communication and should be used only by someone that knows what they are doing.
be careful with ouija boards! they can be very dangerous!!! One of my friends did this with her friends house at their house and the family moved out like a week later because of how bad it had gotten!!!!!!!! This has happened to a few other people as well so, if you ever use a ouija board again, just know what you are getting yourself into
Ouija Boards are fine. It's not the board that causes something bad to happen, it's the person. For example if someone uses the proper method of putting the placett in the center of the board and moving it around three times while saying no evil spirits may enter here it's not as dangerous. If someone is going around asking spirits to speak to them, taking no precautions while using the board evil entities can come into the room. It's the person, not the board. The board is an object that helps make communication possible. The person using it has to do research to find out the proper methods and such because sometimes the boards, when people sell them give instructions on how to play but not what precautions to take.