Not all covens work like a family and if you feel something isn't right, then you leave. If you simply don't want to be in a coven, then leave. If you want to stay, but are having issues with something, speak to the Priest/ess and Council members about it and see about resolving said issue. You don't have to feel obliged to stay within a coven if you don't want to, no matter what people say.
Your next step is figuring out which is the case for you and then acting upon that.