They have a saying "Everything happens for a reason." It's possible that, as previously mentioned, the two of you aren't meant for each other. There could very well be someone out there better suited for him and for yourself. The universe might be trying to tell you that, in an ever so subtle manner.
My advice, let him go and don't worry so much about it. I know it may not seem fair, but you will eventually find someone that will love you, treat you right, etc. You will eventually find one more suitable for you. Things take time. Be patient and eventually that special someone will come your way.