The same thing happens to me, so know you are not alone and your not crazy. My problem is that it only happens with insignificant bits of everyday life only once in a while. :/
Perhaps if you meditate on it you could refine the skill. I have no idea if that will work because I always fall asleep but its worth a try. Let me know if you have any success.