It's very possible what you were experiencing was the creation of a psi ball. This is a ball of energy that you can manipulate.
It's possible that the reason it happened that one time rather than the others because of your level of concentration, or your disbelief afterwards. Our minds often like to work against us especially in this scientific age for lack of a better term.
Yes, energy can have an effect on matter. The manipulation of energy causes changes in our world, in yourself, in everything. Being able to feel the energy and observe the effects yourself through feeling is an excellent way to begin.