probably not. i speak to Rori like this a lot when he's being bothersome because he just wants attention, or he's trying to scare me for fun. if that's all it's doing, it probably wants attention. it could also just be having fun, like a kid making noise then it's mother tells it to stop, so it could be a little upset, but not angry. try talking with it. if you can't hear it, but it can move things, you could ask it to shut the cupboard doors once for yes, two for no. ask if it's mad, if there's something it wants, stuff like that. you can try befriending it, it just sounds like a being that's not harmful.
if you've never spoken to the spirit before and out of nowhere cursed it out, then it's a problem. from what i see, you're fine. to be on the safe side, made a protective charm for yourself and anyone else in the house, and leave a little something for the spirit as a 'sorry for yelling' normally i burn incense Rori likes, if you don't know what the spirit [assuming] likes, try a small dish of honey or something.