I don't know enough about the interaction to know if your feelings about yourself resulting from it were justified or not, but something I have been realizing about myself is that I tend to make too big a deal of it when someone is cross with me about something.
It might be part of having been abused that I feel sorry when I have no reason to be. So one of my goals for myself is to actually be a bit more of an **hole.
Well, maybe not an **hole, really but someone with a little less regard for peoples opinions of me. That may or may not be relevant to what you're talking about, but I just thought I'd throw that in.