Ok mate this will sound harsh.
You are a pussy. If you were not you wouldn't have come here telling us about your problem. You would have just said to the girl "Yeah sure" without thinking about it even a tad bit.
Work on not being effected by random people's comments and not to define your self worth through others opinions but your own.
Let me give you an example. A guy in the gym said that my arms look like shit. Since I can't care less about his opinion (I'm quite happy about the way I look) I just said "Ye man". This was in a group setting. He looked like an ass afterwards. He started apologizing that he was just joking etc. while I genuinely didn't care because his opinion didn't matter in the first place. It was funny tho
Maybe witty comebacks also work, but I personally never use them, because it's try hard and takes too much energy away.