Hey Jake,
I struggled with the same issue for a while. Took me a while to figure out why, but finally concluded that it has to do with stereotypes. In common parlance, introvert = soft, meek, shy. This is worlds away from what science says, which is, introvert = extra sensitive to dopamine, adrenaline etc.
Considering you're on this forum, and having seen a few posts from you in the past, I highly doubt you're the former. Nonetheless, how I solved it was by taking pride in my cool, calm energy, while ensuring that I was being social (something I found unnaturally difficult). If you still are victim to sly comments, perhaps you can try adopting a high class/high status demeanor around your attackers. You know, traces of aggression tempered by poise, stillness and silence.
Few tweaks which helped me allay the same worry. Hope they help
Good luck buddy
valence
PS: Check out Chase's post on low energy vs. high energy, on the boards. Cool info there