How do i stop getting pantsed?

so its funny and everything but heres whats been happening. I go skateboarding with my friends and they will always pants me, I know i should wear a belt but sometimes i like to wear shorts or sweatpants too. I didnt really care but we go surfing too and lately theyve been pulling my shorts off when there are girls around. And they will make fun of me having such a pale ***. I get really tan so its a pretty big contrast. Whenever i pants them back it just turns into people hitting eachother in the nuts. This also happens at soccer and at track. Should i just learn to deal with this or what.