Is it possible that your friends just happen to share a certain body type? Such as: thin, narrow-hipped, narrow shoulders, etc.?
I always feel large, but then, I am large. If I am around larger people than myself, I suddenly feel thinner - like magic. But, then, you don't pick your friends by their size... just be aware of that effect.