Size vs. weight
If people are noticing the difference, and you feel healthy and energetic, you must be doing something right. Don't worry so much about the numbers on the scale,
When my sister was on the swim team in high school, despite all the exercise, she gained a couple of pounds. But when the weather warmed up and she tried on her clothes from the previous summer, they all just hung on her because she had lost almost two sizes!