I do not calorie count either, I do portion count, but I do not weigh portions. I estimate portions based upon fist size, something I learned in a book. I make sure I balance my intake of proteins, veggies, complex carbs, and fruits, but do not get crazy about hitting specific numbers.
I focus more on hitting my exercise goals and exceeding them. It seems I consistently lose weight when I do that, not when I focus too highly on calorie counting.