I lost 30lbs in 3 months without any "official" exercising. I don't enjoy working out gym style either, but I do have a very active lifestyle as we are ranchers and am always out doing chores, riding horses, gardening etc. But that was all the activity I did, and I counted every calorie I consumed every day. For me it was getting my eating under control that made me loose the weight, and I had to find healthy alternatives for dessert which is a must for me!
So it can be done, you just have to be willing to really regulate your diet and not cheat! I saw a post somewhere the other day that said "If you don't like to exercise, diet harder - if you don't like to diet, exercise harder" You can't get to your goals without doing both but you can find the balance point that works for you!