I've always heard the conventional wisdom is that if symtoms are above the neck (such as a sniffly nose), it's okay to exercise; if they're below the neck (chest congestion, nausea), then hold off.
The best thing is to listen to your body. I also can't imagine two weeks off after healing up; that seems like a long time...and I believe that exercise gets so many chemicals going for you that it will speed up your body's return to normal. As long as you are getting enough rest, you should be okay.
And now that you don't have to be perfect, you can be good.