Hey buddy, I've been dealing with asthma for 24 years. I've been around the block with doctors. Let me preface this with the following: The majority of doctor's I have seen for my asthma in the past have been dead wrong. They think a good peak flow number and "clear sounding lungs" means you're okay. This can't be anymore far from the truth.
In fact, I recently went to a highly rated doctor in my area who suffers from asthma himself. What he told me made complete sense to me. A lot of doctors like to think they know everything about medical science, when they actually DO NOT. Asthma in the books has changed rapidly the past 10-15 years. A lot of these doctors don't give a shit and don't know how to treat asthma though (because they're either arrogant and think they're right because of what they learned in med school, or just misinformed)
Here's a few myths debunked: Albuterol and Xopenex should only be used as a "rescue inhaler"
"If I go to the doctor and my lungs are clear, that means that I will not have an asthma attack tonight that can send me to the hospital" - Completely and utterly wrong. I've had times where my GP would assure me "oh your lungs are clear, wow. If you think have an asthma attack, don't go to the hospital it's just anxiety" - I cannot tell you how wrong he was. If you happen to visit the doctor when you're not wheezing (happened to me a lot) they will just ship you off and say every things fine. Then, at night I would have to be rushed to the ER because of my doctor's arrogance and carelessness.
All in all, the ultimate person to ask for how your well-being is, and how well you can breathe is YOU, YOURSELF. You need to put your symptoms above any doctor's speculations. Doctor's see multiple patients a day, they don't dwell and think about all the intricacies of your specific illness.
Asthma is tricky and hard to spot. If a doctor cannot spot it on the time of his apt. he will just say you're fine and you were panicky. Because let's face it, what can a doctor actually DO for your asthma when they cannot hear wheezing? Nothing. So they try to act like they know what they're doing and give you faulty information. Best advice- try to find a doctor who experiences asthma his or herself. This would be a great starting point, because they will actually internally know how asthma behaves and how it should be treated.
As for your symptoms and treatments, I of course am not a doctor and I don't know how your asthma's onset is, or if you have allergy, exercise or sickness induced asthma; or just regularly induced asthma.
Finally, if you still feel sick and short of breath and cannot reach your doctor (let's say it's 2 am) do NOT hesitate to go to the emergency room. Likely, you will be given the proper treatment and care you need. You will also have a variety of medical professionals examine you, which could ultimately lead you on the right path to getting control of your asthma. Again, I've gone to the ER when I had a great peak flow earlier in the day. I've gone to the ER when a doctor assured me that day that my lungs were clear. Use your instincts, certain doctor's (in my opinion) should not be qualified to treat asthma. I have not used an inhaler in years luckily.