Maybe you had trouble re-reading your own comment but I can tell by how you responded here (a cascade of links/references) and a snarky comment ("I can keep going if you'd like") that I'm sure the doctor was glad to be rid of you.
You didn't say the doctor disputed you had a fever. You said the doctor told you the fever wasn't concern until 100.4. Which I'm guessing is your fault for misinterpreting. If you google around, it's very easy to see the fever thresholds.
Here, I'll even paste a summary for you, and I can keep going if you like:
Key Temperature Thresholds
- 100.4°F : The standard definition of a fever.
- 103°F : Contact a healthcare provider
- 104°F : Seek medical attention, particularly if it does not come down with - treatment.
- 105°F : Emergency; seek immediate care.
In one of your own links (clevelandclinic.org), here's an excerpt for you:
When should a fever be treated by a healthcare provider?
In adults, fevers less than 103 degrees F (39.4 degrees C) typically aren’t dangerous and aren’t a cause for concern. If your fever rises above that level, make a call to your healthcare provider for treatment.