Remix.run Logo
Scene_Cast2 2 hours ago

I'm personally heavily testing LLMs on electrical engineering problems. I'm finding that it's not meaningfully better at figuring out what's up than the other models.

To give you an idea - here's a very abridged summary of one sample question (originally a full paragraph): I have a voltage divider with a precision resistor and a thermistor, my voltage reading is off by 17%, where's that coming from. None of the models I tested (including Opus 4.8 and Fable 5) could figure it out.

threatripper an hour ago | parent [-]

Did you also test GPT-5.5 Pro web version?

Why is the voltage reading 17% off?

Scene_Cast2 an hour ago | parent [-]

On my (admittedly weird) setup, GPT-5.5 Pro times out.

The reading is off because the thermistor resistance also depends on applied voltage, not just temperature. LLMs couldn't get this even after feeding them multimeter voltage readings, not just ADC readings. They went into guessing much more esoteric things like ADC switched-capacitor input current, burnout-detect current sources or IDACs left enabled, board leakage, leaky cap, etc.