Actually I think AI will largely automate software and math and really not much else in the short to medium term. (speaking as a computer/math person)

I don't see why that should be the case. The only reason software is getting focused on first is:

1. Software devs are obviously going to have a better idea how to apply AI to software development compared to other fields. So of course the coding tools are going to be the first things made.

2. Formal verification makes the problem easier by allowing for iterative feedback (compilers, proofs, etc.)

The second argument is, I think, somewhat valid, but ignores that a lot of other professions also have similar verification systems even if they're a bit less rigorous. The first argument just explains why things are the way they are now, it's not indicative of the future. I don't want to fall into the trap of thinking that other jobs than mine require less cognitive horsepower or whatever, but I don't see what's particularly special about other jobs if it can do hard STEM stuff.

I thought the same but i dont think so anymore. My wife is a senior manager at a big 4 consultancy gig and she says copilot became freaking good at understanding tax, multinational company structure etc etc. Even if you need a few partners and experts at the top to validate things you can cut huge amounts of workers.

Exactly. Regarding software, it is trained on a massive corpus of code and the feedback loop can be very fast (playing well into LLM's upsides) and results are ... mediocre.

Recently I had to go through some building regulations and Claude's advices were catastrophic.