I will add that it seems:

1. The context window size to output accuracy problem seems like a genuinely hard problem

2. The vast majority of resources are being poured into driving down costs, not increasing output accuracy (and definitely not on gigantic context windows)

I will also add:

* I'm astounded at how terrible LLMs are at writing assembly in my experience. This seems like something they should excel at. So I'm genuinely confused on that piece.

How much Assembly is posted in public repos?