For my real work? It has not been helpful so far.

For side projects? It's been a 10x+ multiplier.

I will add that it seems:

1. The context window size to output accuracy problem seems like a genuinely hard problem

2. The vast majority of resources are being poured into driving down costs, not increasing output accuracy (and definitely not on gigantic context windows)

I will also add:

* I'm astounded at how terrible LLMs are at writing assembly in my experience. This seems like something they should excel at. So I'm genuinely confused on that piece.