can you imagine two years in the future and still believe this will be true? You are just dragging your feet. You will give in sooner or later, and i would suggest sooner.

Nah I’m using it extensively, I know the limits. I do not think scaling is going to magically fix the fundamental limits of attention LLMs