Remix.run Logo
madanparas 4 hours ago

Perry uses NaN-boxing to preserve TypeScript's dynamic type system at runtime, the same approach as JavaScriptCore. The PERF_ROADMAP is honest about the cost: 1.86x behind Zig on image convolution, with 1.24 billion wasted instructions traced specifically to NaN-box unboxing. You cannot get C-level performance without dropping TypeScript semantics, and dropping them means you are no longer compiling TypeScript.

Dylan16807 4 hours ago | parent [-]

I think you mean you can't get that performance without monomorphization. When you know the types you can...

...wait, I went and looked up that file.

"The Three Optimizations That Would Close the Gap"

You're presenting the data from there in an extremely misleading way! They in no way need to drop any Typescript semantics to go faster.

cornholio 3 hours ago | parent | next [-]

Typescript is a dynamic language. Without changing the language, there is fundamentaly no way to resolve at compile time decisions that can be made only at runtime (ie, they are data driven). Monomorphization helps pin down (some) dynamic types but the fundamental problem remains.

nielsbot 2 hours ago | parent | next [-]

Why don't JITs preserve previous work across runs of the same code?

If you encounter code with the same hash as last time, load up the previously generated binary and run that... or is that already happening?

mirekrusin 2 hours ago | parent | prev [-]

Julia?

cornholio 2 hours ago | parent [-]

That's a JIT. Yes, you can do all sorts of optimizations in a JIT, because you do it at runtime using runtime information, and always keeping an escape hatch, so the static code bails when invoked with data it was not compiled to handle. This kind of hatch is used here with <any> wrapping.

JIT is a technique to accelerate dynamic languages at runtime to near machine performance while keeping dynamic ergonomics; but it can't transcend the AOT / runtime wall.

madanparas 3 hours ago | parent | prev [-]

You're right. The typed buffer locals optimization keeps TypeScript semantics intact by exploiting the existing Buffer/Uint8Array type annotation to skip the NaN-unbox. It's not dropping types, it's using them. The floor I described applies to any-typed paths where static type info isn't available. For well-typed TypeScript, the roadmap shows the gap closes without semantic changes.

drawfloat 2 hours ago | parent [-]

Put the LLM down and talk to humans as a human.