Remix.run Logo
PaulHoule 19 hours ago

At the very least you can decode UTF-8 really quickly with AVX-512

https://lemire.me/blog/2023/08/12/transcoding-utf-8-strings-...

and web browsers at the very least spent a lot of cycles on decoding HTML and Javascript which is UTF-8 encoded. It turns out AVX-512 is good at a lot of things you wouldn't think SIMD would be good at. Intel's got the problem that people don't want to buy new computers because they don't see much benefit from buying a new computer, but a new computer doesn't have the benefit it could have because of lagging software support, and the software support lags because there aren't enough new computers to justify the work to do the software support. Intel deserves blame for a few things, one of which is that they have dragged their feet at getting really innovative features into their products while turning people off with various empty slogans.

They really do have a new instruction set that targets plain ordinary single threaded branchy code

https://www.intel.com/content/www/us/en/developer/articles/t...

they'll probably be out of business before you can use it.

gatane 17 hours ago | parent | next [-]

In the end, it doesnt even matter, javascript frameworks are already big enough to slow down your pc.

Unless if said optimization on parsing runs at the very core of JS.

saagarjha 9 hours ago | parent [-]

It'll speed up first load times.

immibis 9 hours ago | parent | prev [-]

If you pay attention this isn't a UTF-8 decoder. It might be some other encoding, or a complete misunderstanding of how UTF-8 works, or an AI hallucination. It also doesn't talk about how to handle the variable number of output bytes or the possibility of a continuation sequence split between input chunks.

kjs3 4 hours ago | parent [-]

I paid attention and I don't see where Daniel claimed that this a complete UTF-8 decoder. He's illustrating a programming technique using a simplified use case, not solving the worlds problems. And I don't think Daniel Lemire lacks an understanding of the concept or needs an AI to code it.