Remix.run Logo
bee_rider 5 months ago

It is kind of a bummer that MKL isn’t open sourced, as that would make inclusion in Linux easier. It is already free-as-in-beer, but of course that doesn’t solve everything.

Baffling that MS didn’t use it. They have a pretty close relationship…

Agree that they are sort of going after hard-to-use niche features nowadays. But I think it is just that the real thing we want—single threaded performance for branchy code—is, like, incredibly difficult to improve nowadays.

PaulHoule 5 months ago | parent [-]

At the very least you can decode UTF-8 really quickly with AVX-512

https://lemire.me/blog/2023/08/12/transcoding-utf-8-strings-...

and web browsers at the very least spent a lot of cycles on decoding HTML and Javascript which is UTF-8 encoded. It turns out AVX-512 is good at a lot of things you wouldn't think SIMD would be good at. Intel's got the problem that people don't want to buy new computers because they don't see much benefit from buying a new computer, but a new computer doesn't have the benefit it could have because of lagging software support, and the software support lags because there aren't enough new computers to justify the work to do the software support. Intel deserves blame for a few things, one of which is that they have dragged their feet at getting really innovative features into their products while turning people off with various empty slogans.

They really do have a new instruction set that targets plain ordinary single threaded branchy code

https://www.intel.com/content/www/us/en/developer/articles/t...

they'll probably be out of business before you can use it.

immibis 5 months ago | parent | next [-]

If you pay attention this isn't a UTF-8 decoder. It might be some other encoding, or a complete misunderstanding of how UTF-8 works, or an AI hallucination. It also doesn't talk about how to handle the variable number of output bytes or the possibility of a continuation sequence split between input chunks.

kjs3 5 months ago | parent [-]

I paid attention and I don't see where Daniel claimed that this a complete UTF-8 decoder. He's illustrating a programming technique using a simplified use case, not solving the worlds problems. And I don't think Daniel Lemire lacks an understanding of the concept or needs an AI to code it.

magicalhippo 5 months ago | parent [-]

Agreed, but the points raised by GP are valid in terms of using that article as an argument that AVX-512 can decode UTF-8 well.

It might be fast, but it's not a UTF-8 decoder. It's a transcoder to a fixed, and very limited, target encoding.

kjs3 5 months ago | parent [-]

I though it was pretty clear the GP was talking about Daniels article, not the blog post, but I guess I can see two readings.

gatane 5 months ago | parent | prev [-]

In the end, it doesnt even matter, javascript frameworks are already big enough to slow down your pc.

Unless if said optimization on parsing runs at the very core of JS.

saagarjha 5 months ago | parent [-]

It'll speed up first load times.