Remix.run Logo
whalesalad 2 hours ago

Anyone running an ARC card for desktop Linux who can comment on the experience? I've had smooth sailing with AMD GPU's but have never tried Intel.

Levitating 5 minutes ago | parent | next [-]

Afaik driver support is very complete on Linux. You often see Arc GPUs used in media transcoding workloads for that reason.

oakpond 2 hours ago | parent | prev | next [-]

Running dual Pro B60 on Debian stable mostly for AI coding.

I was initially confused what packages were needed (backports kernel + ubuntu kobuk team ppa worksforme). After getting that right I'm now running vllm mostly without issues (though I don't run it 24/7).

At first had major issues with model quality but the vllm xpu guys fixed it fast.

Software capability not as good as nvidia yet (i.e. no fp8 kv cache support last I checked) but with this price difference I don't care. I can basically run a small fp8 local model with almost 100k token context and that's what I wanted.

robertVance 38 minutes ago | parent | prev | next [-]

Ive ran arc on fedora for years and for general desktop use it’s been perfect. For llm’s/coding it’s getting better but it’s rough around the edges. Had a bug where trying to get vram usage through pytorch would crash the system, ect.

wyre 2 hours ago | parent | prev [-]

There was the video a little while back where LTT built a computer for Linus Torvalds and they put an Intel Arc card inside, so I'd imagine Linux support is at the very least, acceptable.

[1] https://www.youtube.com/watch?v=mfv0V1SxbNA