| ▲ | Intel Announces Arc Pro B70 and Arc Pro B65 GPUs(techpowerup.com) |
| 55 points by throwaway270925 2 hours ago | 19 comments |
| |
|
| ▲ | genpfault an hour ago | parent | next [-] |
| 600 GB/s of memory bandwidth isn't anything to sneeze at. ~$1000 for the Pro B70, if Microcenter is to be believed: https://www.microcenter.com/product/709007/intel-arc-pro-b70... https://www.microcenter.com/product/708790/asrock-intel-arc-... |
| |
| ▲ | hedgehog 35 minutes ago | parent | next [-] | | Recent kernels have SR-IOV support for these chips too. B&H has them listed for $950. https://www.bhphotovideo.com/c/product/1959142-REG/intel_33p... When 32GB NVIDIA cards seem to start at around $4000 that's a big enough gap to be motivating for a bunch of applications. | |
| ▲ | giancarlostoro an hour ago | parent | prev | next [-] | | Intel GPU prices have stayed fine, but I do wonder if they are viable for Inference if they will wind up like Nvidia GPUs, severely overpriced. | |
| ▲ | qingcharles an hour ago | parent | prev [-] | | I think the B65 is priced at $650. Both supported by llamacpp I believe. With that power draw you could run two of them. |
|
|
| ▲ | nickthegreek an hour ago | parent | prev | next [-] |
| Both have 32gb vram. Could be a pretty compelling choice. |
| |
| ▲ | cptskippy 31 minutes ago | parent [-] | | They certainly look viable as replacements for my Tesla P40 for virtual workloads. |
|
|
| ▲ | vessenes 40 minutes ago | parent | prev | next [-] |
| Not sure why you'd want this over an apple setup. M4 max is 545GB/s of memory bandwidth - $2k for an entire Mac Studio with 48GB of RAM vs 32 for the B70. |
| |
| ▲ | fvv 23 minutes ago | parent | next [-] | | with those $2k you can have 2xB70, with 1.2Tb/sec and 64G Vram, on linux ( and you can scale further while mac prices increase are not linear 0 | |
| ▲ | hedgehog 34 minutes ago | parent | prev | next [-] | | Being able to keep infrastructure on Linux is a big advantage. | | |
| ▲ | RestartKernel 12 minutes ago | parent [-] | | How many compatibility issues is MacOS realistically expected to spur? Windows DX felt unusable to me without a Linux VM (and later WSL), but on MacOS most tooling just kinda seems to work the same. |
| |
| ▲ | 2OEH8eoCRo0 10 minutes ago | parent | prev | next [-] | | Funny, I not sure why anyone would use Apple over Linux. | |
| ▲ | cptskippy 32 minutes ago | parent | prev | next [-] | | Support for Single Root IO Virtualization (SR-IOV) to enable compute and Graphics workloads in virtualized environments. | |
| ▲ | wyre 30 minutes ago | parent | prev [-] | | one can upgrade and swap parts with a computer running an Intel GPU. Linux is very well supported compared to Mac hardware. |
|
|
| ▲ | whalesalad 33 minutes ago | parent | prev | next [-] |
| Anyone running an ARC card for desktop Linux who can comment on the experience? I've had smooth sailing with AMD GPU's but have never tried Intel. |
| |
| ▲ | oakpond 15 minutes ago | parent | next [-] | | Running dual Pro B60 on Debian stable mostly for AI coding. I was initially confused what packages were needed (backports kernel + ubuntu kobuk team ppa worksforme). After getting that right I'm now running vllm mostly without issues (though I don't run it 24/7). At first had major issues with model quality but the vllm xpu guys fixed it fast. Software capability not as good as nvidia yet (i.e. no fp8 kv cache support last I checked) but with this price difference I don't care. I can basically run a small fp8 local model with almost 100k token context and that's what I wanted. | |
| ▲ | wyre 27 minutes ago | parent | prev [-] | | There was the video a little while back where LTT built a computer for Linus Torvalds and they put an Intel Arc card inside, so I'd imagine Linux support is at the very least, acceptable. [1] https://www.youtube.com/watch?v=mfv0V1SxbNA |
|
|
| ▲ | WarmWash an hour ago | parent | prev [-] |
| Wake me when they wake up and release a middling card with 128GB memory. |
| |
