Remix.run Logo
adrian_b an hour ago

Palantir already offers a "turnkey AI datacenter", i.e. a rack with "NVIDIA Blackwell Ultra systems with eight NVIDIA Blackwell Ultra GPUs and NVIDIA Spectrum-X™ Ethernet networking for AI training and inference".

It is said that it comes with all hardware and software required to run inference or training with an open weights LLM.

The existence of this product, which competes with cloud-based offerings like those of OpenAI and Anthropic, is presumably the reason why the Palantir CEO criticized very harshly some time ago the business model of OpenAI/Anthropic.

While I doubt that the ethics of Palantir is any better than of OpenAI/Anthropic, in this particular case I have to agree with Alex Karp about "Sovereign AI", i.e. that only losers will make their business completely dependent on an external entity like OpenAI or Anthropic, who are certainly not trustworthy.

vrganj an hour ago | parent [-]

I'm not sure a data center run by ... Palantir of all organizations is what people have in mind when they worry about data sovereignty.

adrian_b an hour ago | parent [-]

They are selling it, not running it.

It is just a dedicated computer system, which should be managed by its owner, like any other on-prem servers.

I doubt that it has a good price/performance ratio, but it is a solution for those who feel that they do not want to search, buy, assemble, install and configure every HW/SW component.