Remix.run Logo
benjamintnorris 3 hours ago

Hi HN, I'm Ben, founding engineer at relaxAI.

We built a UK sovereign inference provider for developers who are either paying too much for OpenAI/Claude tokens or can't use US hyperscalers due to data residency requirements.

The short version: drop-in OpenAI-compatible API, latest open source models (Kimi K2.6, DeepSeek V4 Pro, Nemotron 3 Super, GPT OSS 120b), running on NVIDIA Blackwell GPUs in the UK. Zero code changes to switch from OpenAI. Up to 80% cheaper per token cost saving!

We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction. For anyone building in regulated sectors — finance, legal, health, defence — that matters a lot. But honestly, most of our early users just came for the huge cost savings.

We're looking for developers to kick the tyres. Check out our API docs at relax.ai/docs. I'd love your feedback and happy to answer any questions.

timruffles an hour ago | parent | next [-]

Firstly, congrats! As a Brit this looks cool, and I'm happy to see it. I wish you every success.

Secondly: I get that 'sovereign' is probably an important sales term for your company. But this, in common with the government's 'sov/ai' fund, does not deserve to be described as sovereign. This is other countries' models served on chips designed and manufactured abroad, powered by a grid which imports 44% of its power.

Of course this isn't your company's fault. Last week I went to an event where the sovereignai.gov.uk people presented. In a very Keir Starmer way (spiritually, he wasn't there), they said in as many words 'oh but I'm sure all reasonable people would agree _really_ sovereign AI would be too hard. So let's all agree to pretend that just popping a bit more money into the AI startup ecosystem is a sovereign AI strategy'.

I'm unsure if the UK does need to be sovereign in anything; it certainly doesn't seem to want to be. But I will continue to poke fun at anything using the pompous phrase 'sovereign' for anything that isn't.

If sovereign AI is a problem you're in earnest about, I hope you go after it seriously, and fix the rest of the stack. I'll cheer you on!

carderne 17 minutes ago | parent | next [-]

The UK grid does not import 44% of its energy.

Gell-Mann suggests I should treat the rest of your post with skepticism.

EDIT: maybe you meant the UK total primary energy? I feel like that's extending the boundary a bit far. Should we start digging for uranium? Or stick to renewables, but only with locally sourced silica and rare earths?

quietbritishjim 29 minutes ago | parent | prev | next [-]

Sovereign capability just means that no foreign government can pull the plug. Who cares where it was copied from?

If it were somehow legal for a company to provide MS Office (not a clone) fully in the UK with no control from Microsoft, that would also count as a sovereign capability, even though none of the code was written in the uk.

Maybe that's not how you like the term to be used but it's widely used that way and widely understood.

bcjdjsndon an hour ago | parent | prev | next [-]

If I could give prizes for comments you'd get one. Too much fart sniffing goes on in these parts, it's always a pleasant change to see dissent

jonplackett an hour ago | parent | prev [-]

Tbf the title only says sovereign _inference_

jstummbillig 2 hours ago | parent | prev | next [-]

Hey Ben. I find communication like this fairly off-putting. In so far the 80% cheaper per token (or any part of it) is something of your own making/ingenuity, by all means, do tell, but it requires comparing token cost fairly with comparable models on i.e. OpenRouter and not across different models and pretending it's the same thing.

imdsm 2 hours ago | parent | prev | next [-]

Marketing aside, why are you using the term "UK sovereign"?

I assume UK based DCs, so why not just say that, UK based LLM inference.

Is it a DC owned/ran by HM Gov? Is that why it's sovereign?

Not a criticism, more of a critique.

drawfloat 2 hours ago | parent | next [-]

Much the same way the word "patriotism" is more common in US national discourse, "sovereignty" is very common in UK national discourse.

bcjdjsndon an hour ago | parent [-]

You're thinking of when chavs used to wear sovereign rings... it's fell out of fashion now tbh

raesene9 an hour ago | parent | prev | next [-]

Data Sovereignty as a term is now fairly well established term that doesn't have specific government connotations e.g. https://events.linuxfoundation.org/kubecon-cloudnativecon-eu...

StilesCrisis 2 hours ago | parent | prev [-]

He does say that? "running on NVIDIA Blackwell GPUs in the UK" is in there and that's pretty unambiguous.

pu_pe 34 minutes ago | parent [-]

The problem is if those GPUs are running on an AWS server (or any other American provider), even if it the server is in the UK the sovereignty claim is null and void.

StilesCrisis 22 minutes ago | parent [-]

Doesn't "We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction" cover that?

pu_pe 12 minutes ago | parent [-]

In theory it should, but I've seen that language describing Azure "sovereign cloud" servers before. The data might indeed be stored in the UK, the problem is the CLOUD act which supersedes it.

spacebanana7 2 hours ago | parent | prev | next [-]

Is your business plan essentially to run mid tier models on hardware in the UK?

I do see the value in this as some enterprises need local data residency, the UK energy grid realistically can't handle new multi GW xAI-style data centres, and many applications don't need frontier models (but do need more than small local ones).

robertlagrant an hour ago | parent | prev | next [-]

Hi Ben - how are you positioning yourself vs LocAI? I had a few chats with them and they have a fairly similar pitch.

benjamintnorris 22 minutes ago | parent [-]

We’re closely partnered with the LocAI model lab, we’re looking forward to running their models on the platform in the next few months!

robertlagrant 14 minutes ago | parent [-]

Ah great! Best of luck. They're a nice bunch.

ltr_ 30 minutes ago | parent | prev | next [-]

good prices, but I don't see info on the token cache hits prices (in/out), are they available?.

graemep 2 hours ago | parent | prev | next [-]

So the pricing is 12.50/month for unlimited chat, or 60p per million tokens output/10p per million input? For use with a coding assistant it would be the latter?

greenchair 2 hours ago | parent | prev | next [-]

Congrats on the launch. More options for consumers in this space the better!

hathym 2 hours ago | parent | prev [-]

why use this over openrouter?

raesene9 an hour ago | parent | next [-]

I'd expect for workflows where there is value in knowing that the data is processed in the UK. From a contractual/data protection standpoint, that could be very useful, depending on the use case.

bocytron 34 minutes ago | parent | prev | next [-]

openrouter is an US based company, so falls under CLOUD Act

nicce an hour ago | parent | prev | next [-]

Avoiding routing through US or US-based companies.

imdsm 2 hours ago | parent | prev [-]

good question, it's going to take a lot to dislodge openrouter from my workflows