Remix.run Logo
kentonv 6 hours ago

What do you mean? This is 100% open source and self-hostable!

https://github.com/cloudflare/cloudflare-os

It runs on the open source Workers Runtime:

https://github.com/cloudflare/workerd

You can run it at home if you want. There's even a Home Assistant Gatekeeper.

mosura 6 hours ago | parent | next [-]

So you can run it off the public internet with no sneaky external dependency on cloudflare, slack etc?

And it would be functionally the same? With the same performance if you put enough hardware there?

If so cool, and that should have been clearly in the announcement, because as it sounded it is “I am a sucker, lock me in!”

kentonv 6 hours ago | parent | next [-]

> So you can run it off the public internet with no sneaky external dependency on cloudflare, slack etc?

Yes. It even supports ollama and works decently well with some local LLMs.

> And it would be functionally the same? With the same performance if you put enough hardware there?

Honestly it is faster running locally.

> If so cool, and that should have been clearly in the announcement,

We had so many things we wanted to say, it was hard to fit them all into one story.

The blog post is for an enterprise audience. My tweet thread is for the hacker audience.

mosura 6 hours ago | parent | next [-]

That is actually cool.

Maybe it is my bubble, but the experience people are having with Anthropic particularly is motivating a big “get this stuff back under control” effort so while it may not be strategically optimal for Cloudflare the local hosting would prove more valuable to enterprises than maybe a few years back, even if presented as a backup plan.

edaemon 5 hours ago | parent | prev [-]

Neat! How does that work with the AI Gateway portion? I see some references in the code but at a quick glance I can't tell if you can configure it to skip AI Gateway.

kentonv 5 hours ago | parent [-]

Use of Cloudflare AI Gateway is optional.

In the default configuration, you just plop your Anthropic/OpenAI/Gemini/Workers AI/ollama API keys into the UI and it talks to each provider directly.

That said, I would recommend AI Gateway, it has a lot of nice features. :)

upcoming-sesame 5 hours ago | parent | prev [-]

You're not alone The name "cloudflare-os" by itself made me think this was heavily based on Cloudflare

nolist_policy 5 hours ago | parent | prev | next [-]

Do you have a store/list of public blueprints like sandstorm?

kentonv 5 hours ago | parent [-]

Not yet, but that's an obvious direction to take things. :)

I'm really excited by the idea that this platform makes it safe to use blueprints that someone else vibe coded, without worrying about whether they checked it for security bugs, etc. Basically if the app works, it works. So yeah, there absolutely should be a marketplace so everyone can try everyone else's stuff.

BTW there are three blueprints installed automatically (docs, slides, sheets).

runtime_terror 5 hours ago | parent [-]

Couldn't the blueprint exfiltrate incoming data to an external location for example?

ocdtrekkie 4 hours ago | parent | next [-]

Blueprints shouldn't (if I know anything about Kenton) have access to the Internet/external locations without you granting it permission to.

kentonv 4 hours ago | parent | prev [-]

The blueprint is just code, it does not include data or capabilities.

It's, I suppose, possible that the agent added secrets to the code itself. Not, like, API keys -- the agent never sees those. But it could have extracted sensitive info and put it into code, perhaps?

We can implement restrictions on exporting blueprints from workspaces that have seen sensitive secrets, though this might be more annoying than useful. It's a tricky balance.

andersonpico 4 hours ago | parent | prev [-]

Thank you for your work over the years, sandstorm is a really interesting and inspiring piece of software. I'll certainly try to self-host CloudflareOS.