Remix.run Logo
jychang 9 days ago

Any way to install this via just a container?

Similar to a `docker compose up -d` that a lot of projects offer. Just download the docker-compose.yml file into a folder, run the command, and you're running. If you want to delete everything, just `docker compose down` and delete the folder, and the container and everything is gone.

Anything similar to that? I don't want to run a random install.sh on my machine that does god knows what.

mkagenius 9 days ago | parent | next [-]

There are similar commands for coderunner (not the UI frontend):

  container image pull instavm/coderunner

  container run  --name coderunner --detach  instavm/coderunner
(for more comprehensive commands, see from line 51 https://github.com/instavm/coderunner/blob/main/install.sh#L...)

Frontend (coderunner-ui) is not inside a docker as of now.

patmorgan23 9 days ago | parent | prev | next [-]

I believe a flatpack or appimage is what you're looking for.

cheschire 9 days ago | parent | prev [-]

But you would pump your secrets into a docker AI?

__MatrixMan__ 9 days ago | parent | next [-]

If it was sufficiently locked down, yeah. It's only going to live long enough to give me an answer and then everything it can write to goes away afterwards (besides the answer itself).

What harm can it do?

oblio 9 days ago | parent | prev [-]

Does Docker do that or are you speculating?

Also - podman?

cheschire 9 days ago | parent [-]

I wasn't implying docker itself was the issue.

The previous commenter said that they didn't want to run a shell script that does "god knows what". The implication being that they would not trust the writer of the shell script.

They wanted a docker container that would setup this offline AI workspace for them, presumably so they could interact with the AI and feed "secrets" or otherwise private data into it. Obviously there are other use cases for an offline AI, but folks tend to let their guard down when they think something is offline-only, and they may not be as careful with .env values, or personal information, as they would with a SaaS frontier model.

So I was pointing out that the contents of the docker container would be also doing "god knows what" with their data. Sure they would get the offline user experience but then what happens? More shell scripts? Background data calls? etc. And of course it depends on how they configure their docker container, but if they aren't willing to review an install shell script, they probably aren't looking to do any level of effort for configuring Docker.

Hopefully that clarifies it.

jychang 8 days ago | parent [-]

... I mean, yes? The entire point of local AI is so you can feed your enterprise code into it, that you don't want offloaded to somewhere else.

That's the exact perfect use case for Docker, versus something heavier weight like a VM. What, you expect generic enterprise code to somehow be too dangerous for Docker but acceptable in a VM?