Is the Grok CLI a 2 terabyte install? Did Elon dropship you an 8U rack of B200s?

No?

Well the model weights, the GPUs, and the context obviously all have to be in the same place, so “sending your project to them” is literally the only thing that could possibly happen, unless you think agents work by fucking magic.

This is the biggest case of PEBKAC in history, maybe ever.

This is the kind of confusion that Charles Babbage could not rightly comprehend, except at those politicians at least had the excuse that computers had only been invented five minutes prior.

▲

notavalleyman 8 hours ago | parent | next [-]

Haha so just send over your entire home directory including password managers and home videos every time you need some python code rewritten.

Only a buffoon would be confused by the straightforward logic.

▲

fwlr 7 hours ago | parent [-]

If you decide that your entire home directory is the project, as the OP did by setting the repo_path to ~/, then, well… I mean, if you ask me, I don’t recommend it, but it’s your computer and your free will.

▲

butlike 6 hours ago | parent [-]

Then that should be considered a 'nuke button' and nuke buttons don't find themselves into well-designed software for the simple fact that an end user shouldn't have to worry about shooting themselves in the foot. Again, with good software.

	▲	fwlr 5 hours ago \| parent [-]
		Granted, but we’re talking about agents, which fundamentally presumes the obsolescence of concepts like “end user” and “good software”.

▲

ch_sm 6 hours ago | parent | prev | next [-]

that‘s … not really how it works. Agents get your code into their context via tool calls, not by uploading the entire file to a server „where the weights live and thus the code has to be too“. Small but crucial difference. Aside from that: LLM providers have to be the ones that facilitate your privacy and security by default. That‘s not on the user. They‘re tool providers and they can‘t compromise you and your org by default.

	▲	fwlr 5 hours ago \| parent [-]
		What do you think a tool call is? What is this small but crucial difference between a `read_file` tool call and `scp`? If your contention is just that this should upload files one by one instead of all at once, what you want is for providers to facilitate the illusion of privacy.

▲

hosel 8 hours ago | parent | prev | next [-]

You’re telling me LLMs aren’t actually magic?

▲

dminik 7 hours ago | parent | prev | next [-]

That's not how any other coding harness/agent works. Why confidently comment on stuff you know nothing about?

▲

Hamuko 8 hours ago | parent | prev [-]

It's fascinating how many people in this conversation think that LLMs need to have all of the files in your $CWD on the model provider's servers to be able to do anything.