Remix.run Logo
▲ dgb23 an hour ago

Phasing out my usage of cloud based LLMs/harnesses.

Focus is pi + self hosted GLM Flash.

Pi is lightweight and easily extensible and creates minimal extra noise. the output I get is very close to what I want to see.

my workflow is focused on clear turns between planning, testing and implementation. Any useful/recurring tasks, like getting/filtering logs, checking statuses etc get regularly folded into a project cli and agent skills that are local to the project.

I spend time interactively iterating on the plan/design and acceptance tests, then let it do its thing. Usually I have multiple interactive sessions at once that I'm steering this way. 1-2 assigned projects, 1-3 side projects (additional automation, experiments/POCs, workflow/process efficiency etc.). I generally don't do sub-agents. When I need throughput I automate first, frontloading the "deterministic" parts.

▲yewenjie an hour ago | parent [-]

What are you using to host GLM-Flash?

▲dgb23 40 minutes ago | parent [-]

Didn't set it up myself so my info will be meagre, but I think it's litellm and a big enough nvidia card. We use it for development but also for internal applications (where smaller models might escalate a task to it when needed).

Obviously not feasible for (just) personal use, the model is too large for consumer hardware.