Remix.run Logo
nekusar 4 hours ago

Local LLMs.

Krasis is one such tool that allows large models using blended GPU/RAM.

ik_llama for better performance than llama.

ComfyAI for local image generation.

Nanocrab seems better for orchestration. Still need a good system capability firewall.

nativeit 4 hours ago | parent [-]

Who’s buying the memory for this effort?

bad_haircut72 4 hours ago | parent [-]

Think how cheap its gonna be when everyone abandons the cloud providers and they start selling the 50B of hardware they over-invested in