| ▲ | manapause 3 hours ago | |
It depends what your goals are and what you are using it for. This space is fluid and my answer last week would be different than my answer today! That said there’s no substitute for hard work, here are some resource to get you up to up to speed: https://carteakey.dev/blog/local-inference/local-llm-optimiz... https://botmonster.com/ai/self-hosted-ai-agent-frameworks-20... Personally I find myself swapping models depending if I am engaged in “trad-development” vs building agentic probes or apps involving imagery. Tailscale the LLM to your deployments and ta-da! | ||