| ▲ | dude250711 6 hours ago | |||||||
Yes, running a local model on a natural wetware substrate here. Recommended setup: plenty of nutrients, some caffeine and a quiet environment. Performance - not currently measured in tokens: roughly average. | ||||||||
| ▲ | jasongill 5 hours ago | parent | next [-] | |||||||
I have been running this stack since well before Claude Code became popular. It works OK but I've found it to be very slow; and despite having a big context window, it seems to lose track of what it's working on and goes down a rabbit hole (or just wastes tokens trying to use the web browser) for hours and is hard to get back on track. I even tried spinning up two sub-agents but even after years of trying to prompt them, they are almost useless in terms of coding ability, so that is looking to be a waste of spending at least so far but maybe the model will improve as time goes on. | ||||||||
| ||||||||
| ▲ | HPsquared 6 hours ago | parent | prev [-] | |||||||
I personally get about 50 tokens per hour. | ||||||||