| ▲ | baalimago 4 hours ago | |||||||
I've never gotten incorrect answers faster than this, wow! Jokes aside, it's very promising. For sure a lucrative market down the line, but definitely not for a model of size 8B. I think lower level intellect param amount is around 80B (but what do I know). Best of luck! | ||||||||
| ▲ | Derbasti 4 hours ago | parent | next [-] | |||||||
Amazing! It couldn't answer my question at all, but it couldn't answer it incredibly quickly! Snarky, but true. It is truly astounding, and feels categorically different. But it's also perfectly useless at the moment. A digital fidget spinner. | ||||||||
| ||||||||
| ▲ | edot 3 hours ago | parent | prev | next [-] | |||||||
Yeah, two p’s in the word pepperoni … | ||||||||
| ▲ | PlatoIsADisease 2 hours ago | parent | prev [-] | |||||||
As someone with a 3060, I can attest that there are really really good 7-9B models. I still use berkeley-nest/Starling-LM-7B-alpha and that model is a few years old. If we are going for accuracy, the question should be asked multiple times on multiple models and see if there is agreement. But I do think once you hit 80B, you can struggle to see the difference between SOTA. That said, GPT4.5 was the GOAT. I can't imagine how expensive that one was to run. | ||||||||