| ▲ | virtue3 13 hours ago | |
We are 100% there already. In browser. the webgpu model in my browser on my m4 pro macbook was as good as chatgpt 3.5 and doing 80+ tokens/s Local is here. | ||
| ▲ | AndroTux 12 hours ago | parent | next [-] | |
Sir, ChatGPT 3.5 is more than 3 years old, running on your bleeding edge M4 Pro hardware, and only proves the previous commenters point. | ||
| ▲ | AugSun 12 hours ago | parent | prev [-] | |
It works really well for "You're helpful assistant / Hi / Hello there. how may I help you today?" Anything else (esp in non-EN language) and you will see the limitations yourself. just try it. | ||