| ▲ | Zee2 14 hours ago | |
> a ∼3B-parameter on-device model | ||
| ▲ | ThomasBb 14 hours ago | parent | next [-] | |
There are even already some local AFM to Open AI API bridge project on GitHub - that lets you point basically any Open AI compatible client at the local models. Super nice for basic summarisation and completions. | ||
| ▲ | JKCalhoun 13 hours ago | parent | prev [-] | |
I was worried "device" was a Mac mini, not an iPhone. (I already have been running models on my MacBook Pro.) | ||