| ▲ | PlatoIsADisease 6 hours ago | |
There is a reason no one uses Apple for local models. Be careful not to fall for marketing and fanboyism. Just look at what people are actually using. Don't rely on a few people who tested a few short prompts with short completions. | ||
| ▲ | mitjam 6 hours ago | parent [-] | |
yes, I'm using smaller models on a Mac M2 Ultra 32GB and they work well, but larger models and coding use might be not a good fit for the architecture, after all. | ||