| ▲ | ganelonhb 5 hours ago | |
I have a 2070 and can confirm it works amazingly fast. I love TheBloke I wish he still made stuff | ||
| ▲ | bashbjorn 5 hours ago | parent | next [-] | |
Yeah, TheBloke era of local LLMs were good times. TBF Unsloth are doing a fantastic job of publishing quants of the major models quickly - they just don't have nearly the volume of "weird" models as TheBloke did. | ||
| ▲ | ge96 5 hours ago | parent | prev [-] | |
What do you use it for? I'm still trying to use agents, I barely use copilot, only at work when I have to. I didn't want to get personal with an LLM unless it was local so that's why I was setting this up but yeah. So far just research is what I was looking at. | ||