Remix.run Logo
fluoridation 6 hours ago

I think at 16 GB you'd struggle to run the regular development tools nowadays, forget about any interesting inference.

Otternonsenz 5 hours ago | parent [-]

Fully agreed, and my hope is as open models grow and change, that getting some amount of this working on Pro-sumer hardware will be more attainable.

But certainly seems like we are a few years away from that, sadly.

Am I also screwed in being able to train my own small model or adjust another one with such a non-workhorse PC?

fluoridation 5 hours ago | parent [-]

Training requires even beefier hardware than inference.