The used model is 9B even with a big context you can easily run it on 16GB. You don't need a $2500 machine for it.

For coding and personal assistance the context window on 16GB is not good enough. Ideally I want a context window of 100k.

▲

Aurornis 3 hours ago | parent | next [-]

This is starting to feel like a conversation where the goal posts keep moving, but a Mac Mini with 32GB of RAM starts at $999

▲

BoredPositron 5 hours ago | parent | prev [-]

In the other reply you said 50k. 16GB vram provides 40-70k on the 9b depending on the implementation and quant. Which is more than enough for the tool we are discussing in this thread but it looks like you are just changing your story instead of admitting that your initial comment was made in a hunch. Adding ever changing context in responses "to be right" is just bad manner.

	▲	hparadiz 5 hours ago \| parent [-]
		50k is what I consider bare minimum but I would like to have 100k. Honestly I'd like to have as much as I can get. Context window is what makes it useful. I wanna feed it all the information at the same time. If I can feed it my entire code base it becomes much more useful than if I feed it only some of my code base.