| ▲ | hparadiz 5 hours ago | |||||||
For coding and personal assistance the context window on 16GB is not good enough. Ideally I want a context window of 100k. | ||||||||
| ▲ | Aurornis 2 hours ago | parent | next [-] | |||||||
This is starting to feel like a conversation where the goal posts keep moving, but a Mac Mini with 32GB of RAM starts at $999 | ||||||||
| ▲ | BoredPositron 5 hours ago | parent | prev [-] | |||||||
In the other reply you said 50k. 16GB vram provides 40-70k on the 9b depending on the implementation and quant. Which is more than enough for the tool we are discussing in this thread but it looks like you are just changing your story instead of admitting that your initial comment was made in a hunch. Adding ever changing context in responses "to be right" is just bad manner. | ||||||||
| ||||||||