| ▲ | walrus01 5 hours ago | |
Yeah, or close enough to 5GB for estimation purposes, for example a just spawned qwen 3.5 122B llama-server instance reports as: 0.07.015.888 I common_memory_breakdown_print: | - Host | 170038 = 162913 + 6740 + 384 | The 6740 is the cache size. | ||