| ▲ | Insanity 7 hours ago |
| Extend your VRAM using RAM, then extend your RAM using Swap. |
|
| ▲ | krige 2 hours ago | parent | next [-] |
| Extend your RAM using RAM Doubler! |
| |
|
| ▲ | system2 4 hours ago | parent | prev | next [-] |
| And burn the swap pagesys file to a rewritable DVD to complete the cycle. It will be super fast that way. |
|
| ▲ | SV_BubbleTime 5 hours ago | parent | prev [-] |
| If you are doing video models, this is an excellent way to murder your SSD. Do not put swap on an SSD you care about at all. |
| |
| ▲ | zozbot234 28 minutes ago | parent | next [-] | | You can of course monitor SMART wearout indicators to check whether this is happening. Casual use of swap for non LLM-use is actually fine since "cold" ephemeral data will be swapped out first and that will never get written to; KV cache is mostly fine since it's similarly append-only so writes are tolerably small; but yes, more general LLM inference totally breaks that limited-writes pattern and will wear out/kill your media. | |
| ▲ | Insanity 4 hours ago | parent | prev | next [-] | | I was writing it somewhat tongue-in-cheek and not as a serious suggestion. But thanks for adding the disclaimer, that's good advice! | |
| ▲ | rvz 2 hours ago | parent | prev [-] | | > Do not put swap on an SSD you care about at all. This. Many people rediscovering what the purpose of swap files are, but will still find a way to abuse it without knowing that they are actually destroying their SSD. |
|