| ▲ | SV_BubbleTime 6 hours ago | |
If you are doing video models, this is an excellent way to murder your SSD. Do not put swap on an SSD you care about at all. | ||
| ▲ | zozbot234 an hour ago | parent | next [-] | |
You can of course monitor SMART wearout indicators to check whether this is happening. Casual use of swap for non LLM-use is actually fine since "cold" ephemeral data will be swapped out first and that will never get written to; KV cache is mostly fine since it's similarly append-only so writes are tolerably small; but yes, more general LLM inference totally breaks that limited-writes pattern and will wear out/kill your media. | ||
| ▲ | Insanity 5 hours ago | parent | prev | next [-] | |
I was writing it somewhat tongue-in-cheek and not as a serious suggestion. But thanks for adding the disclaimer, that's good advice! | ||
| ▲ | rvz 3 hours ago | parent | prev [-] | |
> Do not put swap on an SSD you care about at all. This. Many people rediscovering what the purpose of swap files are, but will still find a way to abuse it without knowing that they are actually destroying their SSD. | ||