Remix.run Logo
Insanity 7 hours ago

Extend your VRAM using RAM, then extend your RAM using Swap.

krige 2 hours ago | parent | next [-]

Extend your RAM using RAM Doubler!

FooBarWidget an hour ago | parent [-]

Then extend your disk space using DoubleSpace/DriveSpace!

Datagenerator an hour ago | parent [-]

Just to be sure install Stacker (from STAC electronics) too

system2 4 hours ago | parent | prev | next [-]

And burn the swap pagesys file to a rewritable DVD to complete the cycle. It will be super fast that way.

SV_BubbleTime 5 hours ago | parent | prev [-]

If you are doing video models, this is an excellent way to murder your SSD.

Do not put swap on an SSD you care about at all.

zozbot234 28 minutes ago | parent | next [-]

You can of course monitor SMART wearout indicators to check whether this is happening. Casual use of swap for non LLM-use is actually fine since "cold" ephemeral data will be swapped out first and that will never get written to; KV cache is mostly fine since it's similarly append-only so writes are tolerably small; but yes, more general LLM inference totally breaks that limited-writes pattern and will wear out/kill your media.

Insanity 4 hours ago | parent | prev | next [-]

I was writing it somewhat tongue-in-cheek and not as a serious suggestion. But thanks for adding the disclaimer, that's good advice!

rvz 2 hours ago | parent | prev [-]

> Do not put swap on an SSD you care about at all.

This.

Many people rediscovering what the purpose of swap files are, but will still find a way to abuse it without knowing that they are actually destroying their SSD.