Not my area of expertise at all, but I thought flash was durable for read-only use. Put your weights there, leave them there, and use other memory for the KV cache.