Remix.run Logo
root_axis 3 hours ago

Ok, now do memory capacity and bandwidth - the things that actually constraint local LLMs.

apimade an hour ago | parent [-]

8800 GTX in 2006: 768 MB of GDDR3, with 86.4 GB/s of theoretical memory bandwidth.

GTX 1080 in 2016: 8 GB of GDDR5X, with 320 GB/s.

RTX 5090 in 2026: 32 GB of GDDR7, with 1.792 TB/s.

This is fun, what's next?!

PCI 8.0 is breaking 1TB/s, GDDR7 is 1TB/s.

With just the _current_ timeline, things are looking like they'll compress once we get over this initial lump.