I've found most of the frontier coding models require somewhere between 300GB to 1TB to run with full capabilities.

godzillabrennus 7 hours ago | parent | next [-]

If only we could buy 1TB of unified memory in a Mac for $1k-$2k in total hardware costs. Apple would basically be able to extinguish the entirety of the market cap for Nvidia, OpenAI, Anthropic, and others all at once.

In 10 years, I hope my MacBook Pro can run today's frontier models and has 1TB of unified Memory.

▲

shadowpho 6 hours ago | parent | next [-]

Why can’t Apple launch a $50k product for $1k? Everyone would buy it!

	▲	tempoponet 41 minutes ago \| parent [-]
		To go further down this pipe dream - Anthropic / OpenAI would buy them all and still price out the consumer. There's no end-run in this scenario.

▲

connicpu 6 hours ago | parent | prev | next [-]

The Nvidia GB300 DGX Station, which isn't even going to hit 1TB total memory, is expected to launch at almost $100k. Bit of a pipe dream with memory prices where they're at.

	▲	FuriouslyAdrift an hour ago \| parent [-]
		There are multiple server systems available right around the $100k range that have 512B of GPU RAM right now (4x AMD Instinct MI300A) GIGABYTE G383-R80-AAP1 for example

▲

jayd16 6 hours ago | parent | prev | next [-]

They want you to buy four 256GB Studios and link them with ThunderBolt.

	▲	Danox 5 hours ago \| parent [-]
		Yes, particularly if that memory is designed and engineered by Apple in house like Apple Silicon in house and manufactured by TSMC on shore somewhere in the United States.

▲

manoDev 7 hours ago | parent | prev | next [-]

I’m bullish on Apple because of that. Tech waves always oscillate between mainframe/thin-client models at first, then commodity hardware catches up. Apple is well positioned to deliver that with the M series, all it takes is for the current AI bubble to pop a bit and memory costs go down.

▲

dboreham 7 hours ago | parent | prev | next [-]

The people who train the frontier models want to recover their costs, so they're not going to let you do that.

▲

bigyabai 4 hours ago | parent | prev [-]

> Apple would basically be able to extinguish the entirety of the market cap for Nvidia

I don't think you understand why people buy Nvidia hardware if you're beating the "just add more dual channel DDR, bro" drum. Apple wouldn't even be able to extinguish AMD with a product like that, it's all slow memory being fed into a raster-first GPU architecture.

▲

pstuart 7 hours ago | parent | prev [-]

The work on LLM in a Flash will probably help, and Apple's NVMe architecture is well suited to maximize throughput could allow their devices to work better on larger models than other vendors.

	▲	ABS 6 hours ago \| parent [-]
		[flagged]