It's looking like running your own mini ecosystem is the way of the future to me. No data centers, just a decent GPU 16-24gb of VRAM, CPU, and 32gb of RAM.

▲

Lalabadie 2 days ago | parent [-]

This is Apple's bet, among others.

Training purpose-specific miniature models lets you have a lot of tasks you can run with high confidence on consumer hardware.

	▲	twoodfin 2 days ago \| parent [-]
		Or on a commodity EC2 instance with a relatively cheap inference sidecar.