> Sure, they have huge GPU clusters

That's a really, really big "sure."

Almost every trick to run a LLM at OpenAI's scale is a trade secret and may not be easily understood by mere mortals anyways (e.g. bare-metal CUDA optimizations)

▲

v5v3 7 days ago | parent | next [-]

Trade secret?

With all the staff poaching the trade secrets may have now leaked?

▲

minimaxir 7 days ago | parent [-]

That's half the reason tech companies poach.

	▲	thrown-0825 7 days ago \| parent [-]
		It's the entire reason. It's also the reason John Carmack got sued by zenimax when he went to oculus.

▲

handfuloflight 7 days ago | parent | prev [-]

Trade secrets also exist to hide faults and blemishes.