Remix.run Logo
WithinReason an hour ago

As an example, Grok 4 took $388M to train

HPsquared 24 minutes ago | parent [-]

Compiling source code also takes computing resources, only the scale is different. It's a very close analogy: source code with training data, and compiled binaries with model weights.

The weights are literally a binary blob.

WithinReason 6 minutes ago | parent [-]

The weights are the modifiable representation. You modify them with gradient updates.