I don't know, compute is compute. Arguably making complex software with LLMs isn't all that different from training a model to do a thing. You're throwing a lot of compute at the problem and hoping for a stochastic solution. The distinction will become even blurrier with time.

Though I agree it might be informative to split it by industry sector.

▲

alexjurkiewicz 5 hours ago | parent | next [-]

AI training uses wildly more compute than most companies, who are generally building domain specific CRUD apps.

Compare AI costs per-engineer-salary-dollar, because more expensive engineers probably need more expensive AI.

▲

eru 4 hours ago | parent [-]

> Compare AI costs per-engineer-salary-dollar, because more expensive engineers probably need more expensive AI.

Let's see how this works out in the long run. For a historical analog, more expensive engineers don't use more expensive computers (by and large).

▲

ThunderSizzle 2 hours ago | parent | next [-]

Which is probably a backwards anti-pattern companies have built.

Your most expensive engineer's time is most valuable, so if you give them standard issue which is half the speed, you are throttling the value you can get from your engineer. Not to mention the mental drain of your cursor barely being able to move due to all the bloated virtual networking systemization.

It would seem to make sense to give more valuable employees faster equipment, so that their time isn't spent toiling with the slow machine, but rather actually producing value.

▲

fragmede 2 hours ago | parent | prev [-]

> more expensive engineers don't use more expensive computers

They don't? If you give your best engineers substandard hardware to work on, you're going to get worse output from them compared to if you give them more expensive computers to work with.

	▲	klibertp an hour ago \| parent [-]
		> you're going to get worse output from them Not completely true. Giving developers hardware that is too beefy is the main reason why so much software breaks down when run on users' machines, which are generally old, on spotty Internet connections, and RAM-starved. Devs just don't need to think about performance unless it's really asymptotically bad, while the users bear the full brunt of inefficiencies.

▲

scrollaway 5 hours ago | parent | prev [-]

If you’re going to include AI training in costs, you should include education as part of the costs of an engineer …

	▲	4 hours ago \| parent \| next [-]
		[deleted]
	▲	imhoguy 5 hours ago \| parent \| prev \| next [-]
		... and that actually shows - senior engineers have spent actual paid time to train juniors. Plus they used to spent time contributing to open source projects or Stack Overflow, all the stuff which every company benefits from.
	▲	victorbjorklund 4 hours ago \| parent \| prev \| next [-]
		And why only education? Everything the engineered needed so far should be included. Can’t have a dev that never eaten since they were born.
	▲	vksv6 5 hours ago \| parent \| prev [-]
		why stop there? Count how long and how much energy it took for evolution to produce that 3 chimp brain that is then educated, and add how long it took culture to produce the knowledge in text books for said education to be possible.