Who accepts the liability when the LLM does its typical occasional massive judgement fuck up?

Asking that because even the very best, commercially available, state of the art LLMs (presently Claude Opus 4.7 (1M) with Max effort enabled) still occasionally fucks up its decisions and judgement in significant ways.

So, it's kind of horrifying to me that people would consider this for actually potentially life-impacting ways. Especially as it sounds like the consideration is to advise people in area's they don't themselves have the skill and knowledge to catch bad advice on. :(

Yeah, investing over time in such a way to beat the S&P is actually incredibly challenging (having tried it myself). I’m very skeptical an LLM can do better than that unless it has a very large, expensive firehose of data.

It may be that more mundane analysis ends up being the most useful. For example — for years, we had some money in a money market fund earning basically no interest. It just wasn’t on the radar.

Had even a not very smart LLM nudged us to put the money into a HYSA earlier, we would have made thousands per year in interest.

My wife also recently used our tool to do some simple investing optimization that’s going to save us a few thousand per year on taxes.

Thing like this aren’t sexy but do have value, and don’t take GPT Pro.