There's a bunch of details regarding LLMs and copyright, but I don't see how

> They should be forced to publicly release the books as an Ebook.

would be reasonable in any way? The books aren't theirs to release publicly. If I brought a copy of any given movie on DVD, ripped it and used it to train my own "LLM" located at /dev/null, should I then be allowed (or even forced) to release the movie publicly for anyone to watch for free?

We’re in a brave new world now. If theirs reason to believe your destroying the last copy of a book( or another copy isn’t easy to obtain) then you should make a copy of it available.

Set up a compensation fund for the rights holders. Anything is better than culture literally being sucked into the void.

The alternative (throwing books away for no good reason) isn't much more reasonable.