Remix.run Logo
forrestthewoods 3 days ago

It’s a bloody shame that Linux is incapable of reliable running software programs without layers and layers of disparate, competing abstractions.

I’m increasingly convinced that the mere existence of a package manager (for programs, not source code) is a sign of a failed platform design. The fact that it exists at all is a miserable nightmare.

Flatpak and Snap tried to make this better. But they do too much which just introduced new problems.

Steam does not have this problem. Download game, play game. Software is not that complicated.

pxc 3 days ago | parent | next [-]

> Steam does not have this problem. Download game, play game. Software is not that complicated.

Steam on Linux essentially has its own "package manager" which uses containerized runtimes: https://gitlab.steamos.cloud/steamrt/steam-runtime-tools

forrestthewoods 3 days ago | parent [-]

The Steam Linux Runtime is pretty bare bones. Their most recent runtime hasn’t been updated in 4 years. That’s quite different.

yjftsjthsd-h 3 days ago | parent [-]

> Their most recent runtime hasn’t been updated in 4 years. That’s quite different.

Bad, even.

forrestthewoods 3 days ago | parent [-]

False. The exact opposite of bad.

The “system” should provide the barest minimum of libraries. Programs should ship as many of their dependencies as is technically feasible.

Oh what’s that? Are crying about security updates? Yeah well unfortunately you shipped everything in a Docker container so you need to rebuild and redeploy all of your hierarchical images anyways.

yjftsjthsd-h 3 days ago | parent | next [-]

> False. The exact opposite of bad.

I don't mind stable base systems, I don't mind slow and well tested updates, I actively like holding stable ABIs, but if you haven't updated anything in 4 years, then you are missing bug and security fixes. Not everything needs to be Arch, but this opposite extreme is also bad.

> The “system” should provide the barest minimum of libraries. Programs should ship as many of their dependencies as is technically feasible.

And then application developers fail to update their vendored dependencies, and thereby leave their users exposed to vulnerabilities. (This isn't hypothetical, it's a thing that has happened.) No, thank you.

>Oh what’s that? Are crying about security updates? Yeah well unfortunately you shipped everything in a Docker container so you need to rebuild and redeploy all of your hierarchical images anyways.

So... are you arguing that we do need to ship everything vendored in so that it can't be updated, or that we need to actually break out packages to be managed independently (like every major Linux distribution does)? Because you appear to have advocated for vendoring everything, and then immediately turned around to criticize the situation where things get vendored in.

pxc 3 days ago | parent | next [-]

> I don't mind stable base systems, I don't mind slow and well tested updates, I actively like holding stable ABIs, but if you haven't updated anything in 4 years, then you are missing bug and security fixes.

I'm not sure GP's claim here about the runtime not changing in 4 years is actually true. There hasn't been a version number bump, but files in the runtime have certainly changed since it's initial release in 2021, right? See: https://steamdb.info/app/1628350/patchnotes/

It looks to me like it gets updated all the time, but they just don't change the version number because the updates don't affect compatibility. It's kinda opaque though, so I'm not totally sure.

forrestthewoods 3 days ago | parent | prev [-]

> So... are you arguing that we do need to ship everything vendored in so that it can't be updated,

I’m arguing that the prevalence of Docker is strong evidence that the “Linux model” has fundamentally failed.

Many people disagree with that claim and think that TheLinuxModel is good actually. However I point that these people almost definitely make extensive use of Docker. And that Docker (or similar) are actually necessary to reliably run programs on Linux because TheLinuxModel is so bad and has failed so badly.

If you believe in TheLinuxModel and also do not use Docker to deploy your software then you are, in the year 2025, a very rare outlier.

Personally, I am very pro ShipYourFuckingDependencies. But I also dont think that deploying a program should be much more complicated than sharing an uncompressed zip file. Docker adds a lot of crusting. Packaging images/zips/deployments should be near instantaneous.

imiric 3 days ago | parent | next [-]

> I’m arguing that the prevalence of Docker is strong evidence that the “Linux model” has fundamentally failed.

That is a very silly argument considering that Docker is built on primitives that Linux exposes. All Docker does is make them accessible via a friendly UI, and adds some nice abstractions on top such as images.

It's also silly because there is no single "Linux model". There are many different ways of running applications on Linux, depending on the environment, security requirements, user preference, and so on. The user is free to simply compile software on their own if they wish. This versatility is a strength, not a weakness.

Your argument seems to be against package managers as a whole, so I'm not sure why you're attacking Linux. There are many ecosystems where dependencies are not vendored and a package manager is useful, viceversa, or even both.

There are very few objectively bad design decisions in computing. They're mostly tradeoffs. Choosing a package manager vs vendoring is one such scenario. So we can argue endlessly about it, or we can save ourselves some time and agree that both approaches have their merits and detriments.

forrestthewoods 3 days ago | parent [-]

> That is a very silly argument considering that Docker is built on primitives that Linux exposes

No.

I am specifically talking about the Linuxism where systems have a global pool of shared libraries in one of several common locations (that ever so slightly differs across distros because fuck you).

Windows and macOS don’t do this. I don’t pollute system32 with a kajillion random ass DLLs. A Windows PATH is relatively clean from random shit. (Less so when Linux-first software is involved). Stuffing a million libraries into /usr/lib or other PATH locations is a Linuxism. I think this Linuxism is bad. And that it’s so bad everyone now has to use Docker just to reliably run a computer program.

Package managers for software libraries to compile programs is a different scenario I’ve not talked about in this thread. Although since you’ve got me ranting the Linuxisms that GCC and Clang follow are also fucking terrible. Linking against the random ass version of glibc on the system is fucking awful software engineering. This is why people also make Docker images of their build environment! Womp womp sad trombone everyone is fired.

I don’t blame Linux for making bad decisions. It was the 80s and no one knew better. But it is indeed an extremely bad set of design decisions. We all live with historical artifacts and cruft. Not everything is a trade off.

pxc 3 days ago | parent | next [-]

> I am specifically talking about the Linuxism where systems have a global pool of shared libraries in one of several common locations (that ever so slightly differs across distros because fuck you).

> Windows and macOS don’t do this.

macOS does in fact have a /usr/lib. It's treated as not to be touched by third parties, but there's always a /usr/local/lib and similar for distributing software that's not bundled with macOS just like on any other Unix operating system. The problem you're naming is just as relevant to FreeBSD Ports as it is to Debian.

And regardless, it's not a commitment Nix shares, and its problems are not problems Nix suffers from. It's not at all inherent to package management, including on Linux. See Nix, Guix, and Spack, for significant, general-purpose, working examples that don't fundamentally rely on abstractions like containers for deployment.

I totally agree with this, though, and so does everyone who's into Nix:

> Stuffing a million libraries into /usr/lib [...] is bad.

> I don’t blame Linux for making bad decisions. It was the 80s and no one knew better. But it is indeed an extremely bad set of design decisions. We all live with historical artifacts and cruft. Not everything is a trade off.

imiric 3 days ago | parent | prev [-]

> Windows and macOS don’t do this. I don’t pollute system32 with a kajillion random ass DLLs.

You can't be serious. Are you not familiar with the phrase "DLL hell"? Windows applications do indeed put and depend on random ass DLLs in system32 to this day. Install any game, and it will dump random DLLs all over the system. Want to run an app built with Visual C++, or which depends on C++ libraries? Good luck tracking down whatever version of the MSVC runtime you need to install...

Microsoft and the community realized this is a problem, which is why most Windows apps are now deployed via Chocolatey, Scoop, WinGet, or the MS Store.

So, again, your argument is nonsensical when focused on Linux. If anything, Linux does this better than other operating systems since it gives the user the choice of how they want to manage applications. You're not obligated to use any specific package manager.

forrestthewoods 3 days ago | parent [-]

> which is why most Windows apps are now deployed via Chocolatey, Scoop, WinGet, or the MS Store

rofl. <insert meme of Inglorious Bastards three fingers>

> Good luck tracking down whatever version of the MSVC runtime you need to install...

Perhaps back in 2004 this was an issue. That was a long time ago.

You use a lot of relevant buzz words. But it’s kinda obvious you don’t know what you’re talking about. Sorry.

> Linux does this better than other operating systems since it gives the user the choice of how they want to manage applications

I would like all Linux programs to reliably run when I try to run them. I do not ever want to track down or manually install any dependency ever. I would like installing new programs to never under any circumstance break any previously installed program.

I would also like a program compiled for Linux to just work on all POSIX compliant distros. Recompiling for different distros is dumb and unnecessary.

I’d also like to be able to trivially cross-compile for any Linux target from any machine (Linux, Mac, or windows). glibc devs should be ashamed of what they’ve done.

imiric 3 days ago | parent [-]

> Perhaps back in 2004 this was an issue. That was a long time ago.

Not true. I experience this today whenever I want to use an app without a package manager, or one that doesn't bundle the VC runtime it needs in its installer, or one that doesn't have an installer.

> You use a lot of relevant buzz words. But it’s kinda obvious you don’t know what you’re talking about. Sorry.

That's rich. Resort to ad hominem when your arguments don't hold any water. (:

> I would also like a program compiled for Linux to just work on all POSIX compliant distros.

So use AppImage, αcτµαlly pδrταblε εxεcµταblε, a statically compiled binary, or any other cross-distro packaging format. Nobody is forcing you to use something you don't want. The idea that Linux is a flawed system because of one packaging format is delusional.

You're clearly not arguing in good faith, and for that reason, I'm out.

forrestthewoods 2 days ago | parent [-]

I assure you my faith of argument was good. Cheers.

pxc 3 days ago | parent | prev [-]

> Many people disagree with that claim and think that TheLinuxModel is good actually. However I point that these people almost definitely make extensive use of Docker

You've got the wrong audience here. Nix people are neither big fans of "the Linux model" (because Nix is founded in part on a critique of the FHS, a core part and source of major problems with "the Linux model") nor rely heavily on Docker to ship dependencies. But if by "the Linux model" you just mean not promising a stable kernel ABI, pulling an OS together from disparate open-source projects, and key libraries not promising eternal API stability, it might have some relevance to Nixers...

> I also dont think that deploying a program should be much more complicated than sharing an uncompressed zip file. Docker adds a lot of crusting. Packaging images/zips/deployments should be near instantaneous.

Your sense of "packaging" conflates two different things. One aspect of packaging is specifying dependencies and how software gets built in the first place in a very general way. This is the hard part of packaging for cohesive software distributions such as have package managers. (This is generally not really done on platforms like Windows, at least not in a unified or easily interrogable format.) This is what an RPM spec does, what the definition of a Nix package does, etc.

The other part is getting built artifacts, in whatever format you have them, into a deployable format. I would call this something like "packing" (like packing an archive) rather than "packaging" (which involves writing some kind of code specifying dependencies and build steps).

If you've done the first step well— by, for instance, writing and building a Nix package— the second step is indeed trivial and "damn near instantaneous". This is true whether you're deploying with `nix-copy-closure`/`nix copy`, which literally just copy files[1][2], or creating a Docker image, where you can just stream the same files to an archive in seconds[3].

And the same packaging model which enables hermetic deployments, like Docker but without requiring the use of containers at all, does still allow keeping only a single copy of common dependencies and patching them in place.[4]

--

1: https://nix.dev/manual/nix/2.30/command-ref/nix-copy-closure...

2: https://nix.dev/manual/nix/2.30/command-ref/new-cli/nix3-cop...

3: https://github.com/nlewo/nix2container

4: https://guix.gnu.org/blog/2020/grafts-continued/

pxc 3 days ago | parent | prev [-]

> Programs should ship as many of their dependencies as is technically feasible.

Shipping in a container just is "ship[ping] as many [...] dependencies as is technically feasible". It's "all of them except the kernel". The "barest minimum of libraries" is none.

Someone who's using Docker is already doing what you're describing anyway. So why are you scolding them as if they aren't?

forrestthewoods 2 days ago | parent [-]

I’m scolding the person who says vendoring dependencies is bad… but then uses docker for everything anyways.

anglesideangle 3 days ago | parent | prev | next [-]

> I’m increasingly convinced that the mere existence of a package manager (for programs, not source code) is a sign of a failed platform design.

Nix is a build system for source code, similar to make. It is such a robust build system that it also can be used as a package manager with a binary cache

chpatrick 3 days ago | parent | prev | next [-]

Does Steam let you control the whole dependency tree of your software, including modifying any part of it and rebuilding from source as necessary, or pushing it to a whole other machine?

Real life software is much more than just downloading a game and running it.

forrestthewoods 3 days ago | parent | next [-]

Pushing to another machine? Yes. By strict definition. Steam exists to sell pre-compiled proprietary programs for dollars.

Rebuilding? No. Linux package management is so-so at allowing you to compile programs. But they’re dogshit garbage at helping you reliably run that program. Docker exists because Linux can’t run software.

chpatrick 2 days ago | parent [-]

Docker (and also Nix) exists because it's not trivial to manage the whole environment needed to run an application.

There's a reason everyone uses it for ops these days, and not some Windows thing.

forrestthewoods a day ago | parent [-]

Yes. The reason is that Linux made very bad design decisions.

> it’s not trivial to manage the whole environment needed to run the application

This is a distinctly Linux problem. Despite what Linux would lead you to believe it is not actually hard to run a computer program.

chpatrick 15 hours ago | parent [-]

Ok then where is the amazing non Linux deployment solution that everyone uses instead?

vilunov 3 days ago | parent | prev [-]

> Real life software is much more than just downloading a game and running it.

Real life software outside of Linux is pretty much just downloading and running it. Only in Linux we don't have a single stable OS ABI, forcing us to find the correct package for our specific distro, or to package the software ourselves.

chpatrick 3 days ago | parent [-]

Maybe for desktop use but when you want to deploy something to your server it's a bit more complicated than that.

zbentley 3 days ago | parent | prev [-]

> I’m increasingly convinced that the mere existence of a package manager (for programs, not source code) is a sign of a failed platform design

> Steam does not have this problem. Download game, play game.

These statements seem contradictory. Steam is a package manager. So is the Apple App Store. Sure, they have different UX than, say, apt/dnf/brew/apk/chocolatey, but they're conceptually package managers.

Given that, I'm unclear what the gripe is (though I'm totally down to rip on Snap/Flatpak; I won't rant here, but I did elsewhere: https://news.ycombinator.com/item?id=44069483). Is the issue with OS/vendor-maintained package managers? Or is the issue with package installers that invoke really complicated build systems at install time (e.g. package managers that install from source)?

forrestthewoods 2 days ago | parent [-]

This is getting into semantics. Personally I would not consider downloading a zip file from a GitHub releases page in a web browser to be using a “package manager”. But someone could try and make that argument.

None of this has formal definitions which makes it difficult to discuss.

Your rant on Snap/Flatpak was great.

The core gripe is that I want running computer programs on Linux to be easy and reliable. It is not. MacOS and Windows are far more reliable, and they don’t require (imho) package managers to do it.

zbentley 2 days ago | parent [-]

> The core gripe is that I want running computer programs on Linux to be easy and reliable. It is not.

No argument here.

What's interesting, though, is that package managers on Linux are the attempted solution to that problem. Without them, hand-managing dependencies and dependency discovery via the "download a zipfile from GitHub" approach just falls apart: said zipfile often wants to link against other libraries when it launches.

Windows (and runtimes like Golang) take a batteries-included approach by vendoring many/most dependency artifacts with binary distributions. MacOS app bundles do a bit of that, and also have a really consistent story about what system-level dependencies are available (which is only a feasible approach for MacOS because there's a single maintainer and distributor of the system).

But even on those platforms, things break down a lot! There are all sorts of problems for various Windows apps that need to be solved by "acquire so-and-so.dll and copy it into this app's install folder, or else its vendored version of that dll will break on your system". Homebrew on MacOS exists (and has highly variable complexity levels re: installation/dependency discovery) precisely because the amount of labor required to participate in the nice app bundle/MacOS native-app ecosystem is too great for many developers.

That said, there's not really a punchline here. It's complicated, I guess?

> Your rant on Snap/Flatpak was great.

Thank you!