There was a UK government GitHub repo that did something interesting with this kind of trick against S3 but I checked just now and the repo is a 404. Here are my notes about what it did: https://simonwillison.net/2025/Feb/7/sqlite-s3vfs/

Looks like it's still on PyPI though: https://pypi.org/project/sqlite-s3vfs/

You can see inside it with my PyPI package explorer: https://tools.simonwillison.net/zip-wheel-explorer?package=s...

▲ simonw 12 hours ago | parent | next [-]

I recovered it from https://archive.softwareheritage.org/browse/origin/directory... and pushed a fresh copy to GitHub here:

https://github.com/simonw/sqlite-s3vfs

This comment was helpful in figuring out how to get a full Git clone out of the heritage archive: https://news.ycombinator.com/item?id=37516523#37517378

Here's a TIL I wrote up of the process: https://til.simonwillison.net/github/software-archive-recove...

▲ QuantumNomad_ 12 hours ago | parent | next [-]

I also have a locally cloned copy of that repo from when it was on GitHub. Same latest commit as your copy of it.

From what I see in GitHub in your copy of the repo, it looks like you don’t have the tags.

Do you have the tags locally?

If you don’t have the tags, I can push a copy of the repo to GitHub too and you can get the tags from my copy.

▲ simonw 12 hours ago | parent [-]

I don't have the tags! It would be awesome if you could push that.

▲ QuantumNomad_ 11 hours ago | parent [-]

Uploaded here:

https://github.com/Quantum-Nomad/sqlite-s3vfs

▲ simonw 11 hours ago | parent [-]

Thanks for that, though actually it turns out I had them after all - I needed to run:

  git push --tags origin

	▲	QuantumNomad_ 11 hours ago \| parent [-]
		All the better :)

▲ bspammer 10 hours ago | parent | prev | next [-]

Doing all this in an hour is such a good example of how absurdly efficient you can be with LLMs.

▲ AceJohnny2 12 hours ago | parent | prev [-]

didn't you do something similar for Datasette, Simon?

▲

simonw 12 hours ago | parent [-]

Nothing smart with HTTP range requests yet - I have https://lite.datasette.io which runs the full Python server app in the browser via WebAssembly and Pyodide but it still works by fetching the entire SQLite file at once.

	▲	AceJohnny2 12 hours ago \| parent [-]
		oh! I must've been confused with your TIL where you linked to an explainer of this technique https://simonwillison.net/2021/May/2/hosting-sqlite-database... https://phiresky.github.io/blog/2021/hosting-sqlite-database... https://news.ycombinator.com/item?id=27016630

▲ billywhizz 8 hours ago | parent | prev [-]

i played around with this a while back. you can see a demo here. it also lets you pull new WAL segments in and apply them to the current database. never got much time to go any further with it than this.

https://just.billywhizz.io/sqlite/demo/#https://raw.githubus...