Does anyone know why all of these WebGPU LLM demos have you download the models to browser storage rather than letting you open a gguf already on your local drive? I have several models downloaded already that I would be interested in trying.

▲

ethan_smith a day ago | parent | next [-]

WebGPU's security model restricts direct file system access, requiring models to be loaded through fetch/cache APIs rather than local file paths.

▲

fooker a day ago | parent | prev [-]

Browsers are sandboxed away from user storage.

You can change this by changing settings, command line arguments, build flags, etc. But can’t really expect people to do this just to use your website.

▲

apitman a day ago | parent [-]

You can open a file for performant access in all major browsers. It's the same API used for uploading files (<input type="file" />), but you can also just load them into memory and do stuff.

▲

fooker a day ago | parent [-]

Sure, with the caveat that the file is specifically selected by the user.

	▲	phatskat 8 hours ago \| parent \| next [-]
		Which sounds ideal for this scenario, right?
	▲	baobun 16 hours ago \| parent \| prev [-]
		I read that as the ask, yes.