I would like a standardized API for local AI to exist outside of the Apple ecosystem. The Prompt API is Chrome is halfway there.

* What is the answer to local AI for native apps on Windows?

* What is the answer to local AI for Linux?

This is a big opportunity for Linux, given the high quality of open-weight models. I hope some answer emerges before designs fracture and we get a dozen mutually incompatible answers.

▲

franze 10 hours ago | parent | next [-]

i researched that question for apfel https://github.com/Arthur-Ficial/apfel and standardized API is openai api so thats what i went with

▲

hackyhacky 10 hours ago | parent [-]

OpenAI's API is not local AI.

	▲	zozbot234 10 hours ago \| parent [-]
		Most local AI servers expose that API.

▲

teravor 9 hours ago | parent | prev [-]

> What is the answer to local AI for Linux?

run an ai api endpoint on a unix domain socket