| ▲ | parthmule28 a day ago | ||||||||||||||||
I just tried the android application, really like the privacy first approach. Would you consider adding BYOK so that a user could have complete control over where inference happens? I realize it might not fit your architecture, but it seems like a neat optional setting. Either way, neat project. | |||||||||||||||||
| ▲ | arisAlexis a day ago | parent [-] | ||||||||||||||||
I did consider it at one point the problem is that the prompt and instruction following for formating and extracting tags, nouns etc and the json returns are unreliable if you switch models and especially if it's an older model. right now i'm using Gemma 4 and works smoothly so it would need to be BYOK for gemma only which is doable. If more people ask I could do it sure. | |||||||||||||||||
| |||||||||||||||||