So there are a zillion of these, including ones that do what yours does. But that being said, I'm going to always upvote every single one of them because this is better and more important that what the big companies are doing across the board.
Thank you! Would love to hear which ones you've used. Working with local files without anything going to the cloud was the main thing I wanted. I tried Jan, OpenWork, Chatbox and Lobe, and couldn't get that working well in any of them. If there's one I missed it would be great to check it out!!
Have you tried Open WebUI? It doesn't determine which model works best for your hardware, but it otherwise has a very large feature set with a large community, and runs offline by default. Geared more for technical users, however.
Orca works great.
In PasClaw, I specifically built it to do local embedding and other local only functionality. Whether it works well or not yet is another story.
Definitely check out Osaurus for macOS and Windows. Heavily privacy focused with e2ee iOS and iPadOS tethers.
Why does it have to be JS? With all this AI, why can't we ship native apps.
It's still pretty tricky to do this as a solo dev to keep feature parity in my experience (fun fact, even Claude's own Desktop app is made in Electron).<p>That being said, majority of the heavy LLM lifting happens natively with llama.cpp :)
Looks great. One thing I am missing is the ability to change the installation directory for the models. For space reasons, I want them to be on a different partition.
Did you happen to try bionic?<p><a href="https://lmstudio.ai/" rel="nofollow">https://lmstudio.ai/</a>