3 comments
created something similar but specific to llama-server. it takes advantage of logprob output and completes decisions in a single forward pass <a href="https://github.com/khimaros/verdict" rel="nofollow">https://github.com/khimaros/verdict</a>
we also have several jev type models available in seconds built on top of models on our router<p>mev (based on mercury)
gemmev (based on gemma)<p>also these take images input<p>zev, lev etc<p><a href="https://trustedrouter.com/docs/decide" rel="nofollow">https://trustedrouter.com/docs/decide</a>
But… why???