Show HN: Flide: Make Jev-like decision models up to 9.5x faster

(github.com)

12 points by unikcc3 hours ago

1 comments

  • unikcc2 hours ago
    Hi HN! I&#x27;m one of the Flide team.<p>We built Flide from scratch to make Jev-like decision model inference up to 9.5x faster than vLLM and SGLang, while keeping exactness.<p>Here is the source code: <a href="https:&#x2F;&#x2F;github.com&#x2F;OmniJev&#x2F;Flide" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;OmniJev&#x2F;Flide</a><p>Look forward to hearing your feedback and ideas!