It's the output of a research paper; the authors are not trying to build up vLLM, and they probably have no incentive to do so. You can submit a PR, though! It's easier now while the divergence is low, so don't wait. Since there are six authors, I bet you could get help with the inevitable review chores if you just take the step of creating the PR.<p>edit: It might not be clear that it is based on vLLM 0.22, which is the current version: <a href="https://github.com/huawei-csl/KVarN/commit/d6290e99098d7426dcce01cdd8cc57a2eecf21a0" rel="nofollow">https://github.com/huawei-csl/KVarN/commit/d6290e99098d7426d...</a>. All you have to do is create a diff off it; it's fairly straightforward.