4 comments

  • xianshou23 days ago
    Incidentally, Chroma also produced the single best study on long-context degradation that I&#x27;ve come across:<p><a href="https:&#x2F;&#x2F;research.trychroma.com&#x2F;context-rot" rel="nofollow">https:&#x2F;&#x2F;research.trychroma.com&#x2F;context-rot</a><p>Before that, I cited nolima (<a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;LocalLLaMA&#x2F;comments&#x2F;1io3hn2&#x2F;nolima_longcontext_evaluation_beyond_literal&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;LocalLLaMA&#x2F;comments&#x2F;1io3hn2&#x2F;nolima_...</a>) constantly to illustrate how difficult tasks involving reasoning or multi-step information gathering degraded much faster than the needle-in-haystack benchmarks cited by the major labs. Now Chroma is the first stop. Nice job on the research!
  • mappu23 days ago
    Cool project!<p>I would hope &quot;native&quot; means at least either CPU-native code (i.e. not Typescript) or OS-native UI (i.e. not Electron) - what did you mean by it here?
    • pekim22 days ago
      Looking at <a href="https:&#x2F;&#x2F;github.com&#x2F;stepandel&#x2F;chroma-explorer&#x2F;blob&#x2F;master&#x2F;package.json" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;stepandel&#x2F;chroma-explorer&#x2F;blob&#x2F;master&#x2F;pac...</a> it looks like it&#x27;s using Electron.
    • arsentjev22 days ago
      it&#x27;s an Electron app that&#x27;s built to look like native. you&#x27;re right, the language is a bit misleading -- will update
    • tonyplee22 days ago
      files in <a href="https:&#x2F;&#x2F;github.com&#x2F;stepandel&#x2F;chroma-explorer&#x2F;tree&#x2F;master&#x2F;src" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;stepandel&#x2F;chroma-explorer&#x2F;tree&#x2F;master&#x2F;src</a> are .tsx (typescipt) code.
  • skeptrune23 days ago
    Very cool!