4 comments

  • mstkllah1 hour ago
    Reads like an ad for Microsoft and its model because it's an article about a decision model that doesn't mention Jev or other decision models at all.
  • liuliu1 hour ago
    I haven't evaluated this one, but for what I have, it seem the pplx-decider-v1.2 (and its -flash variant) are pretty good. Anyone evaluated all these open-source decision models on their own tasks? (I evaluated on MonitoringBench).
    • GavinEke58 minutes ago
      I didn&#x27;t look specifically at open-source but I evaluated as many decision models as I could on openrouter against how good are they at detecting phishing, which isn&#x27;t the best use of these models but I was interested to see how they compared. <a href="https:&#x2F;&#x2F;emdashcyber.com&#x2F;phishnchips-decision-models&#x2F;" rel="nofollow">https:&#x2F;&#x2F;emdashcyber.com&#x2F;phishnchips-decision-models&#x2F;</a>
  • Den_VR38 minutes ago
    No pelicans riding bicycles on this one, eh?
    • bushbaba4 minutes ago
      Instead the right app is hotdog &#x2F; not hotdog
    • abhis379823 minutes ago
      Pelicans are deciding.
      • jumperabg14 minutes ago
        Pelicans deciding if they are going to ride a bicycle.
    • v3ss0n22 minutes ago
      Yeah the most usesless and stupidest bench .. I don&#x27;t know why LLM Community thinks its good idea to use that.. It can&#x27;t work on decision systems.
      • eblume11 minutes ago
        It&#x27;s a meme. Simon Willison started doing it because, I&#x27;m paraphrasing, it&#x27;s something that (at the time) was just sort of at the edge of what you could expect an LLM to be able to do, and also it&#x27;s somewhat of an impossible task since, of course, Pellicans can&#x27;t ride bicycles. From there, he started writing about it along with every major LLM release he covered. His coverage is generally well regarded (hi, Simon!) and so it sticks around. It&#x27;s never been intended as a serious benchmark.
  • selcuka49 minutes ago
    [dead]