Huawei releases MACaQ, its internal quantizer for local inference

(github.com)

44 points by thefox963 hours ago

7 comments

lukasc-ch23 minutes ago
People are reproducing it and creating GGUFs <a href="https://www.reddit.com/r/LocalLLaMA/s/36atJ2nNjh" rel="nofollow">https://www.reddit.com/r/LocalLLaMA/s/36atJ2nNjh</a>
Rabbit5040302012 hours ago
<a href="https://huawei-csl.com/blog/macaq/" rel="nofollow">https://huawei-csl.com/blog/macaq/</a><p>Why does some HN users seem to prefer GitHub page whenever available at expense of official site? I mean, Huawei is still sanctioned, anything they host third party outside China can disappear at any hour.
- nout1 hour ago
  I prefer GitHub, because I can see the code and immediately know where to click. Product pages are always full of various marketing shots, videos, etc that just takes more time to parse through.
- lukasc-ch21 minutes ago
  Looks like many of their repos there have been around for a while. Also not sure why we would sanction free stuff from them
- xpil112 hours ago
  [dead]
mocchibird2 hours ago
Did they release any model? Seems good for Strata
thefox963 hours ago
[dead]
utternerd2 hours ago
What a project name.
- QuantumNomad_2 hours ago
  Probably intended to reference macaque monkeys.
  - keyle1 hour ago
    I forgot my French, but isn't it incredibly rude?
    - PorciiVorbesc1 hour ago
      Why?
      - dmonitor1 hour ago
        I think the immature commenters are referring to the pronunciation being similar to "my cock"
        stdbrouw53 minutes ago
        It's also a racial slur in certain languages.
        PorciiVorbesc1 hour ago
        Aaa, thanks I didn't think of that.
    - IsTom49 minutes ago
      I'd assume the French know something about naming projects in the vein of Coq.
  - xpil112 hours ago
    Weird name. But looks like it. Their blog even says “So easy to use, even a macaque could get the hang of it.” (source: <a href="https://huawei-csl.com/blog/macaq/" rel="nofollow">https://huawei-csl.com/blog/macaq/</a> )
- 0xb0565e4862 hours ago
  xD
- ebx1 hour ago
  Just enough plausible deniability :P
- adrian_b1 hour ago
  I do not think that macaques would mind.
p-s-3 hours ago
[dead]