I've been using MiniMax H3 on my M5 Pro 64GB MacBook Pro through ComfyUI. It works extremely well.<p>I had to modify the default ComfyUI workflows to use a GGUF quant (city96's ComfyUI-GGUF custom node, UnetLoaderGGUF in place of the stock loader) [0].<p>I use the model labeled Q5_K_M. There is Q8_0 available as well, which is 34GB and fits fine in 64GB unified memory if you keep resolution modest.<p>The main issue is speed, a ~9-second 480x864 clip at 20 steps takes me a bit over an hour.<p>There's a lot of great information and workflows available to follow on the r/StableDiffusion subreddit.<p>[0] <a href="https://huggingface.co/Abiray/MiniMax-H3-GGUF/tree/main/unet" rel="nofollow">https://huggingface.co/Abiray/MiniMax-H3-GGUF/tree/main/unet</a>
wow antirez does not sleep
This still requires 128Gb of memory, right? Me and my lowly 96Gb, like a commoner; missing out on the fun.
From README:<p>> On the 128 GB M5 Max, clean end-to-end image+audio and embedded-video+audio renders completed in 74.58 and 76.99 seconds respectively, each with about a 40.1 GB peak physical footprint and zero swaps.<p>Looks like it uses 40GB? So your 96GB mac setup should work fine i guess (Model itself is 33B)
How similar are Jeff Dean and Salvatore Sanfilippo?