2 comments
What was the most difficult challenge for you guys with this project?<p>Also I'm a little intrigued on looking into efficiency techniques for video gen. What are current research directions in that field and promising directions you are particularly interested in? Any pointers for beginners?
I wonder how this behaves when quantized, and how far are we from being able to run something like this purely in the browser with WebGPU.<p>If you swap the text encoder for something like T5-small or CLIP, this could be <2.5Gb at INT4; doable on a lot of machines.