From Muon to Gradient Clipping: Some Thoughts on QK Stability

(MasterGodzilla.github.io)

28 points by Eridanus27 days ago

0 comments