From Muon to Gradient Clipping: Some Thoughts on QK Stability

 (mastergodzilla.github.io)

28 points | by Eridanus2 7 days ago ago

No comments yet.