Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Paper
•
2504.20966
•
Published
•
31
Matthew Shorter
MattShorter
·
AI & ML interests
Self validating media generators
Organizations
upvoted
2
papers
8 months ago