Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning
Paper • 2508.04581 • Published • 6
Denis Makhov
dennismak1994
AI & ML interests
None yet
Recent Activity
authored a paper about 2 months ago
COMPOT: Calibration-Optimized Matrix Procrustes Orthogonalization for Transformers Compression authored a paper about 2 months ago
ROCKET: Rapid Optimization via Calibration-guided Knapsack Enhanced Truncation for Efficient Model Compression authored a paper about 2 months ago
COSPADI: Compressing LLMs via Calibration-Guided Sparse Dictionary
LearningOrganizations
None yet
upvoted 4
papers about 2 months ago
COSPADI: Compressing LLMs via Calibration-Guided Sparse Dictionary Learning
Paper • 2509.22075 • Published • 23
ROCKET: Rapid Optimization via Calibration-guided Knapsack Enhanced Truncation for Efficient Model Compression
Paper • 2602.11008 • Published • 18
COMPOT: Calibration-Optimized Matrix Procrustes Orthogonalization for Transformers Compression
Paper • 2602.15200 • Published • 8