LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
Paper • 2310.08659 • Published • 28
Rasmus Aagaard
rasgaard
AI & ML interests
Industrial PhD student, research on model compression techniques and efficient on-device inference
Recent Activity
upvoted a paper 30 minutes ago
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models upvoted a collection 4 days ago
Transformers.js V4 demos upvoted a paper 8 days ago
2D Matryoshka Sentence EmbeddingsOrganizations
upvoted a paper 30 minutes ago
upvoted a collection 4 days ago
upvoted a paper 8 days ago
upvoted an article 17 days ago
Article
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
•
128
upvoted a collection 18 days ago
liked a
dataset 21 days ago
updated a
dataset 22 days ago
published a
dataset 22 days ago
upvoted an article 28 days ago
Article
GGML and llama.cpp join HF to ensure the long-term progress of Local AI
- +4
•
488
upvoted an article 29 days ago
Article
I Let a Lobster Run My Jetson: What OpenClaw Taught Me About the Future of Computing
•
15
liked 2
models about 1 month ago
upvoted 2
articles about 1 month ago
Article
Transformers.js v4 Preview: Now Available on NPM!
•
77
Article
From Golden Gate Bridge to Broken JSON: Why Anthropic's SAE Steering Fails for Structured Output
•
22
upvoted a paper about 1 month ago
liked a
Space about 1 month ago
upvoted an article about 1 month ago
Article
Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
•
20
upvoted a paper about 2 months ago
upvoted an article about 2 months ago
Article
SmolLM-Smashed: Tiny Giants, Optimized for Speed
•
15
liked a
Space about 2 months ago