S-LoRA: Serving Thousands of Concurrent LoRA Adapters
Paper
•
2311.03285
•
Published
•
31
Coleman Hooper
chooper1
AI & ML interests
Efficient NLP
Recent Activity
upvoted
a
paper
16 days ago
Arbitrage: Efficient Reasoning via Advantage-Aware Speculation
upvoted
a
paper
2 months ago
ParallelBench: Understanding the Trade-offs of Parallel Decoding in
Diffusion LLMs
upvoted
a
paper
4 months ago
XQuant: Breaking the Memory Wall for LLM Inference with KV Cache
Rematerialization
Organizations
authored
a
paper
about 2 years ago