Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
•
63
Lukas PRO
sirluk
AI & ML interests
None yet
Recent Activity
updated
a Space
about 1 month ago
sirluk/trl-lora-without-regret-smollm3
published
a Space
about 1 month ago
sirluk/trl-lora-without-regret-smollm3
commented on
their
article
4 months ago
Efficient LLM Pretraining: Packed Sequences and Masked Attention
Organizations
published
an
article
about 1 year ago
published
an
article
almost 2 years ago
Article
Multilabel Classification using Mistral-7B on a single GPU with quantization and LoRA
•
26