APOLLO: SGD-like Memory, AdamW-level Performance
Paper
•
2412.05270
•
Published
•
37
Hanqing Zhu
hanqing666
·
AI & ML interests
None yet
Recent Activity
published
a model
15 days ago
hanqing666/DAPO-lora-ds-1.5b-base-lora8-pissa-raw_add-lr1e-5-128-egFalse
updated
a model
15 days ago
hanqing666/DAPO-lora-ds-1.5b-base-lora64-pissa-raw_add-lr1e-5-128-egFalse
published
a model
15 days ago
hanqing666/DAPO-lora-ds-1.5b-base-lora64-pissa-raw_add-lr1e-5-128-egFalse
Organizations
authored
a
paper
about 1 year ago