GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length
Paper
•
2310.00576
•
Published
•
2
Scott Chang
z7631614
·
AI & ML interests
None yet
Recent Activity
liked
a dataset
13 days ago
allenai/dolma3_longmino_pool
authored
a paper
10 months ago
GrowLength: Accelerating LLMs Pretraining by Progressively Growing
Training Length
authored
a paper
10 months ago
LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
Organizations
