Weak-to-Strong Extrapolation Expedites Alignment
Paper
•
2404.16792
•
Published
•
11
Model Extrapolation Expedites Alignment
Better aligned models obtained by model extrapolation (ExPO)
-
-
chujiezheng/Mistral7B-PairRM-SPPO-ExPO
Text Generation • 7B • Updated • 8.75k -
chujiezheng/LLaMA3-iterative-DPO-final-ExPO
Text Generation • 8B • Updated • 8.83k • • 2 -
chujiezheng/Llama3-8B-Chinese-Chat-ExPO
Text Generation • 8B • Updated • 8.81k • • 1 -
chujiezheng/tulu-2-dpo-70b-ExPO
Text Generation • 69B • Updated • 8.8k -
chujiezheng/Smaug-Llama-3-70B-Instruct-ExPO
Text Generation • 71B • Updated • 8.91k • • 2 -
chujiezheng/Starling-LM-7B-beta-ExPO
Text Generation • 7B • Updated • 8.68k • 2 -
chujiezheng/Starling-LM-7B-alpha-ExPO
Text Generation • 7B • Updated • 8.73k -
chujiezheng/Llama3-70B-Chinese-Chat-ExPO
Text Generation • 71B • Updated • 8.02k • -
chujiezheng/internlm2-chat-20b-ExPO
Text Generation • 20B • Updated • 15.9k • 1 -
chujiezheng/internlm2-chat-7b-ExPO
Text Generation • 8B • Updated • 15.9k -
chujiezheng/Smaug-34B-v0.1-ExPO
Text Generation • 34B • Updated • 8.01k -
chujiezheng/tulu-2-dpo-13b-ExPO
Text Generation • 13B • Updated • 12 -
chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO
Text Generation • 8B • Updated • 21 • 16 -
chujiezheng/tulu-2-dpo-7b-ExPO
Text Generation • 7B • Updated • 11 -
chujiezheng/Snorkel-Mistral-PairRM-DPO-ExPO
Text Generation • 7B • Updated • 13 -
chujiezheng/neo_7b_instruct_v0.1-ExPO
Text Generation • 8B • Updated • 12 -
chujiezheng/zephyr-7b-beta-ExPO
Text Generation • 7B • Updated • 6 -
chujiezheng/zephyr-7b-alpha-ExPO
Text Generation • 7B • Updated • 8 • 1 -
chujiezheng/zephyr-7b-dpo-full-ExPO
Text Generation • 7B • Updated • 14 -
chujiezheng/internlm2-chat-1_8b-ExPO
Text Generation • 2B • Updated • 15 • 1