Release v0.6.3

What's Changed

• Add the evaluation result for our latest model by @hendrydong in #286
• Add Ghost 7B Alpha to AlpacaEval by @lh0x00 in #288
• Add link for FsfairX-Zephyr-Chat-v0.1 by @hendrydong in #289
• add Qwen1.5-110B-Chat self-report results by @Lukeming-tsinghua in #291
• [ENH] verifying all the qwens by @YannDubs in #292
• Enable analyzing evaluators/annotators on data without multiple generator models by @rdnfn in #293
• Add Storm-7B to AlpacaEval by @yifan123 in #294
• Use verified by default by @YannDubs in #297
• Add SPPO-Mistral7B-PairRM to AlpacaEval by @Edward-Sun in #298
• Add ExPO results to AlpacaEval by @chujiezheng in #299
• Fix typo in README.md by @tongyx361 in #302
• Add Yi-Large Preview to AlpacaEval by @HyperdriveHustle in #304
• "Add Mistral-7B+RAHF-DUAL+LoRA to AlpacaEval" by @LiuAmber in #307
• [verified] Yi-large by @YannDubs in #309
• [ADD] GPT4-o by @YannDubs in #311
• [ENH] add LC SEM by @YannDubs in #317
• llama3 evaluator by @zhuang-li in #314
• Update README.md by @zhuang-li in #315
• [CLEAN] move evaluators lb llama3 by @YannDubs in #318
• [ENH] vicuna 1.5 by @YannDubs in #319
• Add Llama-3-Instruct-8B-SimPO to AlpacaEval by @xiamengzhou in #320
• [ENH] Use multi threading instead of processing by @YannDubs in #321
• Add Aligner 2B+GPT-4 Turbo (04/09) Results by @AlignInc in #324
• Add REBEL-Llama-3-8B-Instruct to AlpacaEval by @ZhaolinGao in #326
• [ENH&BUG] improve VLLM by @YannDubs in #330
• Add ExPO + Llama-3-Instruct-8B-SimPO results by @chujiezheng in #331
• fix model link by @chujiezheng in #332
• Add merlinite-7B-AOT to AlpacaEval by @imelnyk in #334
• [BUG] fix bs in VLLM and add chatml by @YannDubs in #338
• Add Together-MoA, Together-MoA-Lite to AlpacaEval by @IsThatYou in #342
• Add Nanbeige2-16B-Chat to AlpacaEval by @yuani114 in #345
• Add claude-3-5-sonnet-20240620 to AlpacaEval by @MarjovanLier in #348
• [BUG] trust repo alpaca_eval by @YannDubs in #349
• Add OpenPipe Mixture of Agents model to Alpaca Eval by @saum7800 in #347
• Add Storm-7B, Storm-7B (best-of-64) to AlpacaEval by @yifan123 in #344
• Add Infinity-Instruct-3M-0613-Mistral-7B to AlpacaEval by @cszhengyh in #351

New Contributors

• @hendrydong made their first contribution in #286
• @lh0x00 made their first contribution in #288
• @yifan123 made their first contribution in #294
• @Edward-Sun made their first contribution in #298
• @chujiezheng made their first contribution in #299
• @tongyx361 made their first contribution in #302
• @LiuAmber made their first contribution in #307
• @zhuang-li made their first contribution in #314
• @xiamengzhou made their first contribution in #320
• @ZhaolinGao made their first contribution in #326
• @imelnyk made their first contribution in #334
• @IsThatYou made their first contribution in #342
• @MarjovanLier made their first contribution in #348
• @saum7800 made their first contribution in #347
• @cszhengyh made their first contribution in #351

Full Changelog: v0.6.2...v0.6.3