Speedup model init on CPU (by 10x+ for llama-3-8B as one example) #31771
CircleCI Checks / setup_and_quality
succeeded
Jul 16, 2024 in 3m 21s
Workflow: setup_and_quality
- check_circleci_user - Success
- check_code_quality - Success
- check_repository_consistency - Success
- fetch_tests - Success
Loading