-
Notifications
You must be signed in to change notification settings - Fork 62
Issues: huggingface/lighteval
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[FT] Add nucleus sampling
feature request
New feature/request
#246
opened Jul 31, 2024 by
clefourrier
[BUG] Building from source does not package the needed jsonl associated files
bug
Something isn't working
#243
opened Jul 29, 2024 by
clefourrier
[FT] To keep New feature/request
target_for_fewshot_sorting
for another purpose
feature request
#240
opened Jul 28, 2024 by
sadra-barikbin
apply_target_perplexity_metric
pops only the first response
#192
opened May 20, 2024 by
sadra-barikbin
Could not initialize the JudgeOpenAI model
and openi
import error
bug
#166
opened Apr 22, 2024 by
lewtun
add transformers model to be used as judge
feature request
New feature/request
#153
opened Apr 10, 2024 by
NathanHB
Add Code-Centric Interface to LightEval for Enhanced Usability
#148
opened Apr 7, 2024 by
adithya-s-k
Do an intro notebook on how to use Improvements or additions to documentation
lighteval
documentation
#143
opened Apr 3, 2024 by
clefourrier
[New Task] Add AlpacaEval LC
feature request
New feature/request
new task
#139
opened Apr 2, 2024 by
YannDubs
Add a logger in the metric functions
feature request
New feature/request
#135
opened Mar 29, 2024 by
NathanHB
Previous Next
ProTip!
Follow long discussions with comments:>50.