Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Eval Loss #3504

Open
naimavahab opened this issue Jul 30, 2024 · 1 comment
Open

Eval Loss #3504

naimavahab opened this issue Jul 30, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@naimavahab
Copy link

how can i plot the eval loss during finetuning using composer? I am able to get f1,acc scores, but by default it's not plotting eval loss in wandb
@naimavahab naimavahab added the bug Something isn't working label Jul 30, 2024
@mvpatel2000
Copy link
Contributor

it's not explicitly computed, but you can add a metric for it or write a callback calling model.loss on event EVAL_AFTER_FORWARD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@naimavahab @mvpatel2000