Skip to content

Commit

Permalink
fix: warning should not show if eval_batch_size not provided (axolotl…
Browse files Browse the repository at this point in the history
  • Loading branch information
NanoCode012 committed Nov 25, 2023
1 parent a9929cb commit d14be20
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion src/axolotl/utils/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,11 @@ def validate_config(cfg):
"batch_size is not recommended. Please use gradient_accumulation_steps instead.",
"To calculate the equivalent gradient_accumulation_steps, divide batch_size / micro_batch_size / number of gpus.",
)
if cfg.eval_batch_size != cfg.micro_batch_size:
if (
cfg.eval_batch_size
and cfg.micro_batch_size
and cfg.eval_batch_size != cfg.micro_batch_size
):
LOG.warning(
"eval_batch_size != micro_batch_size. This can lead to VRAM instability."
)
Expand Down

0 comments on commit d14be20

Please sign in to comment.