Ultralytics
Default box loss gain is 7.5 yet search space for Ray tune is tune.uniform(0.02, 0.2) #2667
-
|
Hello, Default box loss gain is 7.5 yet search space for Ray tune is tune.uniform(0.02, 0.2) Is it a mistake ? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
@ExtReMLapin hello! The default box loss gain of 7.5 is a starting point based on empirical results and is used as a default hyperparameter for training. The search space for Ray Tune, however, is intentionally set to a different range. This is because hyperparameter tuning often explores a wide variety of values, some of which may be significantly lower or higher than the defaults, to potentially discover better performing configurations. The range for Ray Tune is not a mistake; it's designed to explore hyperparameters that could lead to better performance, even if they are quite different from the defaults. The tuning process can sometimes reveal surprising insights that challenge our initial assumptions. 😊 For more details on hyperparameter tuning and other functionalities, you can refer to our documentation at https://docs.ultralytics.com. |
Beta Was this translation helpful? Give feedback.
@ExtReMLapin hello!
The default box loss gain of 7.5 is a starting point based on empirical results and is used as a default hyperparameter for training. The search space for Ray Tune, however, is intentionally set to a different range. This is because hyperparameter tuning often explores a wide variety of values, some of which may be significantly lower or higher than the defaults, to potentially discover better performing configurations.
The range for Ray Tune is not a mistake; it's designed to explore hyperparameters that could lead to better performance, even if they are quite different from the defaults. The tuning process can sometimes reveal surprising insights that challenge our i…