Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add smoothing to curve plots and max F1 index #7798

Merged
merged 1 commit into from
May 13, 2022
Merged

Conversation

glenn-jocher
Copy link
Member

@glenn-jocher glenn-jocher commented May 13, 2022

@sergiossm

πŸ› οΈ PR Summary

Made with ❀️ by Ultralytics Actions

🌟 Summary

Introduction of a smoothing function for metric curves in Ultralytics' YOLOv5.

πŸ“Š Key Changes

  • A new smoothing function smooth() has been added to utils/metrics.py.
  • This function is applied to the F1 score curve and the mean of precision and recall curves, to obtain a smoothed version of these curves during the calculation of the best threshold.

🎯 Purpose & Impact

  • Purpose: To implement a box filter smoothing mechanism that averages the metrics over a specified fraction of the dataset, which helps in reducing noise and variance in the metrics.
  • Impact: This change will likely lead to more stable and reliable identification of the best threshold for model predictions based on the F1 score, and may also improve the visualization of average precision and recall curves. For users, this means that model evaluation could become more robust, potentially improving overall model performance when applied in real-world scenarios. πŸ“ˆπŸ§Ή

πŸ‘‰ Keep in mind that while smoothing can enhance the understanding of trends by reducing noise, it may also conceal short-term fluctuations that could be important depending on the use case.

@glenn-jocher glenn-jocher self-assigned this May 13, 2022
@glenn-jocher
Copy link
Member Author

F1_curve

@glenn-jocher glenn-jocher merged commit 8a4175c into master May 13, 2022
@glenn-jocher glenn-jocher deleted the update/smooth branch May 13, 2022 11:53
@b0gfasdfg
Copy link

I want to know what do this crve mean,thanks

@glenn-jocher
Copy link
Member Author

tdhooghe pushed a commit to tdhooghe/yolov5 that referenced this pull request Jun 10, 2022
ctjanuhowski pushed a commit to ctjanuhowski/yolov5 that referenced this pull request Sep 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants