Skip to content

PIDray dataset detection using YoloV8 (compared with YoloV5)

Notifications You must be signed in to change notification settings

HumairaBano/yolov8-pidray

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

YoloV8 PIDray detection


1) About work

Automatic security inspection relying on computer vision technology is a challenging task in real-world scenarios due to many factors, such as:

  • intra-class variance,
  • class imbalance,
  • occlusion.

Most previous methods rarely touch the cases where the prohibited items are deliberately hidden in messy objects because of the scarcity of large-scale datasets, hindering their applications.

To address this issue and facilitate related research, was presented a large-scale dataset, named PIDray, which covers various cases in real-world scenarios for prohibited item detection.

This dataset has three degrees of difficulty: easy, hard, hidden.

Also, the authors of the article presented their approach for the detection and segmentation of these items.

You can find it in original repo.

2) Original approach

According to the article, the author proposes the selective dense attention network (SDANet), formed by the dense attention module and the dependency refinement module.

This method has the following metrics:

3) Yolo approach

For these case I`ve trained two detectors from ultralytics: new YoloV8 and pretty old YoloV5.

Both of them was trained on RTX 3090 for 300 epochs and batch size = 32.

To make the inference fast, I took a Small version of Yolo.

The detectors were compared after training.

YoloV8s inference

YoloV5s training results:


results

YoloV8s training results:


results

Comparison


As we can see, YoloV8s shows the mAP result better than YoloV5s by 11%. That`s very cool.

Method Easy mAP Hard mAP Hidden mAP Overall mAP Inference / ms (RTX 3090)
YoloV5s 0.738 0.715 0.493 0.648 ~6 ms/image
YoloV8s 0.818 0.78 0.589 0.729 ~6 ms/image

Moreover, light YoloV8s better than huge SDANet more than 15% (72.9 mAP vs 61.6 mAP)...

mAP difference between YoloV8s and YoloV5s by each class in hidden subset:

plot

4) Try it yourself


In my repository you can find everything you need to run YoloV8 on PIDray data.

The only thing you need is downloaded and converted from Coco-format to Yolo-format PIDray dataset. You can download it from original repo

Also, before start you need to install ultralytics:

pip install ultralytics

Now you can use pretrained YoloV8s weights from weights folder to predict or validate on PIDray data.

Check demo.ipynb for simple inference example using high-level ultralytics lib.

If you want more, check ultralytics YoloV8 docs.

About

PIDray dataset detection using YoloV8 (compared with YoloV5)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 99.9%
  • Python 0.1%