TensorRT

[osmancanaksoy]

Search before asking

• I have searched the Yolo Tracking issues and found no similar bug report.

Question

Hello,
I have Yolov8 model converted to trt form. However, when I run this trt model with bot-sort, I experience a fps drop. Is there a way to convert Bot-Sort to trt form?
Thanks

[mikel-brostrom]

I have not tried this in a long time since I have switched to an Apple computer and it cannot be run in the pipeline as no GPU are available. But you can try this to export the ReID model:

python3 boxmot/appearance/reid_export.py --include engine --device 0 --dynamic

and then run inference with that model using:

python tracking/track.py --source 0 --reid-model <path_to_tensorrt_model>

[osmancanaksoy]

When ı try to run reid_export.py file ı have a error like this:
All the missing packages were installed successfully
2024-07-24 15:16:59.924 | INFO | boxmot.appearance.exporters.base_exporter:wrapper:17 -
Starting /boxmot/tracking/weights/osnet_x0_25_msmt17.pt export with EngineExporter...
2024-07-24 15:16:59.962 | ERROR | boxmot.appearance.exporters.base_exporter:wrapper:23 - Export failure: name 'ONNXExporter' is not defined

[mikel-brostrom]

Yup, I see the issue

[osmancanaksoy]

How to solve this problem ? Have you any idea ?

[mikel-brostrom]

Pull the latest, I just pushed some new code. It is hard for me to test this part as I don't have a computer with Nvidia card and CUDA at hand. It is not runnable in the CI either...

[osmancanaksoy]

Okay, I will check it and give you feedback.
Thanks

[osmancanaksoy]

The current error is as follows:
2024-07-24 16:27:38.526 | INFO | boxmot.appearance.exporters.base_exporter:wrapper:20 - Export success, saved as /boxmot/tracking/weights/osnet_x0_25_msmt17.onnx (0.9 MB)
2024-07-24 16:27:38.526 | INFO | boxmot.appearance.exporters.tensorrt_exporter:export:21 -
Starting export with TensorRT 10.2.0.post1...
2024-07-24 16:27:38.526 | ERROR | boxmot.appearance.exporters.base_exporter:wrapper:23 - Export failure: 'EngineExporter' object has no attribute 'verbose'

[mikel-brostrom]

Just added it 🚀

[github-actions]

👋 Hello, this issue has been automatically marked as stale because it has not had recent activity. Please note it will be closed if no further activity occurs.
Feel free to inform us of any other issues you discover or feature requests that come to mind in the future. Pull Requests (PRs) are also always welcomed!