Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

End2end #61

Merged
merged 55 commits into from
Jul 22, 2022
Merged

End2end #61

merged 55 commits into from
Jul 22, 2022

Conversation

Linaom1214
Copy link
Contributor

export the onnx model include nms,than accelerate with tensorrt,
in 1080Ti the end2end model (yolov7-tiny) fps is 212, but the origin is 172.
onnx_graphsurgeon is needed

@Linaom1214
Copy link
Contributor Author

the code reference https://github.com/zhiqwang/yolov5-rt-stack

AK391 and others added 4 commits July 9, 2022 07:23
update yolov7-tiny deploy cfg
update yolov7-tiny training cfg
@philipp-schmidt
Copy link
Contributor

how is this different from your previous PR?

@Linaom1214
Copy link
Contributor Author

how is this different from your previous PR?
the head return is difference, previous is worry

Previous

wh = (wh * 2) ** 2 * self.anchor_grid[i].expand(shape)  # the expand is error
return x if self.training else (torch.cat(z, 1), x)

Now

 return x if self.training else (z, ) if self.include_nms else (torch.cat(z, 1), x)

update link
add custom hyp
update default activation function
update path
add more tasks
update readme
update reparameterization
update readme
update aux training
update aux training
update aux training
update yolov7 prediction
update readme
@philipp-schmidt
Copy link
Contributor

Any reason to use EfficientNMS instead of BatchedNMSPlugin?

https://github.com/NVIDIA/TensorRT/tree/main/plugin/batchedNMSPlugin

@philipp-schmidt
Copy link
Contributor

Looking forward to it. Will 0.7 support yolov7 in some way? I guess all the changes from yolov5 apply to yolov7.

@zhiqwang
Copy link

Looking forward to it. Will 0.7 support yolov7 in some way? I guess all the changes from yolov5 apply to yolov7.

Yep, we have the plan to support YOLOv7 at 0.7.0 release.

@AlexeyAB
Copy link
Collaborator

@Linaom1214 Thanks! Could you provide Google Colab link how to do export and inference?

@Linaom1214
Copy link
Contributor Author

@Linaom1214 Thanks! Could you provide Google Colab link how to do export and inference?

Ok, here I provide a simple demo, the code training and inference are tested and the result is OK, and the end-to-end model export inference demo is provided. https://colab.research.google.com/drive/1JVC7Z_9163L7QL6SNxMyNeBCeFZpfqwc?usp=sharing

@philipp-schmidt
Copy link
Contributor

Nice notebook.

Do you know why the results are different though? One horse is missing. Maybe NMS parameters?

image
image

@Linaom1214
Copy link
Contributor Author

Nice notebook.

Do you know why the results are different though? One horse is missing. Maybe NMS parameters?

image image

The precision fp32 maybe correct , you can do more experiments. Looking forward to your feedback

@philipp-schmidt
Copy link
Contributor

Conf threshold was at 0.5 for TRT and 0.25 for Pytorch.
Works fine!

image

@AlexeyAB
Copy link
Collaborator

@Linaom1214 Thanks!

Could you solve these 2 conflicts, that arose because of another merged pull request? https://github.com/WongKinYiu/yolov7/pull/114/files

@Linaom1214
Copy link
Contributor Author

@Linaom1214 Thanks!

Could you solve these 2 conflicts, that arose because of another merged pull request? https://github.com/WongKinYiu/yolov7/pull/114/files

All test is right!

Colab Demo

Open In Colab

@AlexeyAB
Copy link
Collaborator

AlexeyAB commented Jul 22, 2022

@AlexeyAB AlexeyAB merged commit afdc86f into WongKinYiu:main Jul 22, 2022
wheemyungshin-nota pushed a commit to wheemyungshin/yolov7 that referenced this pull request Dec 1, 2023
* export end2end onnx model

* fixbug

* add web demo (WongKinYiu#58)

* Update README.md

* main code

update yolov7-tiny deploy cfg

* main code

update yolov7-tiny training cfg

* main code

@liguagua752109150 WongKinYiu#33 (comment)

* main code

@albertfaromatics WongKinYiu#35 (comment)

* main code

update link

* main code

add custom hyp

* main code

update default activation function

* main code

update path

* main figure

add more tasks

* main code

update readme

* main code

update reparameterization

* Update README.md

* main code

update readme

* main code

update aux training

* main code

update aux training

* main code

update aux training

* main figure

update yolov7 prediction

* main code

update readme

* main code

rename

* main code

rename

* main code

rename

* main code

rename

* main code

update readme

* main code

update visualization

* main code

fix gain for train_aux

* main code

update loss

* main code

update instance segmentation demo

* main code

update keypoint detection demo

* main code

update pose demo

* main code

update pose

* main code

update pose

* main code

update pose

* main code

update pose

* main code

update trace

* Update README.md

* main code

fix ciou

* main code

fix nan of aux training WongKinYiu#250 (comment) @hudingding

* support onnx to tensorrt convert (WongKinYiu#114)

* fuse IDetect (WongKinYiu#148)

* Fixes WongKinYiu#199 (WongKinYiu#203)

* minor fix

* resolve conflict

* resolve conflict

* resolve conflict

* resolve conflict

* resolve conflict

* resolve

* resolve

* resolve

* resolve

Co-authored-by: AK391 <81195143+AK391@users.noreply.github.com>
Co-authored-by: Alexey <AlexeyAB@users.noreply.github.com>
Co-authored-by: Kin-Yiu, Wong <102582011@cc.ncu.edu.tw>
Co-authored-by: linghu8812 <36389436+linghu8812@users.noreply.github.com>
Co-authored-by: Alexander <84590713+SashaAlderson@users.noreply.github.com>
Co-authored-by: Ben Raymond <ben@theraymonds.org>
Co-authored-by: AlexeyAB84 <alexeyab84@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet