Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add infer shape in dygraph #43822

Merged
merged 26 commits into from
Jun 28, 2022

Conversation

rainyfly
Copy link
Contributor

@rainyfly rainyfly commented Jun 24, 2022

PR types

Others

PR changes

Others

Describe

  1. profiler补充动态图op的input shapes信息。
  2. 修复丢失events的bug。当前的profiler为了尽可能减少采集数据时的性能消耗,采集数据时由采集器直接保存,等到profiler结束后才统一进行处理。采集器是thread local, 由线程开始时创建,线程结束时释放。但是很多thread local的数据在profiler停止前就被莫名destroyed,导致很多线程收集的events丢失,现在通过使采集器不由thread local的变量来owned修复这一bug。

Copy link
Contributor

@From00 From00 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@From00 From00 merged commit ff7da11 into PaddlePaddle:develop Jun 28, 2022
rainyfly added a commit to rainyfly/Paddle that referenced this pull request Jul 17, 2022
* record memory and op supplement info

* update

* update

* fix a bug

* fix memory recording

* fix a bug

* update

* update

* fix a bug

* update

* fix a bug

* fix a bug

* fix a bug

* update dygraph record

* add infer shape record

* fix

* fix

* fix

* add comments

* fix a bug

* fix

* fix
XiaoguangHu01 pushed a commit that referenced this pull request Jul 19, 2022
…44384)

* add serialization for new field in event node (#43405)

* add serialization for new field in event node

* fix a bug

* add more field to memory record (#43578)

* Add infer shape in dygraph (#43822)

* record memory and op supplement info

* update

* update

* fix a bug

* fix memory recording

* fix a bug

* update

* update

* fix a bug

* update

* fix a bug

* fix a bug

* fix a bug

* update dygraph record

* add infer shape record

* fix

* fix

* fix

* add comments

* fix a bug

* fix

* fix

* add record op info

* fix file mode

* add op input shape info

* fix dependency
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants