Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AutoTuner] Add cost model for autotuner #58183

Merged
merged 3 commits into from
Oct 19, 2023

Conversation

Caozhou1995
Copy link
Contributor

@Caozhou1995 Caozhou1995 commented Oct 18, 2023

PR types

Others

PR changes

Others

Description

PCard-76571
This PR has added the following features:

  1. Built the infrastructure of the Cost Model for graphics memory
  2. Added infrastructure for DP estimation

In the future, we will add the cost model such as memory cost model and performance cost model of the llama series model for accelerated search.

@paddle-bot
Copy link

paddle-bot bot commented Oct 18, 2023

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@zhaoyinglia zhaoyinglia merged commit 0d531a7 into PaddlePaddle:develop Oct 19, 2023
28 checks passed
hitywt pushed a commit to hitywt/Paddle that referenced this pull request Oct 24, 2023
* add memory cost model

* support sharding stage prefix

* fix str type error
jiahy0825 pushed a commit to jiahy0825/Paddle that referenced this pull request Oct 26, 2023
* add memory cost model

* support sharding stage prefix

* fix str type error
danleifeng pushed a commit to danleifeng/Paddle that referenced this pull request Nov 14, 2023
* add memory cost model

* support sharding stage prefix

* fix str type error
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants