Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

HPO Benchmark Fixes and New Features #3925

Merged
merged 31 commits into from
Jul 26, 2021
Merged

HPO Benchmark Fixes and New Features #3925

merged 31 commits into from
Jul 26, 2021

Conversation

xiaowu0162
Copy link
Contributor

@xiaowu0162 xiaowu0162 commented Jul 11, 2021 •
edited
Loading

This pr fixes several issues found in the first version of the HPO Benchmark.
Update: the new feature "new search space for MLP" is also added in this pr.

  • Fix serialized run
  • Retry if tuners return None for generate_parameters
  • Check time limit
  • Check search space design
  • Cast params to int for sklearn
  • Split nnismall into three benchmarks
  • Update and expand documentation
  • New search space for MLP
  • Docs for new features

@xiaowu0162 xiaowu0162 changed the title HPO Benchmark V1 fixes HPO Benchmark V1 Fixes Jul 11, 2021
@xiaowu0162 xiaowu0162 closed this Jul 12, 2021
@xiaowu0162 xiaowu0162 reopened this Jul 12, 2021
@xiaowu0162 xiaowu0162 marked this pull request as ready for review July 12, 2021 03:32
@QuanluZhang
Copy link
Contributor

@xiaowu0162 suggest to further refine the doc

@xiaowu0162 xiaowu0162 marked this pull request as draft July 13, 2021 02:34
@xiaowu0162

This comment has been minimized.

Sign in to view
@xiaowu0162 xiaowu0162 changed the title HPO Benchmark V1 Fixes HPO Benchmark Fixs and New Features Jul 13, 2021
@xiaowu0162 xiaowu0162 marked this pull request as ready for review July 14, 2021 02:33
@QuanluZhang QuanluZhang mentioned this pull request Jul 14, 2021
Closed
@xiaowu0162 xiaowu0162 changed the title HPO Benchmark Fixs and New Features HPO Benchmark Fixes and New Features Jul 16, 2021
@QuanluZhang QuanluZhang merged commit 5bf2cb1 into microsoft:master Jul 26, 2021
@xiaowu0162 xiaowu0162 deleted the hpo-benchmark-v1-fix branch July 26, 2021 02:15
@acured acured mentioned this pull request Aug 16, 2021
Closed
78 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ultmaster ultmaster ultmaster approved these changes

@QuanluZhang QuanluZhang QuanluZhang approved these changes

@J-shang J-shang J-shang approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@xiaowu0162 @QuanluZhang @ultmaster @J-shang