Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scripts to replicate the experiments from arXiv:2109.08267v1 #484

Merged
merged 57 commits into from
Nov 16, 2021

Conversation

ChrisCummins
Copy link
Contributor

@ChrisCummins ChrisCummins commented Nov 16, 2021

This patch set adds scripts to replicate the experiments from our CompilerGym pre-print, specifically:

  • examples/op_benchmarks.py for microbenchmarking operations.
  • examples/llvm_autotuning for autotuning the LLVM phase ordering environment.
  • examples/gcc_autotuning for autotuning the GCC command line flag environment (thanks @hughleat!).
  • examples/loop_tool_sweep.py for running CUDA inner loop size sweeps with loop_tool (thanks @bwasti!).
  • examples/gnn_cost_model for training a GNN cost model on the state transition dataset (thanks @bcui19!).
  • examples/llvm_rl for running reinforcement learning experiments using RLlib.

@ChrisCummins ChrisCummins added this to the v0.2.1 milestone Nov 16, 2021
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 16, 2021
Moving this class into the core compiler_gym library enables it to be
reused by other example code and other users.
Rather than adding submitit to the list of core dependencies, defer
module import until it is needed, printing an error message if it is
not available.
@codecov-commenter
Copy link

codecov-commenter commented Nov 16, 2021

Codecov Report

Merging #484 (8684962) into development (b3d23cf) will decrease coverage by 2.49%.
The diff coverage is 77.61%.

Impacted file tree graph

@@               Coverage Diff               @@
##           development     #484      +/-   ##
===============================================
- Coverage        87.81%   85.32%   -2.50%     
===============================================
  Files              111      113       +2     
  Lines             6182     6397     +215     
===============================================
+ Hits              5429     5458      +29     
- Misses             753      939     +186     
Impacted Files Coverage Δ
compiler_gym/wrappers/__init__.py 100.00% <ø> (ø)
...er_gym/third_party/inst2vec/inst2vec_preprocess.py 69.73% <50.00%> (-4.50%) ⬇️
compiler_gym/util/executor.py 74.43% <62.50%> (ø)
compiler_gym/util/registration.py 80.00% <66.66%> (-20.00%) ⬇️
compiler_gym/wrappers/datasets.py 95.91% <94.11%> (-1.06%) ⬇️
compiler_gym/envs/llvm/datasets/clgen.py 91.80% <100.00%> (ø)
compiler_gym/util/logging.py 100.00% <100.00%> (ø)
...loop_tool/service/loop_tool_compilation_session.py 14.76% <0.00%> (-74.50%) ⬇️
compiler_gym/envs/loop_tool/__init__.py 69.23% <0.00%> (-20.52%) ⬇️
... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b3d23cf...8684962. Read the comment docs.

@ChrisCummins ChrisCummins changed the title [examples] Add scripts to replicate experiments from arXiv:2109.08267v1 Add scripts to replicate the experiments from arXiv:2109.08267v1 Nov 16, 2021
@ChrisCummins ChrisCummins marked this pull request as ready for review November 16, 2021 14:54
@ChrisCummins ChrisCummins merged commit da7595e into facebookresearch:development Nov 16, 2021
@ChrisCummins ChrisCummins deleted the cgo-ae branch November 16, 2021 18:14
This was referenced Nov 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants