Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gauntlet v0.1.0 yaml fixes #748

Merged
merged 116 commits into from
Nov 21, 2023
Merged

Gauntlet v0.1.0 yaml fixes #748

merged 116 commits into from
Nov 21, 2023

Commits on Aug 11, 2023

  1. update yaml

    bmosaicml committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    a4c83d3 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2023

  1. adding datasets

    bmosaicml committed Aug 18, 2023
    Configuration menu
    Copy the full SHA
    fbf43b0 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2023

  1. adding datasets

    bmosaicml committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    7d9c367 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Merge branch 'model_gauntlet_v0.1' of github.com:mosaicml/llm-foundry…

    … into model_gauntlet_v0.1
    bmosaicml committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    5054667 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. added agi eval

    bmosaicml committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    b32224a View commit details
    Browse the repository at this point in the history
  2. test CoT eval

    bmosaicml committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    46b27a3 View commit details
    Browse the repository at this point in the history
  3. fix broken eval yaml

    bmosaicml committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    4d82180 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. fix broken eval yaml

    bmosaicml committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    b1bbff1 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Merge branch 'model_gauntlet_v0.1' of github.com:mosaicml/llm-foundry…

    … into model_gauntlet_v0.1
    bmosaicml committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    7554b01 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. merge main

    bmosaicml committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    1845ffa View commit details
    Browse the repository at this point in the history
  2. debugging

    bmosaicml committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    1508a9f View commit details
    Browse the repository at this point in the history
  3. debugging

    bmosaicml committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    b10c16c View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. commit

    bmosaicml committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    85f081e View commit details
    Browse the repository at this point in the history
  2. commit

    bmosaicml committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    de28be4 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. commit

    bmosaicml committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    193b4e0 View commit details
    Browse the repository at this point in the history
  2. commit

    bmosaicml committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    e896c09 View commit details
    Browse the repository at this point in the history
  3. commit

    bmosaicml committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    a16aea1 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. restore mcli

    bmosaicml committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    6f5fc2c View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. adding simple tasks

    mcarbin committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    7968ca4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0f8b160 View commit details
    Browse the repository at this point in the history
  3. add simple human_eval

    bmosaicml committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    a84dda0 View commit details
    Browse the repository at this point in the history
  4. fix yaml

    bmosaicml committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    90a2dca View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    4c54e3d View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Configuration menu
    Copy the full SHA
    bcda9ef View commit details
    Browse the repository at this point in the history
  2. fix yaml

    bmosaicml committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    48060e1 View commit details
    Browse the repository at this point in the history
  3. Merge branch 'mike/human-eval-simple' of github.com:mcarbin/llm-found…

    …ry into human_eval_simple
    bmosaicml committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    4eee5c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. remove breakpoint

    bmosaicml committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9534d73 View commit details
    Browse the repository at this point in the history
  2. remove breakpoint

    bmosaicml committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    51d1b72 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. change bsz

    bmosaicml committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    e11bb34 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Configuration menu
    Copy the full SHA
    fb750f3 View commit details
    Browse the repository at this point in the history
  2. merge main

    bmosaicml committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    b50da7d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4b29f92 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    07c2c07 View commit details
    Browse the repository at this point in the history
  5. eval gauntlet cb

    bmosaicml committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    841eac0 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    94100fb View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    211def8 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Configuration menu
    Copy the full SHA
    5cf9b89 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9159dc8 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    043f473 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d1744fe View commit details
    Browse the repository at this point in the history
  5. add udpated readme

    bmosaicml committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    cdc2065 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    eb09668 View commit details
    Browse the repository at this point in the history
  7. Merge branch 'mike/human-eval-simple' of github.com:mcarbin/llm-found…

    …ry into human_eval_simple
    bmosaicml committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    cdbd3d1 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    adeb790 View commit details
    Browse the repository at this point in the history
  9. merge

    bmosaicml committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    26107e8 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    2fd5c16 View commit details
    Browse the repository at this point in the history
  11. merge2

    bmosaicml committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    c8a21c6 View commit details
    Browse the repository at this point in the history
  12. fix precommit

    bmosaicml committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    71cd420 View commit details
    Browse the repository at this point in the history
  13. Merge branch 'mike/human-eval-simple' of github.com:mcarbin/llm-found…

    …ry into human_eval_simple
    bmosaicml committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    ff68b53 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    bd8a9f8 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. add pii

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    47ebdfc View commit details
    Browse the repository at this point in the history
  2. restor line

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    2d17293 View commit details
    Browse the repository at this point in the history
  3. restor line

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    8b7abf1 View commit details
    Browse the repository at this point in the history
  4. finish non gen safety

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    ed3f52a View commit details
    Browse the repository at this point in the history
  5. add execution predicrtion

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    f96bbce View commit details
    Browse the repository at this point in the history
  6. add execution prediction

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    6ff9133 View commit details
    Browse the repository at this point in the history
  7. add execution prediction

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    bb7a847 View commit details
    Browse the repository at this point in the history
  8. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    6ee0f48 View commit details
    Browse the repository at this point in the history
  9. change mosaicml reqs

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    f332091 View commit details
    Browse the repository at this point in the history
  10. change mosaicml reqs

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    bb89c97 View commit details
    Browse the repository at this point in the history
  11. fix error

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    966b1bb View commit details
    Browse the repository at this point in the history
  12. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    977b48f View commit details
    Browse the repository at this point in the history
  13. comment

    bmosaicml committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    e15246e View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. test smaller beams

    bmosaicml committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    e40463b View commit details
    Browse the repository at this point in the history
  2. tesT

    bmosaicml committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    4a4d021 View commit details
    Browse the repository at this point in the history
  3. tesT

    bmosaicml committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    c5e30ec View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. tesT

    bmosaicml committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    19c8b2b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    441b004 View commit details
    Browse the repository at this point in the history
  3. add coding task

    bmosaicml committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    3025517 View commit details
    Browse the repository at this point in the history
  4. tesT

    bmosaicml committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    5e444e3 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. finish eval

    bmosaicml committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    b55bdda View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. finish data

    bmosaicml committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    2d77a0e View commit details
    Browse the repository at this point in the history
  2. fix

    bmosaicml committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c025ac4 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. fix

    bmosaicml committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    2702e15 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d393603 View commit details
    Browse the repository at this point in the history
  3. remove strategyqa cot

    bmosaicml committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    0350950 View commit details
    Browse the repository at this point in the history
  4. merge

    bmosaicml committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    27754e8 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. remove

    bmosaicml committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    b00a806 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. remove

    bmosaicml committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    7b68b55 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    57e35cd View commit details
    Browse the repository at this point in the history
  3. foo

    bmosaicml committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    814a8c9 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. edit

    bmosaicml committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    b142b57 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Configuration menu
    Copy the full SHA
    a56b30e View commit details
    Browse the repository at this point in the history
  2. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    368d232 View commit details
    Browse the repository at this point in the history
  3. fix

    bmosaicml committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    d86ece1 View commit details
    Browse the repository at this point in the history
  4. rm breakpoint

    bmosaicml committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    0477773 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. rm breakpoint

    bmosaicml committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    7fed6a2 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. Configuration menu
    Copy the full SHA
    48bf32b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f2f59df View commit details
    Browse the repository at this point in the history
  3. merge

    bmosaicml committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    01b3103 View commit details
    Browse the repository at this point in the history
  4. remove import

    bmosaicml committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    20aeafd View commit details
    Browse the repository at this point in the history
  5. remove import

    bmosaicml committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    46b7d72 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. restore files

    bmosaicml committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    93fa556 View commit details
    Browse the repository at this point in the history
  2. restore

    bmosaicml committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    f17f8c4 View commit details
    Browse the repository at this point in the history
  3. restore

    bmosaicml committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    a9606b4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cd08024 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2023

  1. Configuration menu
    Copy the full SHA
    f0c0b9d View commit details
    Browse the repository at this point in the history
  2. edit yamls

    bmosaicml committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    4572056 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    297bfa2 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. fix yamllint

    bmosaicml committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    e6b696f View commit details
    Browse the repository at this point in the history
  2. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    a1f8ffb View commit details
    Browse the repository at this point in the history
  3. restore mpt eval

    bmosaicml committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    6014dd4 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Configuration menu
    Copy the full SHA
    90ef388 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. Configuration menu
    Copy the full SHA
    1357cb8 View commit details
    Browse the repository at this point in the history
  2. finish

    bmosaicml committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    65d9604 View commit details
    Browse the repository at this point in the history
  3. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    dc525be View commit details
    Browse the repository at this point in the history
  4. follow up

    bmosaicml committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    d5f3139 View commit details
    Browse the repository at this point in the history
  5. fix

    bmosaicml committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    00a0426 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Configuration menu
    Copy the full SHA
    5e2101d View commit details
    Browse the repository at this point in the history
  2. precommit

    bmosaicml committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    4bc2594 View commit details
    Browse the repository at this point in the history
  3. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    6eb14a5 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c1e2fc9 View commit details
    Browse the repository at this point in the history
  5. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    970a4df View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    0d650c1 View commit details
    Browse the repository at this point in the history
  7. precommit

    bmosaicml committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    afbd992 View commit details
    Browse the repository at this point in the history
  8. Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…

    …y into execution_prediction
    bmosaicml committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    fd890fe View commit details
    Browse the repository at this point in the history