Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Self taught evaluators project release #7

Merged
merged 56 commits into from
Sep 26, 2024
Merged

Self taught evaluators project release #7

merged 56 commits into from
Sep 26, 2024

Conversation

uralik
Copy link
Contributor

@uralik uralik commented Sep 26, 2024

We release

  • evaluation and inference instructions
  • data generation pipeline scripts
  • dataset loading example
  • training configs and fairseq2 commands for training

xianxl and others added 30 commits September 23, 2024 20:47
@xianxl
add prompt templates and readme
8627a36
@xianxl
Update README.md
1bf73bd
@xianxl
update readme
837e3f9
@xianxl
Add files via upload
bf0d48e
@xianxl
Delete projects/self_taught_evaluator/figures/CoPE.png
0adbfe1
@xianxl
Update README.md
eb66ca7
@xianxl
Add files via upload
f86ca84
@xianxl
Update README.md
dfcd8f4
@xianxl
Update README.md
ce14a98
@xianxl
more scripts
a77cad3
@xianxl
Add files via upload
63235bc
@xianxl
Update README.md
a2bdec4
@xianxl
Delete projects/self_taught_evaluator/figures/self_taught_sft.png
13bc0d1
@xianxl
Delete projects/self_taught_evaluator/figures/self_taught_sft.pdf
4ee7e7e
evals
4310311
use public model dirs
947e800
small fix
8158fe0
headers added
38de806
rename dir
dbffc0c
typo
c442201
@xianxl
add training data prepration scripts
3d18c8a
nits
b5000eb
training config for dpo added
a5eb8da
@xianxl
nit
2a24bcf
@xianxl
Update README.md
018b999
@xianxl
Update README.md
1b81556
@xianxl
add headers
0c53db4
@xianxl
headers
d4ada58
@xianxl
black
76d08ea
@xianxl
minor fix
45eca68
@janedwivedi
Copy link

Should requirements.txt be in the highest dir level? Or maybe change "Please refer to src/requirements.txt"?

Golovneva
Golovneva reviewed Sep 26, 2024
View reviewed changes
.pre-commit-config.yaml Outdated Show resolved Hide resolved
Golovneva
Golovneva reviewed Sep 26, 2024
View reviewed changes
projects/self_taught_evaluator/README.md Outdated Show resolved Hide resolved
projects/self_taught_evaluator/README.md Show resolved Hide resolved
projects/self_taught_evaluator/README.md Outdated Show resolved Hide resolved
projects/self_taught_evaluator/README.md Show resolved Hide resolved
projects/self_taught_evaluator/README.md Outdated Show resolved Hide resolved
projects/self_taught_evaluator/src/utils.py Outdated Show resolved Hide resolved
projects/self_taught_evaluator/src/utils.py Outdated Show resolved Hide resolved
projects/self_taught_evaluator/src/utils.py Outdated Show resolved Hide resolved
ram/data_utils.py Show resolved Hide resolved
ram/data_utils.py Outdated Show resolved Hide resolved
Ilia Kulikov and others added 10 commits September 26, 2024 21:48
removing large files
507df50
@uralik @Golovneva
Update projects/self_taught_evaluator/README.md
220dd0e 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/README.md
491c055 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/README.md
4353c3d 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/README.md
c9b646c 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/utils.py
3babf06 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/utils.py
d77db4f 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/utils.py
3666f35 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update ram/data_utils.py
e36a20c 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik
Update projects/self_taught_evaluator/README.md
51fb34f
Golovneva
Golovneva approved these changes Sep 26, 2024
View reviewed changes
Copy link
Contributor

@Golovneva Golovneva left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

uralik and others added 12 commits September 26, 2024 14:54
@uralik @Golovneva
Update projects/self_taught_evaluator/README.md
797d20d 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/README.md
09a2b85 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/run_rewardbench.sh
6d0b403 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/run_inference_wvllm.sh
9da2c6b 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/prepare_dpo_data.py
13af802 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/prepare_dpo_data.py
17038db 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/prepare_dpo_data.py
3786ce0 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
@uralik @Golovneva
Update projects/self_taught_evaluator/src/utils.py
4c0e090 
Co-authored-by: Golovneva <103262907+Golovneva@users.noreply.github.com>
link update
9a9f332
sorting
5d59ad6
adding test scripts to preprocess hf dataset, adding fairseq2 asset c…
4165264 
…ard example
mentioning data processing script
441d653
@uralik uralik merged commit 65b6833 into main Sep 26, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Golovneva Golovneva Golovneva approved these changes

@janiceblue janiceblue Awaiting requested review from janiceblue

@tianlu-wang tianlu-wang Awaiting requested review from tianlu-wang

@jaseweston jaseweston Awaiting requested review from jaseweston

@janedwivedi janedwivedi Awaiting requested review from janedwivedi

@PingYu-iris PingYu-iris Awaiting requested review from PingYu-iris

@xianxl xianxl Awaiting requested review from xianxl

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@uralik @janedwivedi @Golovneva @facebook-github-bot @xianxl