Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

use fastchat conversations template #578

Merged
merged 16 commits into from
Sep 27, 2023
Merged

use fastchat conversations template #578

merged 16 commits into from
Sep 27, 2023

Commits on Sep 27, 2023

  1. use fastchat conversations template

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    7018c6f View commit details
    Browse the repository at this point in the history

  2. require fastchat (fschat) pip install

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    6cab750 View commit details
    Browse the repository at this point in the history

  3. handle roles dynamically from conversation

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    6449cda View commit details
    Browse the repository at this point in the history

  4. tweak fastchat conversation with a monkeypatch to get individual turns

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    374d567 View commit details
    Browse the repository at this point in the history

  5. fix up so it works with multiple conversation styles, and don't strip… 

    … the turns
    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    d411c70 View commit details
    Browse the repository at this point in the history

  6. fix sharegpt fixture now that we're using a more correct tokenization

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    8d64467 View commit details
    Browse the repository at this point in the history

  7. use a new prompter and support fastchat conversation type

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    51682d6 View commit details
    Browse the repository at this point in the history

  8. use sharegpt from prompt strategies now

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    6d0268e View commit details
    Browse the repository at this point in the history

  9. update docs, add chatml template

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    7add5bb View commit details
    Browse the repository at this point in the history

  10. add a newline after im_end token

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    3989f84 View commit details
    Browse the repository at this point in the history

  11. ensure we correctly set system message

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    b541ffd View commit details
    Browse the repository at this point in the history

  12. update per PR feedback to handle deprecated sharegpt types

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    0cd7eb1 View commit details
    Browse the repository at this point in the history

  13. don't add duplicate wandb req

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    06ea94f View commit details
    Browse the repository at this point in the history

  14. make sharegpt fields configurable from yml

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    52f9aef View commit details
    Browse the repository at this point in the history

  15. llama2 fixes

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    c312e9c View commit details
    Browse the repository at this point in the history

  16. don't fail fatally when turns are improper

    @winglian
    winglian committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    243d9e1 View commit details
    Browse the repository at this point in the history