Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Text Generation] Causal Mask Feature Branch #1126

Merged
merged 12 commits into from
Jul 27, 2023
Merged

[Text Generation] Causal Mask Feature Branch #1126

merged 12 commits into from
Jul 27, 2023

Commits on Jul 19, 2023

  1. Update helpers.py

    @dbogunowicz
    dbogunowicz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    b97fa1e View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Merge branch 'main' into feature/damian/causal_mask_fb

    @dbogunowicz
    dbogunowicz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    87bd213 View commit details
    Browse the repository at this point in the history

  2. correct implementation of the mapping from inputs to causal mask

    @dbogunowicz
    dbogunowicz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    d844518 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. [Text Generation] Causal Mask Support (#1127) 

    * initial commit

* clean up the PR

* working implementation

* Ben's review comments
    @dbogunowicz
    dbogunowicz committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    cbab152 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feature/damian/causal… 

    …_mask_fb
    @dbogunowicz
    dbogunowicz committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    f6d8efe View commit details
    Browse the repository at this point in the history

  3. [Text Generation] Multitoken prefill enablement (#1130) 

    * initial commit

* clean up the PR

* working implementation

* initial implementation, hacky lets clean it up

* ready for review

* few tiny quality improvements

* simplify the logic for computing num of unmasked bits for creating attention_mask for the multitoken prefill
    @dbogunowicz
    dbogunowicz committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    e324cdc View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. replace boolean causal mask for int64 causal mask

    @dbogunowicz
    dbogunowicz committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    91118e6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/damian/causal_mask_fb

    @dbogunowicz
    dbogunowicz committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    e08fda9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/damian/causal_mask_fb

    @dbogunowicz
    dbogunowicz committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    83a6312 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. Merge branch 'main' into feature/damian/causal_mask_fb

    @dbogunowicz
    dbogunowicz committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    3987e1b View commit details
    Browse the repository at this point in the history

  2. fix breaking tests

    @dbogunowicz
    dbogunowicz committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    e599583 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/damian/causal_mask_fb

    @dbogunowicz
    dbogunowicz committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    af3a3a5 View commit details
    Browse the repository at this point in the history