Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[KV Cache Injection] Causal Mask implementation for OPT and CodeGen #1677

Merged
merged 12 commits into from
Jul 27, 2023
Merged

[KV Cache Injection] Causal Mask implementation for OPT and CodeGen #1677

merged 12 commits into from
Jul 27, 2023

Commits on Jul 20, 2023

  1. initial commit

    @dbogunowicz
    dbogunowicz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    87fe3a0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/damian/refactor_injection

    @dbogunowicz
    dbogunowicz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    4be95cc View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/damian/refactor_injection

    @dbogunowicz
    dbogunowicz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    5c0280b View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Merge branch 'main' into feature/damian/refactor_injection

    @dbogunowicz
    dbogunowicz committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    0005056 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. [KV Cache Injection] Causal Mask for CodeGen (#1676) 

    * initial implementation; testing now

* fix a small blunder

* cleanup

---------

Co-authored-by: bogunowicz@arrival.com <bogunowicz@arrival.com>
    @dbogunowicz
    dbogunowicz and bogunowicz@arrival.com committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    9368269 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/damian/refactor_injection

    @dbogunowicz
    dbogunowicz committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    d927e9f View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. [KV Cache Injection] Causal Mask for OPT (#1688) 

    * initial implementation; testing now

* fix a small blunder

* cleanup

* initial implementation

* on to testing with deepsparse

---------

Co-authored-by: bogunowicz@arrival.com <bogunowicz@arrival.com>
    @dbogunowicz
    dbogunowicz and bogunowicz@arrival.com committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    db62ca0 View commit details
    Browse the repository at this point in the history

  2. replace boolean causal mask for int64 causal mask

    @dbogunowicz
    dbogunowicz committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    f4cfc8f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/damian/refactor_injection

    @dbogunowicz
    dbogunowicz committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    5f434bc View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. better logging info

    bogunowicz@arrival.com committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    6d3b2b9 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feature/damian/refact… 

    …or_injection
    bogunowicz@arrival.com committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    224412f View commit details
    Browse the repository at this point in the history

  3. allow transformations to be also a list

    bogunowicz@arrival.com committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    9b92f77 View commit details
    Browse the repository at this point in the history