Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

imatrix : offload to GPU support #4957

Merged
merged 10 commits into from
Jan 17, 2024
Merged

imatrix : offload to GPU support #4957

merged 10 commits into from
Jan 17, 2024

Commits on Jan 15, 2024

  1. backend : add eval callback 

    ggml-ci
    @ggerganov
    ggerganov committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    65648b3 View commit details
    Browse the repository at this point in the history

  2. backend : group nodes in a single compute when user don't need them

    @ggerganov
    ggerganov committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    01b6f68 View commit details
    Browse the repository at this point in the history

  3. backend : clean-up the implementation 

    ggml-ci
    @ggerganov
    ggerganov committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    83f3d7a View commit details
    Browse the repository at this point in the history

  4. simple : do not perform tensor data copy if not needed

    @ggerganov
    ggerganov committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    e1b1db9 View commit details
    Browse the repository at this point in the history

  5. simple : fix

    @ggerganov
    ggerganov committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    e049380 View commit details
    Browse the repository at this point in the history

  6. imatrix : offload to GPU support

    @ggerganov
    ggerganov committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    0b2fca9 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. imatrix : fix ggml_mul_mat_id hanlding 

    ggml-ci
    @ggerganov
    ggerganov committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    a722d05 View commit details
    Browse the repository at this point in the history

  2. ci : add imatrix test 

    ggml-ci
    @ggerganov
    ggerganov committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    10b25e0 View commit details
    Browse the repository at this point in the history

  3. ci : rearrange output 

    ggml-ci
    @ggerganov
    ggerganov committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    4fb5284 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into gg/imatrix-gpu-4931 

    ggml-ci
    @ggerganov
    ggerganov committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    2917e6b View commit details
    Browse the repository at this point in the history