Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPU jpeg decoder: add batch support and hardware decoding #8496

Merged
merged 41 commits into from
Aug 7, 2024
Merged

GPU jpeg decoder: add batch support and hardware decoding #8496

merged 41 commits into from
Aug 7, 2024

Commits on Apr 23, 2024

  1. Adding GPU acceleration to encode_jpeg 

    Summary:
I'm adding GPU support to the existing torchvision.io.encode_jpeg function. If the input tensors are on the GPU, the CUDA version will be used and the CPU version otherwise.
Additionally, I'm adding a new function torchvision.io.encode_jpegs (plural) with uses a fused kernel and may be faster than successive calls to the singular version which incurs kernel launch overhead for each call.
If it's alright, I'll be happy to refactor decode_jpeg to follow this
convention in a follow up PR.

Test Plan:
1. pytest test -vvv
2. ufmt format torchvision
3. flake8 torchvision

Reviewers:

Subscribers:

Tasks:

Tags:
    @deekay42
    deekay42 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    133d7c1 View commit details
    Browse the repository at this point in the history

  2. fix test cases

    @deekay42
    deekay42 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4cc30cb View commit details
    Browse the repository at this point in the history

  3. fix lints

    @deekay42
    deekay42 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    2db02f0 View commit details
    Browse the repository at this point in the history

  4. fix lints2

    @deekay42
    deekay42 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    6acef83 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. latest round of updates

    @deekay42
    deekay42 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    ae0450d View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. fix lints

    @deekay42
    deekay42 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    a799c53 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Ignore mypy

    @NicolasHug
    NicolasHug committed May 31, 2024
    Configuration menu
    Copy the full SHA
    c5810ff View commit details
    Browse the repository at this point in the history

  2. Add comment

    @NicolasHug
    NicolasHug committed May 31, 2024
    Configuration menu
    Copy the full SHA
    ff40253 View commit details
    Browse the repository at this point in the history

  3. minor test refactor

    @NicolasHug
    NicolasHug committed May 31, 2024
    Configuration menu
    Copy the full SHA
    0972863 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of github.com:pytorch/vision into add_gpu_encode

    @NicolasHug
    NicolasHug committed May 31, 2024
    Configuration menu
    Copy the full SHA
    4ce658d View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Merge branch 'pytorch:main' into add_gpu_encode

    @deekay42
    deekay42 authored Jun 4, 2024
    Configuration menu
    Copy the full SHA
    65372a3 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Caching nvjpeg vars across calls

    @deekay42
    deekay42 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    62e072a View commit details
    Browse the repository at this point in the history

  2. Update if nvjpeg not found

    @deekay42
    deekay42 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    b3d06cb View commit details
    Browse the repository at this point in the history

  3. Adding gpu decode

    @deekay42
    deekay42 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    fcf8a78 View commit details
    Browse the repository at this point in the history

  4. Update if nvjpeg not found

    @deekay42
    deekay42 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    f190d99 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. merge

    @deekay42
    deekay42 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c471db8 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'main' of github.com:pytorch/vision into add_gpu_encode

    @NicolasHug
    NicolasHug committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    b5eaa89 View commit details
    Browse the repository at this point in the history

  2. Revert "Ignore mypy" 

    This reverts commit c5810ff.
    @NicolasHug
    NicolasHug committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    5051050 View commit details
    Browse the repository at this point in the history

  3. Add comment

    @NicolasHug
    NicolasHug committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    136f790 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. minor changes to address ahmad's comments

    @deekay42
    deekay42 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    0a88d27 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'add_gpu_encode' of https://github.com/deekay42/vision i… 

    …nto add_gpu_encode
    @deekay42
    deekay42 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    df60183 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. add dtor log messages

    @deekay42
    deekay42 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    f3c8a72 View commit details
    Browse the repository at this point in the history

  2. Skip CUDA cleanup altogether

    @deekay42
    deekay42 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    117d1f1 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'main' into add_gpu_encode

    @NicolasHug
    NicolasHug authored Jun 13, 2024
    Configuration menu
    Copy the full SHA
    21eca4c View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'add_gpu_encode' into add_gpu_decode

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    64f2cf9 View commit details
    Browse the repository at this point in the history

  2. disable cleanup

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    156e250 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'add_gpu_decode'

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3efb658 View commit details
    Browse the repository at this point in the history

  4. disable cleanup

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5f77eea View commit details
    Browse the repository at this point in the history

  5. merge

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ac8edd2 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'add_gpu_encode' into add_gpu_decode

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    cebe75f View commit details
    Browse the repository at this point in the history

  7. Merge branch 'deekay42-add_gpu_decode'

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2e60784 View commit details
    Browse the repository at this point in the history

  8. merge

    @deekay42
    deekay42 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    01a5621 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. ahmad's comments

    @deekay42
    deekay42 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    ccdafd4 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Merge branch 'main' of github.com:pytorch/vision into add_gpu_decode

    @NicolasHug
    NicolasHug committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    c44599d View commit details
    Browse the repository at this point in the history

  2. Fix syntax

    @NicolasHug
    NicolasHug committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    25ca905 View commit details
    Browse the repository at this point in the history

  3. self address a few comments / nits

    @NicolasHug
    NicolasHug committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    43b317b View commit details
    Browse the repository at this point in the history

  4. lint

    @NicolasHug
    NicolasHug committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    223f8a0 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. ahmads comments 2

    @deekay42
    deekay42 committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    863cf76 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. lint

    @NicolasHug
    NicolasHug committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    fc28c60 View commit details
    Browse the repository at this point in the history

  2. lint

    @NicolasHug
    NicolasHug committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    dcd1c07 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into add_gpu_decode

    @NicolasHug
    NicolasHug authored Aug 7, 2024
    Configuration menu
    Copy the full SHA
    efa746d View commit details
    Browse the repository at this point in the history