Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SEDONA-285] Sedona Spark Jupyterlab docker image #939

Merged
merged 52 commits into from
Aug 2, 2023
Merged

[SEDONA-285] Sedona Spark Jupyterlab docker image #939

merged 52 commits into from
Aug 2, 2023

Commits on May 26, 2023

  1. Added docker images for spark-sedona:1.3.1-zeppelin and spark-sedona1… 

    ….4.0-jupyterlab
    Hadiya Kartikey committed May 26, 2023
    Configuration menu
    Copy the full SHA
    9aa8914 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. Merge branch 'apache:master' into main

    @kartikeyhadiya
    kartikeyhadiya committed May 29, 2023
    Configuration menu
    Copy the full SHA
    0270034 View commit details
    Browse the repository at this point in the history

  2. Changes in jupyterlab dockerfile: 1) Removed duplicate data and noteb… 

    …ooks, instead added binder folder as volume in docker-compose file.
    Hadiya Kartikey committed May 29, 2023
    Configuration menu
    Copy the full SHA
    0843750 View commit details
    Browse the repository at this point in the history

  3. 1) Modified docker files to download jars on the fly. 2) Added Apache… 

    … License as file header to .dockerfiles and .sh script
    Hadiya Kartikey committed May 29, 2023
    Configuration menu
    Copy the full SHA
    b5a6f61 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Merge branch 'apache:master' into main

    @kartikeyhadiya
    kartikeyhadiya committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    5c595ce View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Merge branch 'apache:master' into main

    @kartikeyhadiya
    kartikeyhadiya committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    c609f4f View commit details
    Browse the repository at this point in the history

  2. Restructed docker files for spark to include only single copy for zep… 

    …pelin and jupyterlab. By default spark 3.3.2 version used but can be changed with --build-args. Added workflow for pushing image to dockerhub
    @kartikeyhadiya
    kartikeyhadiya committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    531c49a View commit details
    Browse the repository at this point in the history

  3. Update dockerhub-deploy.yml 

    Updated dokcerhub-deploy.yml workflow
    @kartikeyhadiya
    kartikeyhadiya committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    be63322 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Merge branch 'master' of https://github.com/yyy1000/sedona into docke… 

    …r-img
    @yyy1000
    yyy1000 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    97ac895 View commit details
    Browse the repository at this point in the history

  2. update sedona version

    @yyy1000
    yyy1000 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    a055e81 View commit details
    Browse the repository at this point in the history

  3. update sedona version

    @yyy1000
    yyy1000 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    6107193 View commit details
    Browse the repository at this point in the history

  4. update sedona version

    @yyy1000
    yyy1000 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    d3094e2 View commit details
    Browse the repository at this point in the history

  5. add bash script to accelarate

    @yyy1000
    yyy1000 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    a76104d View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. feat: add keplergl in Docker build

    @yyy1000
    yyy1000 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    acf3e83 View commit details
    Browse the repository at this point in the history

  2. feat: update pyspark dependency from Pipfile

    @yyy1000
    yyy1000 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    41e74fa View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. feat: remove unused command

    @yyy1000
    yyy1000 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    fdb04b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. remove install packages

    @yyy1000
    yyy1000 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    b71ea78 View commit details
    Browse the repository at this point in the history

  2. add bask-jdk in docker.sh

    @yyy1000
    yyy1000 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    bdaae12 View commit details
    Browse the repository at this point in the history

  3. feat: add curl install

    @yyy1000
    yyy1000 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    70eceed View commit details
    Browse the repository at this point in the history

  4. feat: add update

    @yyy1000
    yyy1000 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    d704e93 View commit details
    Browse the repository at this point in the history

  5. feat: spark-py

    @yyy1000
    yyy1000 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    3d3d167 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. feat: using python as base

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    bdd14b6 View commit details
    Browse the repository at this point in the history

  2. feat: using new base-jdk

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    ce96110 View commit details
    Browse the repository at this point in the history

  3. feat: add curl

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    c0adfdd View commit details
    Browse the repository at this point in the history

  4. feat: change pyspark jars

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    3f285b5 View commit details
    Browse the repository at this point in the history

  5. fix: nit

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    8b803e0 View commit details
    Browse the repository at this point in the history

  6. feat: try using spark-base as base

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    e0e2710 View commit details
    Browse the repository at this point in the history

  7. fix: degrade to java8

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    35c91b6 View commit details
    Browse the repository at this point in the history

  8. feat: change sedona jars

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    42b766b View commit details
    Browse the repository at this point in the history

  9. fix: nit

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    f73cb33 View commit details
    Browse the repository at this point in the history

  10. fix: change jars

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    4a42741 View commit details
    Browse the repository at this point in the history

  11. fix: nit

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    95b3e62 View commit details
    Browse the repository at this point in the history

  12. feat: also move pyspark jars

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    1de590d View commit details
    Browse the repository at this point in the history

  13. change move to cp

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    7746bd8 View commit details
    Browse the repository at this point in the history

  14. fix: nit

    @yyy1000
    yyy1000 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    1b17728 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. A working version

    @jiayuasu
    jiayuasu committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    51b62dd View commit details
    Browse the repository at this point in the history

  2. Finalize

    @jiayuasu
    jiayuasu committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    f6d83de View commit details
    Browse the repository at this point in the history

  3. Finalize

    @jiayuasu
    jiayuasu committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    c23e85c View commit details
    Browse the repository at this point in the history

  4. Add S3

    @jiayuasu
    jiayuasu committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    3d42805 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Merge branch 'apache:master' into build-sedona-jupyter-docker

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    b6f97e3 View commit details
    Browse the repository at this point in the history

  2. Refactor to enable cross platform compilation

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    6b44c61 View commit details
    Browse the repository at this point in the history

  3. Refactor

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    f8f50b7 View commit details
    Browse the repository at this point in the history

  4. Update

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    b4cfe7a View commit details
    Browse the repository at this point in the history

  5. Update the GitHub action file

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    f1e6cbd View commit details
    Browse the repository at this point in the history

  6. Fix the github action file

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    4173e3e View commit details
    Browse the repository at this point in the history

  7. Fix the GitHub action

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    ea55d62 View commit details
    Browse the repository at this point in the history

  8. Set up docker for MacOS

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    5561164 View commit details
    Browse the repository at this point in the history

  9. Manually trigger GitHub actions again

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    f3a9bca View commit details
    Browse the repository at this point in the history

  10. Drop docker build on Windows

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    206fc3b View commit details
    Browse the repository at this point in the history

  11. Fix a typo in docker-build

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    9b30750 View commit details
    Browse the repository at this point in the history

  12. Remove the progress option

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    cbd154e View commit details
    Browse the repository at this point in the history

  13. Add colima start

    @jiayuasu
    jiayuasu committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    95b9291 View commit details
    Browse the repository at this point in the history