Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SEDONA-285] Sedona Spark Jupyterlab docker image #939

Merged
merged 52 commits into from
Aug 2, 2023

Conversation

jiayuasu
Copy link
Member

@jiayuasu jiayuasu commented Aug 2, 2023

Did you read the Contributor Guide?

Is this PR related to a JIRA ticket?

What changes were proposed in this PR?

  1. Add Sedona Spark Jupyter lab image
    • Cross platform compilation on amd64 and arm64. For this purpose, only 1 dockerfile is allowed.
    • Build from official Sedona releases and Sedona master branch
    • Sedona in this container runs in a real cluster mode rather than pseudo mode.
    • JDK is explicitly set to Java 19 to avoid situations that the latest Sedona jar is compiled by Java > 11.
  2. Add docs for this

TODO

  1. Currently, the images were pushed to https://hub.docker.com/r/drjiayu/sedona-jupyterlab . I am working on requesting a ASF docker seat and then the images will be pushed to an official Sedona DockerHub repo.
  2. Add sedona spark zeppelin docker in 2nd PR
  3. Add sedona flink zeppelin docker in 3rd PR

How was this patch tested?

  1. Locally tested
  2. Pushed to https://hub.docker.com/r/drjiayu/sedona-jupyterlab

Did this PR include necessary documentation updates?

  • Yes, I have updated the documentation update.

Hadiya Kartikey and others added 30 commits May 26, 2023 22:58
…ooks, instead added binder folder as volume in docker-compose file.
… License as file header to .dockerfiles and .sh script
…pelin and jupyterlab. By default spark 3.3.2 version used but can be changed with --build-args. Added workflow for pushing image to dockerhub
Updated dokcerhub-deploy.yml workflow
@jiayuasu jiayuasu merged commit bb87200 into apache:master Aug 2, 2023
41 checks passed
@jiayuasu jiayuasu deleted the build-sedona-jupyter-docker branch August 2, 2023 18:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants