Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pipeline working #92

Open
wants to merge 27 commits into
base: develop
Choose a base branch
from
Open

Pipeline working #92

wants to merge 27 commits into from

Commits on Dec 6, 2023

  1. * Update pydantic to pydantic_settings 

    * Minor bug fixes for various library updates.
    @wtgee
    wtgee committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    0dd7dd5 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. Dumping notebook before major updates.

    @wtgee
    wtgee committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    54cbcd9 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2024

  1. A big dump. 💩

    @wtgee
    wtgee committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    84136a4 View commit details
    Browse the repository at this point in the history

  2. Change occurrences of ObservationPathInfo to ImagePathInfo.

    @wtgee
    wtgee committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    266c78d View commit details
    Browse the repository at this point in the history

  3. Specify panoptes-data version. 

    Add env.yml file for docker.
    @wtgee
    wtgee committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    7f3475b View commit details
    Browse the repository at this point in the history

  4. Fix image time key.

    @wtgee
    wtgee committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    afbd8b6 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2024

  1. * Use mounted paths instead of storage. 

    * cli returns path
* notebook processing return success flag...with errors in notebook it still processes successfully so we can't just raise exception.
    @wtgee
    wtgee committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    3e001fb View commit details
    Browse the repository at this point in the history

  2. Fixing paths

    @wtgee
    wtgee committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    bbcc76d View commit details
    Browse the repository at this point in the history

  3. Bucket name fixes.

    @wtgee
    wtgee committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    b75445e View commit details
    Browse the repository at this point in the history

  4. Adding to the gcloud build ignore file.

    @wtgee
    wtgee committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    dd423e2 View commit details
    Browse the repository at this point in the history

  5. Fixing the uploading of images and assets to the processed bucket.

    @wtgee
    wtgee committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    d1db828 View commit details
    Browse the repository at this point in the history

  6. More updates to paths. Not using volumes.

    @wtgee
    wtgee committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    412ec92 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Too many problems with file locations in processing bucket so incomin… 

    …g function was changed to not move them. Processing uses public url and works on that. Assets are uploaded to processed bucket but original image remains in incomign bucket.
    @wtgee
    wtgee committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    c50059e View commit details
    Browse the repository at this point in the history

  2. Always expect a public_url

    @wtgee
    wtgee committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    5c44ebc View commit details
    Browse the repository at this point in the history

  3. Don't ignore notebook, D'oh. 

    Fixing upload.
    @wtgee
    wtgee committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    7d3a345 View commit details
    Browse the repository at this point in the history

  4. If an error, send to notebook-errors prefix in the bucket.

    @wtgee
    wtgee committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    05bad95 View commit details
    Browse the repository at this point in the history

  5. Don't allow forcing to go on in an endless loop without manual interv… 

    …ention.
    @wtgee
    wtgee committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    0191237 View commit details
    Browse the repository at this point in the history

  6. Forced process boolean

    @wtgee
    wtgee committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    7a45c13 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Dumping some files.

    @wtgee
    wtgee committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d660b00 View commit details
    Browse the repository at this point in the history

  2. More dump.

    @wtgee
    wtgee committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d2b8912 View commit details
    Browse the repository at this point in the history

  3. Deletions and reogranizations.

    @wtgee
    wtgee committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    b0347fb View commit details
    Browse the repository at this point in the history

  4. More cleanup and reorganization.

    @wtgee
    wtgee committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    119d4a5 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Adding logging

    @wtgee
    wtgee committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    960144b View commit details
    Browse the repository at this point in the history

  2. Exception handling

    @wtgee
    wtgee committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    c15ce37 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Dump of working items.

    @wtgee
    wtgee committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    3d35e3c View commit details
    Browse the repository at this point in the history

  2. Upgrading to pyscaffold 4.x

    @wtgee
    wtgee committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    0b76716 View commit details
    Browse the repository at this point in the history

  3. Upgrading to pyscaffold 4.x - remove old rst docs.

    @wtgee
    wtgee committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    d7d0fd4 View commit details
    Browse the repository at this point in the history