Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Public cloud storage needed to support cookbook data #155

Closed
clyne opened this issue Jul 6, 2023 · 2 comments
Closed

Public cloud storage needed to support cookbook data #155

clyne opened this issue Jul 6, 2023 · 2 comments
Assignees
Labels
infrastructure Infrastructure related issue

Comments

@clyne
Copy link
Contributor

clyne commented Jul 6, 2023

For cookbooks that require data sets that are too large for GitHub, and are not available from freely accessible source, we need to provide an alternate storage location (e.g. Jetstream2).

@ktyle
Copy link
Contributor

ktyle commented Aug 21, 2023

We have 1 TB (not 10 as I mentioned on the call, sorry) on our existing JS2 allocation, so I will look into writing a pangeo-forge recipe that could place at least one test dataset there.

@brian-rose
Copy link
Member

We have 1 TB (not 10 as I mentioned on the call, sorry) on our existing JS2 allocation, so I will look into writing a pangeo-forge recipe that could place at least one test dataset there.

It will be fantastic to have a working example!

This will let us develop a (hopefully simple) process by which existing or new Cookbooks can request and get access to some of this storage. Filling up the existing allocation will make it that much easier to build a coherent proposal for a larger storage allocation via ACCESS.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
infrastructure Infrastructure related issue
Projects
Status: Done
Development

No branches or pull requests

4 participants