Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clay pipeline v04 #173

Merged
merged 13 commits into from
Mar 26, 2024
Merged

Clay pipeline v04 #173

merged 13 commits into from
Mar 26, 2024

Conversation

yellowcap
Copy link
Member

@yellowcap yellowcap commented Mar 6, 2024

This is the version that has been used for #142

Updates include

  • Tile size of 256 px
  • Different sample source with more samples
  • More human footprint focused sampling strategy (more urban, more agriculture)
  • improved logging
  • Fix one bug for when pixel spaces from S2 and S1 don't overlap

Copy link
Collaborator

@srmsoumya srmsoumya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, in the next iteration, maybe we move all configurable options into a config.yaml file for data.

],
},
}
job = {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So we are not creating the job array anymore?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are, but instead of running 2500 individual tasks, we are running one array job which bundles these subjobs into one parent. That is way easier to handle.

@yellowcap yellowcap merged commit 1fe4fdf into main Mar 26, 2024
6 checks passed
@yellowcap yellowcap deleted the clay-pipeline-v04 branch March 26, 2024 09:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants