Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 benchmarks #339

Merged
merged 8 commits into from
Aug 30, 2024
Merged

S3 benchmarks #339

merged 8 commits into from
Aug 30, 2024

Conversation

stanbrub
Copy link
Collaborator

@stanbrub stanbrub commented Aug 30, 2024

  • Added S3 benchmarks for write and read parquet
  • Added service selection, so that tests can specify what services are needed when the tests are run instead of running all of them
    • ex, redpanda is needed for data generation but not for the test
  • Updated test runner to support the service-selection feature and provide defaults relevant for the typical test they run
  • Added minio server and bucket to the docker-compose.yml files for adhoc, release, nightly

@stanbrub stanbrub self-assigned this Aug 30, 2024
@stanbrub stanbrub merged commit 2a1d7aa into deephaven:main Aug 30, 2024
2 checks passed
@stanbrub stanbrub deleted the s3-benchmarks branch August 30, 2024 22:41
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

AWS S3 Benchmarks for Parquet Per Benchmark Docker Service Selection
1 participant