Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: [Dataproc] ROLLBACK: add support for new Dataproc features #5890

Merged
merged 3 commits into from
Feb 22, 2023
Merged

feat: [Dataproc] ROLLBACK: add support for new Dataproc features #5890

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
9c69d54
feat: ROLLBACK: add support for new Dataproc features
gcf-owl-bot[bot] Feb 21, 2023
5956d87
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Feb 21, 2023
22e6925
Merge branch 'main' into owl-bot-copy-Dataproc
bshaffer Feb 22, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file modified Dataproc/metadata/V1/Batches.php
View file
Open in desktop
Binary file not shown.
Binary file modified Dataproc/metadata/V1/Clusters.php
View file
Open in desktop
Binary file not shown.
Binary file modified Dataproc/metadata/V1/Jobs.php
View file
Open in desktop
Binary file not shown.
Binary file modified Dataproc/metadata/V1/Operations.php
View file
Open in desktop
Binary file not shown.
Binary file modified Dataproc/metadata/V1/Shared.php
View file
Open in desktop
Binary file not shown.
16 changes: 8 additions & 8 deletions Dataproc/samples/V1/AutoscalingPolicyServiceClient/create_autoscaling_policy.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,18 +45,18 @@
* of the location has the following format:
* `projects/{project_id}/locations/{location}`
* Please see {@see AutoscalingPolicyServiceClient::regionName()} for help formatting this field.
* @param float $policyBasicAlgorithmYarnConfigScaleUpFactor Fraction of average YARN pending memory in the last cooldown
* period for which to add workers. A scale-up factor of 1.0 will result in
* scaling up so that there is no pending memory remaining after the update
* (more aggressive scaling). A scale-up factor closer to 0 will result in a
* smaller magnitude of scaling up (less aggressive scaling). See [How
* autoscaling
* @param float $policyBasicAlgorithmYarnConfigScaleUpFactor Fraction of average YARN pending memory in the last cooldown period
* for which to add workers. A scale-up factor of 1.0 will result in scaling
* up so that there is no pending memory remaining after the update (more
* aggressive scaling). A scale-up factor closer to 0 will result in a smaller
* magnitude of scaling up (less aggressive scaling).
* See [How autoscaling
* works](https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/autoscaling#how_autoscaling_works)
* for more information.
*
* Bounds: [0.0, 1.0].
* @param float $policyBasicAlgorithmYarnConfigScaleDownFactor Fraction of average YARN pending memory in the last cooldown
* period for which to remove workers. A scale-down factor of 1 will result in
* @param float $policyBasicAlgorithmYarnConfigScaleDownFactor Fraction of average YARN pending memory in the last cooldown period
* for which to remove workers. A scale-down factor of 1 will result in
* scaling down so that there is no available memory remaining after the
* update (more aggressive scaling). A scale-down factor of 0 disables
* removing workers, which can be beneficial for autoscaling a single job.
Expand Down
16 changes: 8 additions & 8 deletions Dataproc/samples/V1/AutoscalingPolicyServiceClient/update_autoscaling_policy.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,18 +37,18 @@
* Disabled check for update_mask, because all updates will be full
* replacements.
*
* @param float $policyBasicAlgorithmYarnConfigScaleUpFactor Fraction of average YARN pending memory in the last cooldown
* period for which to add workers. A scale-up factor of 1.0 will result in
* scaling up so that there is no pending memory remaining after the update
* (more aggressive scaling). A scale-up factor closer to 0 will result in a
* smaller magnitude of scaling up (less aggressive scaling). See [How
* autoscaling
* @param float $policyBasicAlgorithmYarnConfigScaleUpFactor Fraction of average YARN pending memory in the last cooldown period
* for which to add workers. A scale-up factor of 1.0 will result in scaling
* up so that there is no pending memory remaining after the update (more
* aggressive scaling). A scale-up factor closer to 0 will result in a smaller
* magnitude of scaling up (less aggressive scaling).
* See [How autoscaling
* works](https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/autoscaling#how_autoscaling_works)
* for more information.
*
* Bounds: [0.0, 1.0].
* @param float $policyBasicAlgorithmYarnConfigScaleDownFactor Fraction of average YARN pending memory in the last cooldown
* period for which to remove workers. A scale-down factor of 1 will result in
* @param float $policyBasicAlgorithmYarnConfigScaleDownFactor Fraction of average YARN pending memory in the last cooldown period
* for which to remove workers. A scale-down factor of 1 will result in
* scaling down so that there is no available memory remaining after the
* update (more aggressive scaling). A scale-down factor of 0 disables
* removing workers, which can be beneficial for autoscaling a single job.
Expand Down
6 changes: 2 additions & 4 deletions Dataproc/samples/V1/BatchControllerClient/delete_batch.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,8 @@
* Deletes the batch workload resource. If the batch is not in terminal state,
* the delete fails and the response returns `FAILED_PRECONDITION`.
*
* @param string $formattedName The fully qualified name of the batch to retrieve
* in the format
* "projects/PROJECT_ID/locations/DATAPROC_REGION/batches/BATCH_ID"
* Please see {@see BatchControllerClient::batchName()} for help formatting this field.
* @param string $formattedName The name of the batch resource to delete. Please see
* {@see BatchControllerClient::batchName()} for help formatting this field.
*/
function delete_batch_sample(string $formattedName): void
{
Expand Down
6 changes: 2 additions & 4 deletions Dataproc/samples/V1/BatchControllerClient/get_batch.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,8 @@
/**
* Gets the batch workload resource representation.
*
* @param string $formattedName The fully qualified name of the batch to retrieve
* in the format
* "projects/PROJECT_ID/locations/DATAPROC_REGION/batches/BATCH_ID"
* Please see {@see BatchControllerClient::batchName()} for help formatting this field.
* @param string $formattedName The name of the batch to retrieve. Please see
* {@see BatchControllerClient::batchName()} for help formatting this field.
*/
function get_batch_sample(string $formattedName): void
{
Expand Down
4 changes: 2 additions & 2 deletions Dataproc/samples/V1/WorkflowTemplateServiceClient/create_workflow_template.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,8 +49,8 @@
*
* The step id is used as prefix for job id, as job
* `goog-dataproc-workflow-step-id` label, and in
* [prerequisiteStepIds][google.cloud.dataproc.v1.OrderedJob.prerequisite_step_ids]
* field from other steps.
* [prerequisiteStepIds][google.cloud.dataproc.v1.OrderedJob.prerequisite_step_ids] field from other
* steps.
*
* The id must contain only letters (a-z, A-Z), numbers (0-9),
* underscores (_), and hyphens (-). Cannot begin or end with underscore
Expand Down
7 changes: 3 additions & 4 deletions Dataproc/samples/V1/WorkflowTemplateServiceClient/instantiate_inline_workflow_template.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,7 @@
* Instantiates a template and begins execution.
*
* This method is equivalent to executing the sequence
* [CreateWorkflowTemplate][google.cloud.dataproc.v1.WorkflowTemplateService.CreateWorkflowTemplate],
* [InstantiateWorkflowTemplate][google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateWorkflowTemplate],
* [CreateWorkflowTemplate][google.cloud.dataproc.v1.WorkflowTemplateService.CreateWorkflowTemplate], [InstantiateWorkflowTemplate][google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateWorkflowTemplate],
* [DeleteWorkflowTemplate][google.cloud.dataproc.v1.WorkflowTemplateService.DeleteWorkflowTemplate].
*
* The returned Operation can be used to track execution of
Expand Down Expand Up @@ -75,8 +74,8 @@
*
* The step id is used as prefix for job id, as job
* `goog-dataproc-workflow-step-id` label, and in
* [prerequisiteStepIds][google.cloud.dataproc.v1.OrderedJob.prerequisite_step_ids]
* field from other steps.
* [prerequisiteStepIds][google.cloud.dataproc.v1.OrderedJob.prerequisite_step_ids] field from other
* steps.
*
* The id must contain only letters (a-z, A-Z), numbers (0-9),
* underscores (_), and hyphens (-). Cannot begin or end with underscore
Expand Down
4 changes: 2 additions & 2 deletions Dataproc/samples/V1/WorkflowTemplateServiceClient/update_workflow_template.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,8 +39,8 @@
*
* The step id is used as prefix for job id, as job
* `goog-dataproc-workflow-step-id` label, and in
* [prerequisiteStepIds][google.cloud.dataproc.v1.OrderedJob.prerequisite_step_ids]
* field from other steps.
* [prerequisiteStepIds][google.cloud.dataproc.v1.OrderedJob.prerequisite_step_ids] field from other
* steps.
*
* The id must contain only letters (a-z, A-Z), numbers (0-9),
* underscores (_), and hyphens (-). Cannot begin or end with underscore
Expand Down
24 changes: 12 additions & 12 deletions Dataproc/src/V1/AcceleratorConfig.php
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading