Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(deps): update terraform cloudposse/security-group/aws to v2 (main) #64

Merged
merged 18 commits into from
Jul 6, 2023

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Jun 28, 2023

Mend Renovate

This PR contains the following updates:

Package Type Update Change
cloudposse/security-group/aws (source) module major 0.3.1 -> 2.2.0

Release Notes

cloudposse/terraform-aws-security-group (cloudposse/security-group/aws)

v2.2.0

Compare Source

`.editorconfig` Typo @​milldr (#​50)

what

fixed intent typo

why

should be spelled "indent"

references

https://cloudposse.slack.com/archives/C01EY65H1PA/p1685638634845009

Sync github @​max-lobur (#​47)

Rebuild github dir from the template

v2.1.0

Compare Source

  • No changes

v2.0.1

Compare Source

🐛 Bug Fixes

Properly handle enabled = false @​Nuru (#​45)

what

  • Properly handle enabled = false

why

  • Fixes #​43

v2.0.0: Breaking changes

Compare Source

For details about migrating from v1 to v2, read the migration documentation.

Version 1 of this module had a flaw in that it tried to create new security group rules before deleting the old ones, which the Terraform provider does not handle properly and caused most attempted changes to fail. Version 2 resolves this issue by also creating a new security group when the rules change, installing the new rules in the new security group, then changing the security group assignments. Read the README and the migration documentation for more details.

Document migration from v1 to v2 @​Nuru (#​42)

what

  • Document migration from v1 to v2 of this module
  • Fix #​40

why

  • Serious issues exist in v1, causing v2 to have different defaults and new settings. Documentation is needed to guide users on how to upgrade while minimizing service interruptions.

references

Fixes the link for examples/complete/main.tf @​jdmedeiros (#​41)

Fixes the link for examples/complete/main.tf on the README.md file.

v1.0.1

Compare Source

🐛 Bug Fixes

Handle `self = false`, add warning about `compact` and `sort` @​Nuru (#​33)

what

  • Handle self = false
  • Add warning about compact and sort

why

  • Setting self = false in a rule (meaning the rule does not apply to the security group it is being associated with) was causing an empty rule to be created and/or causing conflicts with other rule elements. Now it works like self = null works.
  • Explain some causes of the dreaded "Invalid for_each argument" error and what to do to fix it.

references

v1.0.0: Initial release with production Semantic Versioning

Compare Source

Initial release with production Semantic Versioning, part of Cloud Posse's general policy to convert to production versioning as we make updates to relatively mature modules.

This version is functionally equivalent to v0.4.3. The only differences are to the support framework (for things like developing and testing the module).

git.io->cloudposse.tools update and test framework update @​dylanbannon (#​32)

what and why

Change all references to git.io/build-harness into cloudposse.tools/build-harness, since git.io redirects will stop working on April 29th, 2022.

References

  • DEV-143
Rename the exported `security-group-inputs` file to `security-group-variables` @​aknysh (#​31)

what

  • Rename the exported security-group-inputs.tf file to security-group-variables.tf

why

  • Standardize on file names with variables for specific resources.
    For example, we have spotinst-variables.tf for Spot, security-group-variables.tf for SG, etc.

v0.4.3

Compare Source

Update recommended inputs and outputs @​Nuru (#​26)

what

  • Update recommended inputs and outputs

why

  • Changes based on experience implementing several modules

🚀 Enhancements

Rename the exported `security_group_inputs.tf` file to `security-group-inputs.tf` @​aknysh (#​30)

what

  • Rename the exported security_group_inputs.tf file to security-group-inputs.tf
  • Update GitHub workflows and LICENSE

why

  • Our naming convention is to use kebab-case for all files. Having a file in snake_case (after adding it to a repo) together with all the other files in kebab-case in the same repo does not look correct
  • Keep up to date

v0.4.2

Compare Source

🐛 Bug Fixes

Correctly extract security group name for tags @​Nuru (#​25)

what

  • Correctly extract security group name from var.security_group_name list when setting tags

why

  • Type mismatch error otherwise

v0.4.1

Compare Source

🐛 Bug Fixes

Fix bad markup (unclosed `details` block) in README.yaml @​Nuru (#​24)

what

  • Fix bad markup (unclosed details block) in README.yaml

why

  • Incorrectly hides most of README

v0.4.0: New Standards, Breaking Changes

Compare Source

This release makes no attempt at backward compatibility with earlier versions.
It puts forth some new Cloud Posse standards. See details below.

As a major overhaul, it likely has bugs. It may have breaking changes in the near future as we discover design issues. However, the intention is to get this module stabilized and provide a consistent interface moving forward.

This module requires Terraform version 0.14 or later due to numerous issues in Terraform 0.13.

🚀 Enhancements

Overhaul Module to New Standards @​Nuru (#​17) (click to see details)

what

  • Input use_name_prefix replaced with create_before_destroy. Previously, create_before_destroy was always set to true but of course that fails if you are not using a name prefix, because the names must be unique. Now the name is automatically a prefix if create_before_destroy is true and not if it is not.
  • Input security_group_enabled renamed to create_security_group. Whether the security group is created or not, it will be enabled, and setting security_group_enabled to false does not disable the entire module, even though the module is named "security-group", which makes the old name terribly confusing. The new name is more descriptive.
  • Input id renamed to target_security_group_id. Again id by itself is too vague. Converted to list to conform to new standard pattern that optional inputs which are used in conditionals are passed as list elements. See Hashicorp recommendation
  • Added a security_group_name input, which, if set, will set the security group name. If not set, name will be derived from null-label. Because the security group name must be unique within an account, we should provide some way for people to set/override it other than forcing them to create a customized null-label.
  • As a convenience, added rule_matrix . Many of our modules allow users to simply give a list of security groups to allow access to the new resource, typically called allowed_security_groups. This variable allows for easy migration by closely paralleling the existing resource creation code. It allows any number of rules to be applied to any combined list of security groups and CIDRs. See example.
  • As a convenience, added allow_all_egress. AWS by default allows full egress to newly created security groups. Terraform removes this when taking over a security group, but our modules frequently want to restore it. Historically, though, the modules have implemented this slightly differently, and few or none have allowed IPv6 egress. Adding this boolean gives us a way to enable it simply and consistently (as opposed to every module writing its own egress rule).
  • Abandoned the attempt to create stable keys for rules to use in for_each. Existing generated keys were not guaranteed unique, and keys that were generated and guaranteed to be unique would not be known at plan time and thus could not be used. Instead, provide option for user to provide stable keys and, if not provided, generate keys knowing they might not be stable.

why

  • This module is the foundation for how we'll handle security groups across all of our modules and we need to ensure greater consistency from the onset

naming conventions

We want to migrate to a consistent set of name across modules. However, it is also quite painful to be forced to rename, so where possible I would like to maintain existing names but mark them deprecated and feed them into the new names in main.tf locals{}. We have also already seen issues with the most recent set of name changes. Therefore I propose these names with these meanings:

associated_security_group_ids

associated_security_group_ids is a list of IDs of Security Group that are "associated" (AWS' term) with the resource being created. In other words, the new resource is placed in or becomes a member of the Security Groups identified by the ID.

Most often our modules got this information as existing_security_groups and a boolean use_existing_security_groups, and the recent change was to call this input simply security_groups. However, there is no consistency in naming in the AWS provider (redshift_cluster calls it cluster_security_groups, elasticache_replication_group calls it security_group_ids, ec2_instance calls it just security_groups but accepts legacy security group names as well as IDs) and in our modules we typically have several lists of security groups (see below), so just calling this security_groups is very confusing.

Using "associated" makes it clear the purpose, and suffixing with "ids" makes it clear the type. Since AWS in inconsistent and variously uses ARNs, IDs, and Names to identify resources, I think including the type is very helpful.

allowed_security_group_ids

allowed_security_group_ids are security groups that are allowed ingress to the resource being created. Typically rules allowing this are added to the single created security group, as it should be unnecessary for an existing security group, but where desired, these rules can be added to the first in the list of "associated" security groups

allow_all_egress

AWS by default creates security groups that allow no ingress but allow all egress. When Terraform starts managing rules for the security group, it removes this default egress rule. Modules should include an allow_all_egress boolean to restore that rule when true.

security_group_description

Our modules have evolved over time (at community request) to provide more useful descriptions of Security Groups. Unfortunately, Terraform cannot change the description of an existing security group; instead it must replace the SG with a new one with the new description. For this reason, changes to the description field, while beneficial for new users, can be too disruptive on existing infrastructure to be worth it. In order to provide users with control over the description and thus mitigate the impact of changes, all modules that create security groups should include a security_group_description input which, if set, overrides any other kind of generated or default description.

Instance Metadata Services

Although not actually part of the Security Group module, since we are covering consistent naming of inputs, we document here that we are using the following inputs and defaults to configure the AWS Instance Metadata Service. Note that our inputs do not exactly match the Terraform resource inputs because we have chosen to use boolean inputs rather than string inputs to toggle features. Our standard metadata_options block looks like this

  metadata_options {
    http_endpoint               = (var.metadata_http_endpoint_enabled) ? "enabled" : "disabled"
    http_put_response_hop_limit = var.metadata_http_put_response_hop_limit
    http_tokens                 = (var.metadata_http_tokens_required) ? "required" : "optional"
  }

and defaults are

metadata_http_endpoint_enabled = true
metadata_http_put_response_hop_limit = 2
metadata_http_tokens_required = true

We picked these defaults so that we default to best security practices with a concession (hop limit 2 instead of 1) to running containerized services. However, metadata_http_tokens_required = true may break some existing applications and is a breaking change, so when implemented, it should be noted in the release notes, along with how to preserve the previous settings.

Optional Inputs

This module is among the first to implement the new Cloud Posse standard for optional inputs in Terraform. Because of issues like this (just one of many, many examples) we are going to follow Hashicorp's advice and prohibit the conditional creation of resources based on values of inputs. If you want to condition the creation of a resource (e.g. count = xxx ? 1 : 0) based on whether the input is supplied or not, the way we are going to do it is to make the optional input a list. A supplied value will be in a list with 1 element. An omitted value will use the default list of 0 elements. It will remain standard practice to depend on the value of enabled, but otherwise we should avoid conditional creation of resources based on input values.

Unfortunately, this also means we cannot use for_each when the values might be generated during apply. This appears to be a consequence of the fact that for_each requires a set and the cardinality of the set depends on the values generated (adding 2 of the same value to a set only increases the size of the set by 1). So we can only use for_each when we can guarantee the user is hard coding the values so they are all known an plan time. Otherwise use count.

references

Issues with Terraform management of Security Group Rules: drift detection, cyclical dependencies, and competing for control: a post from a Hashicorp engineer

Bug in Terraform AWS provider requires multiple apply cycles to update aws_elasticache_replication_group security groups:

Some problems with the previous version:

v0.3.3

Compare Source

🤖 Automatic Updates

Update context.tf @​cloudpossebot (#​21)

what

This is an auto-generated PR that updates the context.tf file to the latest version from cloudposse/terraform-null-label

why

To support all the features of the context interface.

v0.3.2

Compare Source

🚀 Enhancements

add missing required input (vpc_id) in the example @​Zaargh (#​20)

what

  • add missing required input vpc_id in the example

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR has been generated by Mend Renovate. View repository job log here.

@renovate renovate bot requested review from a team as code owners June 28, 2023 21:53
@renovate renovate bot requested review from Gowiem and joe-niland June 28, 2023 21:53
@renovate renovate bot added the auto-update This PR was automatically generated label Jun 28, 2023
@renovate
Copy link
Contributor Author

renovate bot commented Jun 29, 2023

Edited/Blocked Notification

Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.

You can manually request rebase by checking the rebase/retry box above.

Warning: custom changes will be lost.

@max-lobur max-lobur added the patch A minor, backward compatible change label Jul 5, 2023
@max-lobur
Copy link
Contributor

/terratest

@max-lobur max-lobur enabled auto-merge (squash) July 6, 2023 09:36
max-lobur
max-lobur previously approved these changes Jul 6, 2023
@max-lobur max-lobur added minor New features that do not break anything and removed patch A minor, backward compatible change labels Jul 6, 2023
@max-lobur
Copy link
Contributor

/terratest

variables.tf Outdated Show resolved Hide resolved
@max-lobur
Copy link
Contributor

/terratest

max-lobur
max-lobur previously approved these changes Jul 6, 2023
@max-lobur
Copy link
Contributor

/terratest

@max-lobur
Copy link
Contributor

/terratest

@max-lobur
Copy link
Contributor

/terratest

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-update This PR was automatically generated minor New features that do not break anything
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant