[mdatagen] allow filtering out metrics based on resource attributes

[povilasv]

Description:

This PR allows filtering out metrics based on resource attributes. For example:

        resource_attributes:                                                                      
          k8s.pod.name:
            enabled: true 
            exclude:
              #- strict: "kube-apiserver-kind-control-plane"
              - regexp: "kube-.*"
              - regexp: "coredns-.*"
              - strict: "coredns"
              - strict: "kindnet-mpb2p"

Would remove metrics that match regex or strict rules on resource attributes.

Link to tracking Issue:

#25134
Testing:

• Tested with k8scluster receiver in kind cluster.
• unit tests added
  Documentation:

[github-actions]

This PR was marked stale due to lack of activity. It will be closed in 14 days.

[dmitryax]

Good start. Thanks @povilasv!

[github-actions]

This PR was marked stale due to lack of activity. It will be closed in 14 days.

[povilasv]

Tested validation with:

        resource_attributes:                                                                      
          k8s.pod.name:
            enabled: true 
            include:
              - regexp: ".*"
              - regexp: "(["
            exclude:
              - strict: "kube-apiserver-kind-control-plane"

Collector fails with:

2024/01/24 12:49:46 collector server run finished with error: invalid configuration: receivers::k8s_cluster: error parsing regexp: missing closing ]: `[`

So looks like the engine magically calls Validate() on the config 👍

[povilasv]

Thanks for reviewing @dmitryax , this is ready for the second round :)

I played with this change in a kind cluster, and looks it does what we want :D

[fatsheep9146]

I think metadata-schema.yaml could also be updated to include this changes.

[povilasv]

I don't think we need to change metadata-schema.yaml , as this change allows end-user to configure filtering. There is no change in metadata schema for receiver maintainers.

[povilasv]

@dmitryax Thanks for review! Updated based on your comments :)

[dmitryax]

@povilasv PTAL at the failing CI

[dmitryax]

@povilasv the PR looks good to me in general. Can you please submit if against mdatagen in core?

[povilasv]

Pushed a PR for core open-telemetry/opentelemetry-collector#9660

[povilasv]

Closing this PR, as I added more tests and different packaging for the new filter package in the core repository. PR: open-telemetry/opentelemetry-collector#9660

I think we can review / merge the functionality after we fully deprecate the mdatagen in contrib.