💡 [REQUEST] - ttpforge test --strict-validation mode

[d3sch41n]

Implementation PR

No response

Reference Issues

No response

Summary

Add logic to ttpforge test that will enforce stricter standards on new TTPs to make TTP authors fully provide required metadata - it should throw an error if the following fields are empty:

• The platforms list under requirements (TTPs must specify supported platforms)
• The top-level tests: field (TTPs must have test cases)
• Description field (TTPs must provide basic contextual information)

We can then make CI/CD for the TTP repos run this command against all .yaml stuff.

Basic Example

This TTP would pass the new validation

name: Awesome TTP
description: |
  Info about the TTP
requirements: 
  platforms:
    - os: linux
tests:
   - name a_valid_test_case 

Drawbacks

Can't enforce this against existing TTP portfolio until they are all updated

Unresolved questions

No response

[d3sch41n]

@l50 relevant to our earlier discussions on metadata

[d3sch41n]

@cedowens plz take this from me and give it to someone else once I'm actually gone :)

[d3sch41n]

@godlovepenn relevant to oncall discussion