[Feature] add steps property to Configuration

[mlubanski]

Problem Statement

I am a new chainsaw user who recently started migrating my KUTTL tests to chainsaw

I am missing functionality which would allow me initialize my environment before running tests. In KUTTL we have ability to define on Configuration (kuttl-test.yaml) scripts to initialize our environment. Those scripts were executed only once before running all tests.

apiVersion: kuttl.dev/v1beta1
kind: TestSuite
....
- script: |
    helm upgrade -i crossplane --create-namespace --namespace crossplane-system crossplane-stable/crossplane --wait
    helm upgrade -i kyverno kyverno/kyverno -n kyverno --create-namespace --wait

I personally used it for Kubernetes add-ons installation/configuration (e.g. crossplane, kyverno, ...)

This was very handy as at the end user with one command was able to use one command to install/configured on cluster pre-requisites and than perform tests

Solution Description

Add to Configuration schema steps property. Steps defined on Configuration level would ran only once before all tests

Alternatives

No response

Additional Context

No response

Slack discussion

No response

Research

• I have searched other issues in this repository and mine is not recorded.

[eddycharly]

Thanks for reporting @mlubanski !

However i don't see the benefits of such a change, those steps can be run beforehand easily.
Ideally i don't expect chainsaw to be coupled with setting up the system to be tested. It's only a test runner and i think it's a good thing.