Umbrella issue for the overall smoke test plan

[jijiechen]

Description

kuma-smoke test plan

Single zone on Kubernetes

Components:

• The CP
• The counter demo DP
• builtin gateway
• delegated gateway

• Scenario 1

1. should install new version using different combinations (sidecar/CNI, kumactl/helm)
   1. run the installer
   2. check CP health
   3. check the CRDs
   4. spin up a dp
   5. publish some policies
   6. verify the results

• Scenario 2

2. should upgrade from a previous version (sidecar, CNI)
   1. install an old version
   2. spin up a dp
   3. publish some policies
   4. upgrade to the new version
   5. check CP health
   6. check DP health

Single zone on Universal

Components:

• The CP
• Simple DP
• DP with gateway
• DP with transparent proxy

(todo: Scenarios?)

Multizone

Setup 1 - universal global

Components:

• Global: universal (postgresql)
• Zone1: universal
• Zone2: k8s
• Zone3: k8s-old version

(todo: Scenarios?)

Setup 2 - k8s global

Components:

• Global: k8s
• Zone1: k8s
• Zone2: universal
• Zone3: universal

(todo: Scenarios?)

Setup 3 - multi clouds

Components:

• Global: k8s on aws
• Zone1: k8s on gcp
• Zone2: k8s on aks
• Zone3: universal on aws

(todo: Scenarios?)

[jijiechen]

Environment matrix - Kubernetes:

• local (k8s-kind)
• aws (k8s-eks)
• azure (k8s-aks)
• gcp (k8s-gke)

Environment matrix - VM:

• aws
• azure
• gcp