[SPIKE] Determine a better solution for running smoke tests on staging

[chris-kuryak]

Problem statement

The current smoke tests in staging run during deployment, which blocks deployment if something goes wrong. This is not ideal as smoke tests should be pre-emptive and allow time to fix issues before deployment. Therefore, we need to find a better solution for when and how to run smoke tests in staging.

What you need to know

Acceptance criteria

Propose and document a solution that:

• Allows errors from Smoke Tests to be caught and report to FE engineers at least 24 hours before deployment
• Smoke tests are performed automatically and regularly without much (if any) human input