{Codecov upload issue debugging} - Ensuring the Codecov UI is able to react to data from the latest upload

[rohan-at-sentry]

Problem

The Codecov UI is essentially static after the first report upload - which is problematic in the following scenarios

• when the user uploads multiple coverage reports per commit : coverage data on the UI is wrong as it only shows the results after first upload
• when the user uploads a single coverage report per commit, and (for reasons) chooses to re-run CI on the same commit : coverage data on the UI is wrong as it only shows the results after first upload
• whenthe user uploads multiple coverage reports per commit

We want to ensure the Codecov UI updates data shown on it with every report upload. This will help ensure consistency of report processing outcomes across PR comment and APP (commit and PR).

Why is it important?

Not seeing consistency on what you see on the PR reflect what you see confuses people.

Path forward

• ensure the coverage report errors on the commits tab are shown/not shown based on if the latest coverage report upload was successful

  • Related issue (Implement the Upload processing status UI component #2522) that adds coverage report errors to the UI on the commits tab
  • Errors shown should be from the latest upload to error out

• Update top level coverage statistics for the commit and PR with result from latest result

• Set notify_error to true for all new customers (the default appears to be false). This allows any issues with uploads to surface on the PR comment as well --> serves as a warning signal to users that coverage reporting on the UI may be impacted.