MEDIUM: [Tracking] Implement more E2E tests and add new metrics

[mountiny]

The E2E tests are now set up and working again, lets expand on their options and add more flows and metrics:

• chat switching/opening for the first time
• typing
• scrolling chat messages
• number of renders when we open chat (it should be 1-2)
• searching
• signing in
• scrolling list of chats
• onyx tests

@Szymon20000 @hannojg

Issue Owner

Current Issue Owner: @kirillzyusko

[hannojg]

👋

[hannojg]

@perunt

[perunt]

👋

[mountiny]

Also Assigning @AndrewGable as he will most likely help us too 🤝 feel free to unassign if you prefer

[hannojg]

Update:

There was again a false positive on the e2e test runs. Added this PR trying to minimise those errors:

• [NoQA] [DEV] E2e/increase reliability #30484

[hannojg]

Update:

First PR for adding tests for typing is up:

• [DEV] E2e/add typing tests #30502

[melvin-bot]

⚠️ Looks like this issue was linked to a Deploy Blocker here

If you are the assigned CME please investigate whether the linked PR caused a regression and leave a comment with the results.

If a regression has occurred and you are the assigned CM follow the instructions here.

If this regression could have been avoided please consider also proposing a recommendation to the PR checklist so that we can avoid it in the future.

[mountiny]

Lies, it was a different pr causing the issue

[melvin-bot]

This issue has not been updated in over 15 days. @AndrewGable, @hannojg, @mountiny, @perunt eroding to Monthly issue.

P.S. Is everyone reading this sure this is really a near-term priority? Be brave: if you disagree, go ahead and close it out. If someone disagrees, they'll reopen it, and if they don't: one less thing to do!

[mountiny]

@hannojg @perunt how is it going?

[hannojg]

• The typing test is implemented and merged!
• For Chat switching we have a PR which should be done latest by end of this week: E2E chat opening #30634
• For the remaining tests we will put again more focus on that to finish it off soon!

(Note: we are internally working on a system to make the e2e tests even better, more news on that soon! ™️ )

[mountiny]

Thanks!

[dangrous]

adding myself here for reviewing the chat switching one!

[hannojg]

Chat switching is merged 🎊 !

@perunt I think we can add "number of renders when we open chat (it should be 1-2)" to the same test as second metric?

Also next up would be the search page test!

[kirillzyusko]

@dangrous I think we are currently (still) trying to fix e2e tests. And only after that we can start to write new e2e tests 👀

[dangrous]

how are we looking?

[kirillzyusko]

@dangrous Still fixing e2e tests 😅 Recent RN 0.75 broke them 😔

[hannojg]

Okay, so the tests are stable again, and we are collecting additional metrics.
Now we'd like to add more e2e performance regression tests. What other flows do you think are important to cover?
I feel like we currently don't really cover any money request flows?

We will add other tests like chat scrolling etc as mentioned in the issue's description soon!

[mountiny]

Yes, create money request flow - a manual would be good. Not sure if its possible to test the one with a scan, you might have to upload a file

[dangrous]

How are things going here?

[hannojg]

cc @kirillzyusko is working on that (please assign him as well). We've overhauled the e2e pipeline to be more robust. We have to fix one failing test, but are otherwise ready to write some more e2e tests this week (finally!!)

[dangrous]

awesome!

[kirillzyusko]

Yes, I should get some time to work on new e2e tests this week!

[melvin-bot]

This issue has not been updated in over 15 days. @dangrous, @hannojg, @kirillzyusko, @mountiny, @perunt eroding to Monthly issue.

P.S. Is everyone reading this sure this is really a near-term priority? Be brave: if you disagree, go ahead and close it out. If someone disagrees, they'll reopen it, and if they don't: one less thing to do!

[hannojg]

We are actively working on extending the e2e test suite. Current next PR we're working on is:

• e2e: added money request flow e2e test #52751

[melvin-bot]

@dangrous, @hannojg, @kirillzyusko, @mountiny, @perunt, this Monthly task hasn't been acted upon in 6 weeks; closing.

If you disagree, feel encouraged to reopen it -- but pick your least important issue to close instead.

[perunt]

It's alive. There are two new tests on the way:
#52751
#54625

[dangrous]

yep, reopening. chill, melvin