Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace Sauce Labs with Playwright #117

Open
1 of 5 tasks
vweevers opened this issue Sep 25, 2022 · 3 comments
Open
1 of 5 tasks

Replace Sauce Labs with Playwright #117

vweevers opened this issue Sep 25, 2022 · 3 comments
Labels
maintenance General maintenance pull request welcome A pull request is welcome test Improvements or additions to tests

Comments

@vweevers
Copy link
Member

vweevers commented Sep 25, 2022

It has served us well for a long time, but I've spent more (too much) time chasing issues that arise from changes to their platform, than to changes to the code we're testing. Mostly recently (Level/abstract-level#42) tests started failing with the following error:

Misconfigured -- You've exceeded your Sauce Labs concurrency limit. This test was throttled and ultimately timed out waiting for a free slot to run. You can upgrade your account for higher-concurrency at https://saucelabs.com/pricing.

Replacing Sauce Labs will reduce our coverage of browsers by only a small percentage (in terms of how many end users we serve by testing lesser-used browsers). The benefits far outweigh that: Playwright is faster, more stable, and we (in fact anyone) can run the same suite locally and in CI (without needing credentials). It's easy to achieve as we can continue using Airtap, but with airtap-playwright instead of airtap-sauce.

Side note: for the Airtap project, it likely means airtap-sauce won't be maintained anymore, at least not by me.

Repositories that this applies to:

  • abstract-level
  • memory-level
  • browser-level
  • levelup (remove browser tests altogether)
  • ...
@vweevers vweevers added test Improvements or additions to tests maintenance General maintenance labels Sep 25, 2022
@ralphtheninja
Copy link
Member

@vweevers Yeah, lets do it.

Aaaand blocked the other person.

@vweevers
Copy link
Member Author

Aaaand blocked the other person.

What did I miss?

@ralphtheninja
Copy link
Member

What did I miss?

A spammer. Github must have cleaned up the post.

vweevers added a commit to Level/abstract-level that referenced this issue Oct 30, 2022
vweevers added a commit to Level/abstract-level that referenced this issue Oct 30, 2022
vweevers added a commit to Level/abstract-level that referenced this issue Oct 30, 2022
vweevers added a commit to Level/abstract-level that referenced this issue Oct 30, 2022
@vweevers vweevers added the pull request welcome A pull request is welcome label Oct 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
maintenance General maintenance pull request welcome A pull request is welcome test Improvements or additions to tests
Projects
Status: Todo
Development

No branches or pull requests

3 participants
@ralphtheninja @vweevers and others