Update playwright to v1.50.1 #4837
Annotations
8 errors, 5 warnings, and 1 notice
Run Playwright tests:
playwright/e2e/app-loading/feature-detection.spec.ts#L21
1) [Chrome] › playwright/e2e/app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
Error: expect(page).toHaveScreenshot(expected)
23293 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Chrome/unsupported-browser-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Chrome/unsupported-browser-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 23293 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 23293 pixels (ratio 0.03 of all image pixels) are different.
19 | await expect(header).toBeVisible();
20 |
> 21 | await expect(page).toMatchScreenshot("unsupported-browser.png");
| ^
22 | });
23 |
24 | test(`shows error page if browser lacks WebAssembly support`, { tag: "@screenshot" }, async ({ page }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:21:24
|
Run Playwright tests:
playwright/e2e/app-loading/feature-detection.spec.ts#L21
1) [Chrome] › playwright/e2e/app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
23293 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Chrome-retry1/unsupported-browser-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Chrome-retry1/unsupported-browser-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 23293 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 23293 pixels (ratio 0.03 of all image pixels) are different.
19 | await expect(header).toBeVisible();
20 |
> 21 | await expect(page).toMatchScreenshot("unsupported-browser.png");
| ^
22 | });
23 |
24 | test(`shows error page if browser lacks WebAssembly support`, { tag: "@screenshot" }, async ({ page }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:21:24
|
Run Playwright tests:
playwright/e2e/app-loading/feature-detection.spec.ts#L21
1) [Chrome] › playwright/e2e/app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
23293 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Chrome-retry2/unsupported-browser-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Chrome-retry2/unsupported-browser-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 23293 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 23293 pixels (ratio 0.03 of all image pixels) are different.
19 | await expect(header).toBeVisible();
20 |
> 21 | await expect(page).toMatchScreenshot("unsupported-browser.png");
| ^
22 | });
23 |
24 | test(`shows error page if browser lacks WebAssembly support`, { tag: "@screenshot" }, async ({ page }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:21:24
|
Run Playwright tests:
playwright/e2e/chat-export/html-export.spec.ts#L126
2) [Chrome] › playwright/e2e/chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot @screenshot
Error: expect(page).toHaveScreenshot(expected)
64168 pixels (ratio 0.07 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/chat-export/html-export.spec.ts/html-export-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-Chrome/html-export-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-Chrome/html-export-diff.png
Call log:
- expect.toHaveScreenshot(html-export.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 64168 pixels (ratio 0.07 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 64168 pixels (ratio 0.07 of all image pixels) are different.
124 | const zip = await extractZipFileToPath(zipPath, dirPath);
125 | await page.goto(`file://${dirPath}/${Object.keys(zip.files)[0]}/messages.html`);
> 126 | await expect(page).toMatchScreenshot("html-export.png", {
| ^
127 | mask: [
128 | // We need to mask the whole thing because the width of the time part changes
129 | page.locator(".mx_TimelineSeparator"),
at /home/runner/work/element-web/element-web/playwright/e2e/chat-export/html-export.spec.ts:126:32
|
Run Playwright tests:
playwright/e2e/chat-export/html-export.spec.ts#L126
2) [Chrome] › playwright/e2e/chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
64168 pixels (ratio 0.07 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/chat-export/html-export.spec.ts/html-export-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-Chrome-retry1/html-export-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-Chrome-retry1/html-export-diff.png
Call log:
- expect.toHaveScreenshot(html-export.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 64168 pixels (ratio 0.07 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 64168 pixels (ratio 0.07 of all image pixels) are different.
124 | const zip = await extractZipFileToPath(zipPath, dirPath);
125 | await page.goto(`file://${dirPath}/${Object.keys(zip.files)[0]}/messages.html`);
> 126 | await expect(page).toMatchScreenshot("html-export.png", {
| ^
127 | mask: [
128 | // We need to mask the whole thing because the width of the time part changes
129 | page.locator(".mx_TimelineSeparator"),
at /home/runner/work/element-web/element-web/playwright/e2e/chat-export/html-export.spec.ts:126:32
|
Run Playwright tests:
playwright/e2e/chat-export/html-export.spec.ts#L126
2) [Chrome] › playwright/e2e/chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
64168 pixels (ratio 0.07 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/chat-export/html-export.spec.ts/html-export-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-Chrome-retry2/html-export-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-Chrome-retry2/html-export-diff.png
Call log:
- expect.toHaveScreenshot(html-export.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 64168 pixels (ratio 0.07 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 64168 pixels (ratio 0.07 of all image pixels) are different.
124 | const zip = await extractZipFileToPath(zipPath, dirPath);
125 | await page.goto(`file://${dirPath}/${Object.keys(zip.files)[0]}/messages.html`);
> 126 | await expect(page).toMatchScreenshot("html-export.png", {
| ^
127 | mask: [
128 | // We need to mask the whole thing because the width of the time part changes
129 | page.locator(".mx_TimelineSeparator"),
at /home/runner/work/element-web/element-web/playwright/e2e/chat-export/html-export.spec.ts:126:32
|
Run Playwright tests:
playwright/e2e/accessibility/keyboard-navigation.spec.ts#L1
3) [Chrome] › playwright/e2e/accessibility/keyboard-navigation.spec.ts:17:9 › Landmark navigation tests › without any rooms
Test timeout of 30000ms exceeded while setting up "homeserver".
|
Run Playwright tests
Process completed with exit code 1.
|
Run Playwright tests:
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts#L1
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts took 45.9s
|
Run Playwright tests:
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts#L1
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts took 32.8s
|
Run Playwright tests:
[Chrome] › playwright/e2e/composer/RTE.spec.ts#L1
[Chrome] › playwright/e2e/composer/RTE.spec.ts took 30.9s
|
Run Playwright tests:
[Chrome] › playwright/e2e/crypto/crypto.spec.ts#L1
[Chrome] › playwright/e2e/crypto/crypto.spec.ts took 30.5s
|
Run Playwright tests:
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts took 26.0s
|
Run Playwright tests
2 failed
[Chrome] › playwright/e2e/app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
[Chrome] › playwright/e2e/chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot @screenshot
1 flaky
[Chrome] › playwright/e2e/accessibility/keyboard-navigation.spec.ts:17:9 › Landmark navigation tests › without any rooms
53 passed (5.4m)
|
Loading