e2e-flakiness-detector #235
Annotations
10 errors and 1 notice
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-atFile.test.ts#L89
1) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-atFile.test.ts#L89
2) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-atFile.test.ts#L89
3) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-atFile.test.ts#L89
4) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-input.test.ts#L1
5) chat-input.test.ts:26:3 › chat input focus ────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/common.ts#L16
5) chat-input.test.ts:26:3 › chat input focus ────────────────────────────────────────────────────
Error: locator.click: Frame was detached
Call log:
- waiting for getByRole('button', { name: 'Sign In to Your Enterprise Instance' })
at common.ts:16
14 | }
15 | await focusSidebar(page)
> 16 | await sidebar.getByRole('button', { name: 'Sign In to Your Enterprise Instance' }).click()
| ^
17 | await page.getByRole('option', { name: 'Sign In with URL and Access Token' }).click()
18 | // Ensure the correct input box has showed up before we start filling in the forms.
19 | await expect(page.getByText('Enter the URL of the')).toBeVisible()
at sidebarSignin (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:16:88)
at /home/runner/work/cody/cody/vscode/test/e2e/chat-input.test.ts:31:5
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/command-core.test.ts#L1
6) command-core.test.ts:106:3 › Explain Command from Prompts Tab ─────────────────────────────────
Test timeout of 30000ms exceeded.
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/command-core.test.ts#L127
6) command-core.test.ts:106:3 › Explain Command from Prompts Tab ─────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('option', { name: 'Explain Code' })
125 | const sidebarTab = sidebarChat.getByTestId('tab-prompts')
126 | await sidebarTab.click()
> 127 | await sidebarChat.getByRole('option', { name: 'Explain Code' }).click()
| ^
128 |
129 | // Click on a command from the sidebar should not start a new Editor window when sidebar is empty.
130 | await expect(sidebarChat.getByText('hello from the assistant')).toBeVisible()
at /home/runner/work/cody/cody/vscode/test/e2e/command-core.test.ts:127:69
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/command-edit.test.ts#L118
7) command-edit.test.ts:100:1 › edit (fixup) input - range selection ─────────────────────────────
Error: expect.toBeVisible: Error: strict mode violation: getByText('Nearest Code Block') resolved to 2 elements:
1) <span class="monaco-highlighted-label">…</span> aka getByLabel('$(file-code) Nearest Code').getByText('Nearest Code Block')
2) <span class="monaco-highlighted-label">…</span> aka getByLabel('check file-code Nearest Code').locator('a').filter({ hasText: 'Nearest Code Block' })
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Nearest Code Block')
116 | // Check the correct range item is auto-selected
117 | const rangeItem = page.getByText('Nearest Code Block')
> 118 | expect(rangeItem).toBeVisible()
| ^
119 |
120 | // Open the range input and check it has the correct item selected
121 | await rangeItem.click()
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:118:23
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/command-edit.test.ts#L129
7) command-edit.test.ts:100:1 › edit (fixup) input - range selection ─────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for getByLabel('symbol-method fizzbuzz')
- locator resolved to <div role="option" data-index="0" aria-level="1" aria-setsize="3" id="list_id_4_0" aria-posinset="1" draggable="false" data-parity="even" class="monaco-list-row" data-last-element="false" aria-label="symbol-method fizzbuzz, symbols">…</div>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is not visible
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
127 | await symbolitem.click()
128 | const selectedSymbolItem = page.getByLabel('symbol-method fizzbuzz')
> 129 | await selectedSymbolItem.click()
| ^
130 |
131 | // Check that the range input updated correctly to reflect the selected symbol
132 | const inputBox = page.getByPlaceholder(/^Enter edit instructions \(type @ to include code/)
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:129:30
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0
12 failed
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-input.test.ts:26:3 › chat input focus ─────────────────────────────────────────────────────
command-core.test.ts:106:3 › Explain Command from Prompts Tab ──────────────────────────────────
command-edit.test.ts:100:1 › edit (fixup) input - range selection ──────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
30 skipped
428 passed (1.8h)
|
Loading