Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qa updates - Week 5 of 2025 #78

Merged
merged 7 commits into from
Jan 29, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion content/qa/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,11 +16,11 @@ tags:
### `waku:`
* [[qa/waku/2025q1-interop-testing|interop-testing ]]
* [[qa/waku/2025q1-waku-go-bindings-testing|waku-go-bindings-testing ]]
* [[qa/waku/2025q1-messaging-api-testing|messaging-api-testing ]]
* [[qa/waku/2025q1-direct-message-reliability-testing|direct-message-reliability-testing ]]

### `nomos:`
* [[qa/nomos/2025q1-da-testing|da-testing ]]
* [[qa/nomos/2025q1-e2e-testing|e2e-testing ]]
---

## 2024q4 `vac:qa:`
Expand Down
41 changes: 41 additions & 0 deletions content/qa/nomos/2025q1-e2e-testing.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
---
title: Nomos E2E Testing for Nomos Node
tags:
- "2025q1"
- "qa"
- "nomos"
draft: false
description: Maintain and ensure the reliability of Nomos e2e tests.
---

`vac:qa:nomos:2025q1-e2e-testing`

## Description
Maintain and ensure the continued reliability of the Nomos end to end testing framework.
This includes addressing regressions, adapting code in `nomos-e2e-tests` and `nomos-node`,
adapting to other changes in `nomos-node`,
and performing minor improvements to keep the framework functional and effective.

**Alignment with VAC Narratives:**

* The VAC QA team supports internal collaboration and efficiency by maintaining the quality and reliability of the Nomos E2E framework.

## Task List

### Maintenance

* fully qualified name: `vac:qa:nomos:2025q1-e2e-testing:maintenance`
* owner: romanzac
* status: in progress (20%)
* start-date: 2025/01/01
* end-date: 2025/03/31

#### Description
Ongoing maintenance of Nomos E2E tests and changes in Nomos Node repository related to Nomos E2E testing.
This includes updating tests for changes in `nomos-node`, addressing regressions,
investigating and resolving issues, and implementing minor improvements to the testing framework as needed.

#### Deliverables
* [Two node cluster start automation](https://github.com/logos-co/nomos-e2e-tests/pull/1)
* [fix: Temporarily downgrade cargo-binstall to 1.10.19](https://github.com/logos-co/nomos-node/pull/983)
* [chore: Add LogOutput and LogLevel property to Cfgsync config](https://github.com/logos-co/nomos-node/pull/978)
6 changes: 3 additions & 3 deletions content/qa/waku/2025q1-direct-message-reliability-testing.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ and validating the application of MVDS for improved message delivery reliability

* fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:functional`
* owner: fbarbu15
* status: in progress (60%)
* status: in progress (90%)
* start-date: 2025/01/06
* end-date: 2025/01/25

Expand All @@ -50,7 +50,7 @@ including 1:1 chats and private groups.

* fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:degraded-network`
* owner: fbarbu15
* status: in progress (40%)
* status: in progress (50%)
* start-date: 2025/01/25
* end-date: 2025/02/15

Expand All @@ -68,7 +68,7 @@ after a network reconnection.

* fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:rate-limit`
* owner: fbarbu15
* status: not started
* status: in progress (10%)
* start-date: 2025/02/25
* end-date: 2025/03/10

Expand Down
2 changes: 2 additions & 0 deletions content/qa/waku/2025q1-interop-testing.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,3 +36,5 @@ investigating and resolving issues, and implementing minor improvements to the t

#### Deliverables
* [SQL logic error table Message has no column named storedAt](https://github.com/waku-org/nwaku/issues/3243)
* [bug: wakuorg/nwaku:latest node fails to start for RLN tests](https://github.com/waku-org/nwaku/issues/3247)
* [chore: add reconciliation metrics](https://github.com/waku-org/waku-interop-tests/pull/100)
2 changes: 1 addition & 1 deletion content/qa/waku/2025q1-waku-go-bindings-testing.md
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ It should also be adaptable to future testing needs.

* fully qualified name: `vac:qa:waku:2025q1-waku-go-bindings-testing:relay`
* owner: aya
* status: not started
* status: in progress (25%)
* start-date: 2025/01/20
* end-date: 2025/02/25

Expand Down
Original file line number Diff line number Diff line change
@@ -1,21 +1,21 @@
---
title: Messaging API Testing
tags:
- "2025q1"
- "2025q2"
- "qa"
- "waku"
draft: false
description: Test and validate the reliability of the Messaging API for nwaku and js-waku.
---

`vac:qa:waku:2025q1-messaging-api-testing`
`vac:qa:waku:2025q2-messaging-api-testing`

## Description
Test and validate the reliability of the Messaging API
for nwaku and js-waku in accordance to Waku FURPS.
Ensure the API performs consistently and meets the expected functional and reliability requirements,
aligning with behaviors used by applications like the Status app and Waku Tester tool.
Note! Dates are not set because Waku needs to notify us when the task is ready for QA.
Note! Waku confirmed that this will be ready to test somewhere in Q2 or even Q3 2025

**Alignment with VAC Narratives:**
- By testing the Messaging API,
Expand All @@ -28,7 +28,7 @@ Note! Dates are not set because Waku needs to notify us when the task is ready f

### Integrate Functional Testing into Interop Framework

* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-interop`
* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-interop`
* owner: fbarbu15
* status: not started
* start-date:
Expand All @@ -44,7 +44,7 @@ Implement functional tests for the new Messaging API within the interop testing

### Reliability Testing for nwaku

* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-nwaku`
* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-nwaku`
* owner: fbarbu15
* status: not started
* start-date:
Expand All @@ -60,7 +60,7 @@ Validate message reliability under various conditions, including network instabi

### Reliability Testing for js-waku

* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-js-waku`
* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-js-waku`
* owner: fbarbu15
* status: not started
* start-date:
Expand All @@ -76,7 +76,7 @@ Validate message reliability under various conditions, including network instabi

### Long-Run Testing

* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:long-run`
* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:long-run`
* owner: fbarbu15
* status: not started
* start-date:
Expand Down