diff --git a/content/qa/index.md b/content/qa/index.md index e735b7cb1..5fc11051d 100644 --- a/content/qa/index.md +++ b/content/qa/index.md @@ -16,11 +16,11 @@ tags: ### `waku:` * [[qa/waku/2025q1-interop-testing|interop-testing ]] * [[qa/waku/2025q1-waku-go-bindings-testing|waku-go-bindings-testing ]] -* [[qa/waku/2025q1-messaging-api-testing|messaging-api-testing ]] * [[qa/waku/2025q1-direct-message-reliability-testing|direct-message-reliability-testing ]] ### `nomos:` * [[qa/nomos/2025q1-da-testing|da-testing ]] +* [[qa/nomos/2025q1-e2e-testing|e2e-testing ]] --- ## 2024q4 `vac:qa:` diff --git a/content/qa/nomos/2025q1-e2e-testing.md b/content/qa/nomos/2025q1-e2e-testing.md new file mode 100644 index 000000000..ca351d1e3 --- /dev/null +++ b/content/qa/nomos/2025q1-e2e-testing.md @@ -0,0 +1,41 @@ +--- +title: Nomos E2E Testing for Nomos Node +tags: + - "2025q1" + - "qa" + - "nomos" +draft: false +description: Maintain and ensure the reliability of Nomos e2e tests. +--- + +`vac:qa:nomos:2025q1-e2e-testing` + +## Description +Maintain and ensure the continued reliability of the Nomos end to end testing framework. +This includes addressing regressions, adapting code in `nomos-e2e-tests` and `nomos-node`, +adapting to other changes in `nomos-node`, +and performing minor improvements to keep the framework functional and effective. + +**Alignment with VAC Narratives:** + +* The VAC QA team supports internal collaboration and efficiency by maintaining the quality and reliability of the Nomos E2E framework. + +## Task List + +### Maintenance + +* fully qualified name: `vac:qa:nomos:2025q1-e2e-testing:maintenance` +* owner: romanzac +* status: in progress (20%) +* start-date: 2025/01/01 +* end-date: 2025/03/31 + +#### Description +Ongoing maintenance of Nomos E2E tests and changes in Nomos Node repository related to Nomos E2E testing. +This includes updating tests for changes in `nomos-node`, addressing regressions, +investigating and resolving issues, and implementing minor improvements to the testing framework as needed. + +#### Deliverables +* [Two node cluster start automation](https://github.com/logos-co/nomos-e2e-tests/pull/1) +* [fix: Temporarily downgrade cargo-binstall to 1.10.19](https://github.com/logos-co/nomos-node/pull/983) +* [chore: Add LogOutput and LogLevel property to Cfgsync config](https://github.com/logos-co/nomos-node/pull/978) diff --git a/content/qa/waku/2025q1-direct-message-reliability-testing.md b/content/qa/waku/2025q1-direct-message-reliability-testing.md index 2a9d902c4..10421ff6c 100644 --- a/content/qa/waku/2025q1-direct-message-reliability-testing.md +++ b/content/qa/waku/2025q1-direct-message-reliability-testing.md @@ -32,7 +32,7 @@ and validating the application of MVDS for improved message delivery reliability * fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:functional` * owner: fbarbu15 -* status: in progress (60%) +* status: in progress (90%) * start-date: 2025/01/06 * end-date: 2025/01/25 @@ -50,7 +50,7 @@ including 1:1 chats and private groups. * fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:degraded-network` * owner: fbarbu15 -* status: in progress (40%) +* status: in progress (50%) * start-date: 2025/01/25 * end-date: 2025/02/15 @@ -68,7 +68,7 @@ after a network reconnection. * fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:rate-limit` * owner: fbarbu15 -* status: not started +* status: in progress (10%) * start-date: 2025/02/25 * end-date: 2025/03/10 diff --git a/content/qa/waku/2025q1-interop-testing.md b/content/qa/waku/2025q1-interop-testing.md index bb72c6774..c500fbad9 100644 --- a/content/qa/waku/2025q1-interop-testing.md +++ b/content/qa/waku/2025q1-interop-testing.md @@ -36,3 +36,5 @@ investigating and resolving issues, and implementing minor improvements to the t #### Deliverables * [SQL logic error table Message has no column named storedAt](https://github.com/waku-org/nwaku/issues/3243) +* [bug: wakuorg/nwaku:latest node fails to start for RLN tests](https://github.com/waku-org/nwaku/issues/3247) +* [chore: add reconciliation metrics](https://github.com/waku-org/waku-interop-tests/pull/100) diff --git a/content/qa/waku/2025q1-waku-go-bindings-testing.md b/content/qa/waku/2025q1-waku-go-bindings-testing.md index 7051554ca..d2fcf425e 100644 --- a/content/qa/waku/2025q1-waku-go-bindings-testing.md +++ b/content/qa/waku/2025q1-waku-go-bindings-testing.md @@ -53,7 +53,7 @@ It should also be adaptable to future testing needs. * fully qualified name: `vac:qa:waku:2025q1-waku-go-bindings-testing:relay` * owner: aya -* status: not started +* status: in progress (25%) * start-date: 2025/01/20 * end-date: 2025/02/25 diff --git a/content/qa/waku/2025q1-messaging-api-testing.md b/content/qa/waku/2025q2-messaging-api-testing.md similarity index 87% rename from content/qa/waku/2025q1-messaging-api-testing.md rename to content/qa/waku/2025q2-messaging-api-testing.md index ef3ebc2a3..518c85e40 100644 --- a/content/qa/waku/2025q1-messaging-api-testing.md +++ b/content/qa/waku/2025q2-messaging-api-testing.md @@ -1,21 +1,21 @@ --- title: Messaging API Testing tags: - - "2025q1" + - "2025q2" - "qa" - "waku" draft: false description: Test and validate the reliability of the Messaging API for nwaku and js-waku. --- -`vac:qa:waku:2025q1-messaging-api-testing` +`vac:qa:waku:2025q2-messaging-api-testing` ## Description Test and validate the reliability of the Messaging API for nwaku and js-waku in accordance to Waku FURPS. Ensure the API performs consistently and meets the expected functional and reliability requirements, aligning with behaviors used by applications like the Status app and Waku Tester tool. -Note! Dates are not set because Waku needs to notify us when the task is ready for QA. +Note! Waku confirmed that this will be ready to test somewhere in Q2 or even Q3 2025 **Alignment with VAC Narratives:** - By testing the Messaging API, @@ -28,7 +28,7 @@ Note! Dates are not set because Waku needs to notify us when the task is ready f ### Integrate Functional Testing into Interop Framework -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-interop` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-interop` * owner: fbarbu15 * status: not started * start-date: @@ -44,7 +44,7 @@ Implement functional tests for the new Messaging API within the interop testing ### Reliability Testing for nwaku -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-nwaku` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-nwaku` * owner: fbarbu15 * status: not started * start-date: @@ -60,7 +60,7 @@ Validate message reliability under various conditions, including network instabi ### Reliability Testing for js-waku -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-js-waku` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-js-waku` * owner: fbarbu15 * status: not started * start-date: @@ -76,7 +76,7 @@ Validate message reliability under various conditions, including network instabi ### Long-Run Testing -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:long-run` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:long-run` * owner: fbarbu15 * status: not started * start-date: