From 9175cb4636ff5b6aad8c44b9720c476f94e6a621 Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 14:31:04 +0200 Subject: [PATCH 1/7] Update 2025q1-direct-message-reliability-testing.md --- .../qa/waku/2025q1-direct-message-reliability-testing.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/content/qa/waku/2025q1-direct-message-reliability-testing.md b/content/qa/waku/2025q1-direct-message-reliability-testing.md index 2a9d902c4..10421ff6c 100644 --- a/content/qa/waku/2025q1-direct-message-reliability-testing.md +++ b/content/qa/waku/2025q1-direct-message-reliability-testing.md @@ -32,7 +32,7 @@ and validating the application of MVDS for improved message delivery reliability * fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:functional` * owner: fbarbu15 -* status: in progress (60%) +* status: in progress (90%) * start-date: 2025/01/06 * end-date: 2025/01/25 @@ -50,7 +50,7 @@ including 1:1 chats and private groups. * fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:degraded-network` * owner: fbarbu15 -* status: in progress (40%) +* status: in progress (50%) * start-date: 2025/01/25 * end-date: 2025/02/15 @@ -68,7 +68,7 @@ after a network reconnection. * fully qualified name: `vac:qa:waku:2025q1-direct-message-reliability-testing:rate-limit` * owner: fbarbu15 -* status: not started +* status: in progress (10%) * start-date: 2025/02/25 * end-date: 2025/03/10 From 850a1d5882976c389b352aff848f36d8a6843044 Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 14:37:48 +0200 Subject: [PATCH 2/7] Update 2025q1-waku-go-bindings-testing.md --- content/qa/waku/2025q1-waku-go-bindings-testing.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/qa/waku/2025q1-waku-go-bindings-testing.md b/content/qa/waku/2025q1-waku-go-bindings-testing.md index 7051554ca..d2fcf425e 100644 --- a/content/qa/waku/2025q1-waku-go-bindings-testing.md +++ b/content/qa/waku/2025q1-waku-go-bindings-testing.md @@ -53,7 +53,7 @@ It should also be adaptable to future testing needs. * fully qualified name: `vac:qa:waku:2025q1-waku-go-bindings-testing:relay` * owner: aya -* status: not started +* status: in progress (25%) * start-date: 2025/01/20 * end-date: 2025/02/25 From 70f68619d4276c656751f8d98fedd281a0f65fcf Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 14:45:41 +0200 Subject: [PATCH 3/7] Update 2025q1-interop-testing.md --- content/qa/waku/2025q1-interop-testing.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/content/qa/waku/2025q1-interop-testing.md b/content/qa/waku/2025q1-interop-testing.md index bb72c6774..c500fbad9 100644 --- a/content/qa/waku/2025q1-interop-testing.md +++ b/content/qa/waku/2025q1-interop-testing.md @@ -36,3 +36,5 @@ investigating and resolving issues, and implementing minor improvements to the t #### Deliverables * [SQL logic error table Message has no column named storedAt](https://github.com/waku-org/nwaku/issues/3243) +* [bug: wakuorg/nwaku:latest node fails to start for RLN tests](https://github.com/waku-org/nwaku/issues/3247) +* [chore: add reconciliation metrics](https://github.com/waku-org/waku-interop-tests/pull/100) From 083f060a7e1cdd9a292b53ff6d16c161c5754e9e Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 14:59:40 +0200 Subject: [PATCH 4/7] Create 2025q1-e2e-testing.md --- content/qa/nomos/2025q1-e2e-testing.md | 41 ++++++++++++++++++++++++++ 1 file changed, 41 insertions(+) create mode 100644 content/qa/nomos/2025q1-e2e-testing.md diff --git a/content/qa/nomos/2025q1-e2e-testing.md b/content/qa/nomos/2025q1-e2e-testing.md new file mode 100644 index 000000000..ca351d1e3 --- /dev/null +++ b/content/qa/nomos/2025q1-e2e-testing.md @@ -0,0 +1,41 @@ +--- +title: Nomos E2E Testing for Nomos Node +tags: + - "2025q1" + - "qa" + - "nomos" +draft: false +description: Maintain and ensure the reliability of Nomos e2e tests. +--- + +`vac:qa:nomos:2025q1-e2e-testing` + +## Description +Maintain and ensure the continued reliability of the Nomos end to end testing framework. +This includes addressing regressions, adapting code in `nomos-e2e-tests` and `nomos-node`, +adapting to other changes in `nomos-node`, +and performing minor improvements to keep the framework functional and effective. + +**Alignment with VAC Narratives:** + +* The VAC QA team supports internal collaboration and efficiency by maintaining the quality and reliability of the Nomos E2E framework. + +## Task List + +### Maintenance + +* fully qualified name: `vac:qa:nomos:2025q1-e2e-testing:maintenance` +* owner: romanzac +* status: in progress (20%) +* start-date: 2025/01/01 +* end-date: 2025/03/31 + +#### Description +Ongoing maintenance of Nomos E2E tests and changes in Nomos Node repository related to Nomos E2E testing. +This includes updating tests for changes in `nomos-node`, addressing regressions, +investigating and resolving issues, and implementing minor improvements to the testing framework as needed. + +#### Deliverables +* [Two node cluster start automation](https://github.com/logos-co/nomos-e2e-tests/pull/1) +* [fix: Temporarily downgrade cargo-binstall to 1.10.19](https://github.com/logos-co/nomos-node/pull/983) +* [chore: Add LogOutput and LogLevel property to Cfgsync config](https://github.com/logos-co/nomos-node/pull/978) From 7e525682a1c30b51151d87e302dbe381f8aeed37 Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 15:00:50 +0200 Subject: [PATCH 5/7] Update index.md --- content/qa/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/qa/index.md b/content/qa/index.md index e735b7cb1..5fc11051d 100644 --- a/content/qa/index.md +++ b/content/qa/index.md @@ -16,11 +16,11 @@ tags: ### `waku:` * [[qa/waku/2025q1-interop-testing|interop-testing ]] * [[qa/waku/2025q1-waku-go-bindings-testing|waku-go-bindings-testing ]] -* [[qa/waku/2025q1-messaging-api-testing|messaging-api-testing ]] * [[qa/waku/2025q1-direct-message-reliability-testing|direct-message-reliability-testing ]] ### `nomos:` * [[qa/nomos/2025q1-da-testing|da-testing ]] +* [[qa/nomos/2025q1-e2e-testing|e2e-testing ]] --- ## 2024q4 `vac:qa:` From 0fa8e021f1c50ee0a4549b1a37f0a1dee2f300ce Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 15:02:07 +0200 Subject: [PATCH 6/7] Update and rename 2025q1-messaging-api-testing.md to 2025q2-messaging-api-testing.md --- ...-testing.md => 2025q2-messaging-api-testing.md} | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) rename content/qa/waku/{2025q1-messaging-api-testing.md => 2025q2-messaging-api-testing.md} (87%) diff --git a/content/qa/waku/2025q1-messaging-api-testing.md b/content/qa/waku/2025q2-messaging-api-testing.md similarity index 87% rename from content/qa/waku/2025q1-messaging-api-testing.md rename to content/qa/waku/2025q2-messaging-api-testing.md index ef3ebc2a3..f8ed0bc69 100644 --- a/content/qa/waku/2025q1-messaging-api-testing.md +++ b/content/qa/waku/2025q2-messaging-api-testing.md @@ -1,21 +1,21 @@ --- title: Messaging API Testing tags: - - "2025q1" + - "2025q2" - "qa" - "waku" draft: false description: Test and validate the reliability of the Messaging API for nwaku and js-waku. --- -`vac:qa:waku:2025q1-messaging-api-testing` +`vac:qa:waku:2025q2-messaging-api-testing` ## Description Test and validate the reliability of the Messaging API for nwaku and js-waku in accordance to Waku FURPS. Ensure the API performs consistently and meets the expected functional and reliability requirements, aligning with behaviors used by applications like the Status app and Waku Tester tool. -Note! Dates are not set because Waku needs to notify us when the task is ready for QA. +Note! Waku confirmed that this will be somewhere in Q2 or even Q3 2025 **Alignment with VAC Narratives:** - By testing the Messaging API, @@ -28,7 +28,7 @@ Note! Dates are not set because Waku needs to notify us when the task is ready f ### Integrate Functional Testing into Interop Framework -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-interop` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-interop` * owner: fbarbu15 * status: not started * start-date: @@ -44,7 +44,7 @@ Implement functional tests for the new Messaging API within the interop testing ### Reliability Testing for nwaku -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-nwaku` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-nwaku` * owner: fbarbu15 * status: not started * start-date: @@ -60,7 +60,7 @@ Validate message reliability under various conditions, including network instabi ### Reliability Testing for js-waku -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:functional-js-waku` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:functional-js-waku` * owner: fbarbu15 * status: not started * start-date: @@ -76,7 +76,7 @@ Validate message reliability under various conditions, including network instabi ### Long-Run Testing -* fully qualified name: `vac:qa:waku:2025q1-messaging-api-testing:long-run` +* fully qualified name: `vac:qa:waku:2025q2-messaging-api-testing:long-run` * owner: fbarbu15 * status: not started * start-date: From 3187dea9af4d5becdf71b2377ae5ff2ea7774e2a Mon Sep 17 00:00:00 2001 From: fbarbu15 Date: Mon, 27 Jan 2025 15:05:29 +0200 Subject: [PATCH 7/7] Update 2025q2-messaging-api-testing.md --- content/qa/waku/2025q2-messaging-api-testing.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/qa/waku/2025q2-messaging-api-testing.md b/content/qa/waku/2025q2-messaging-api-testing.md index f8ed0bc69..518c85e40 100644 --- a/content/qa/waku/2025q2-messaging-api-testing.md +++ b/content/qa/waku/2025q2-messaging-api-testing.md @@ -15,7 +15,7 @@ Test and validate the reliability of the Messaging API for nwaku and js-waku in accordance to Waku FURPS. Ensure the API performs consistently and meets the expected functional and reliability requirements, aligning with behaviors used by applications like the Status app and Waku Tester tool. -Note! Waku confirmed that this will be somewhere in Q2 or even Q3 2025 +Note! Waku confirmed that this will be ready to test somewhere in Q2 or even Q3 2025 **Alignment with VAC Narratives:** - By testing the Messaging API,