Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cluster: could not parse redisearch results #97

Open
fcostaoliveira opened this issue Sep 18, 2024 · 0 comments
Open

cluster: could not parse redisearch results #97

fcostaoliveira opened this issue Sep 18, 2024 · 0 comments
Assignees
@fcostaoliveira
Labels
bug Something isn't working

Comments

@fcostaoliveira
Copy link

issue coming from: https://github.com/RediSearch/RediSearch/actions/runs/10926464133/job/30338823638?pr=5026

2024-09-18T20:05:01.3822240Z 2024-09-18 20:05:01,381 INFO Executing remote command "wget https://s3.amazonaws.com/benchmarks.redislabs/redisearch/tools/ftsb/ftsb_redisearch_linux_amd64 -q -O /tmp/ftsb_redisearch"
2024-09-18T20:05:02.1128132Z INFO:root:Executing remote command "wget https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/1M-enwiki_abstract-hashes-text-no-sortable/1M-enwiki_abstract-hashes-text-no-sortable.redisearch.commands.BENCH.QUERY_simple-1word-query.csv -q -O /tmp/input.data"
2024-09-18T20:05:02.1131979Z 2024-09-18 20:05:02,112 INFO Executing remote command "wget https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/1M-enwiki_abstract-hashes-text-no-sortable/1M-enwiki_abstract-hashes-text-no-sortable.redisearch.commands.BENCH.QUERY_simple-1word-query.csv -q -O /tmp/input.data"
2024-09-18T20:05:06.9431398Z INFO:root:Executing remote command "chmod 755 /tmp/ftsb_redisearch"
2024-09-18T20:05:06.9433045Z 2024-09-18 20:05:06,942 INFO Executing remote command "chmod 755 /tmp/ftsb_redisearch"
2024-09-18T20:05:07.0205923Z INFO:root:Finished up remote tool ftsb_redisearch requirements
2024-09-18T20:05:07.0207775Z 2024-09-18 20:05:07,020 INFO Finished up remote tool ftsb_redisearch requirements
2024-09-18T20:05:07.0209411Z INFO:root:Reusing cached remote file (located at /tmp/input.data ).
2024-09-18T20:05:07.0210992Z 2024-09-18 20:05:07,020 INFO Reusing cached remote file (located at /tmp/input.data ).
2024-09-18T20:05:07.0212319Z INFO:root:Running the benchmark with the following parameters:
2024-09-18T20:05:07.0216069Z 	Args array: ['/tmp/ftsb_redisearch', '--host', '10.3.0.226:20000', '--cluster-mode', '--workers', '32', '--requests', '50000', '--reporting-period', '1s', '--input', '/tmp/input.data', '--json-out-file', '/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out']
2024-09-18T20:05:07.0221768Z 	Args str: /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out
2024-09-18T20:05:07.0225181Z 2024-09-18 20:05:07,020 INFO Running the benchmark with the following parameters:
2024-09-18T20:05:07.0228999Z 	Args array: ['/tmp/ftsb_redisearch', '--host', '10.3.0.226:20000', '--cluster-mode', '--workers', '32', '--requests', '50000', '--reporting-period', '1s', '--input', '/tmp/input.data', '--json-out-file', '/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out']
2024-09-18T20:05:07.0234584Z 	Args str: /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out
2024-09-18T20:05:07.0237837Z INFO:root:Starting CPU collecing thread
2024-09-18T20:05:07.0238894Z 2024-09-18 20:05:07,020 INFO Starting CPU collecing thread
2024-09-18T20:05:07.0630008Z INFO:root:Connecting to remote server 3.14.141.238
2024-09-18T20:05:07.0631155Z 2024-09-18 20:05:07,062 INFO Connecting to remote server 3.14.141.238
2024-09-18T20:05:07.0899752Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.0902034Z 2024-09-18 20:05:07,089 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.0903288Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.0904603Z 2024-09-18 20:05:07,089 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.2403618Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:07.2406510Z 2024-09-18 20:05:07,239 INFO Authentication (publickey) successful!
2024-09-18T20:05:07.2407675Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:07.2408775Z 2024-09-18 20:05:07,239 INFO Authentication (publickey) successful!
2024-09-18T20:05:07.2409687Z INFO:root:Connected to remote server 3.14.141.238
2024-09-18T20:05:07.2410715Z 2024-09-18 20:05:07,240 INFO Connected to remote server 3.14.141.238
2024-09-18T20:05:07.2413518Z INFO:root:Executing remote command "/tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:07.2417549Z 2024-09-18 20:05:07,240 INFO Executing remote command "/tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:35.3091701Z WARNING:root:Exit status: 1 for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:35.3095948Z 	STDERR: []
2024-09-18T20:05:35.3119310Z 	STDOUT: ['    setup writes/sec          writes/sec         updates/sec           reads/sec    cursor reads/sec         deletes/sec     current ops/sec           total ops             TX BW/sRX BW/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       200 (112.063)           0 (0.000)           0 (0.000)       200 (112.063)                 200               0BB/s  23.7KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)      2492 (115.967)           0 (0.000)           0 (0.000)      2492 (115.967)                2693               0BB/s  296.5KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       500 (117.311)           0 (0.000)           0 (0.000)       500 (117.311)                3193               0BB/s  59.4KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       800 (117.311)           0 (0.000)           0 (0.000)       800 (117.311)                3993               0BB/s  95KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)      1999 (119.167)           0 (0.000)           0 (0.000)      1999 (119.167)                5993               0BB/s  237.2KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       400 (119.295)           0 (0.000)           0 (0.000)       400 (119.295)                6393               0BB/s  47.5KB/s\n', '2024/09/18 20:05:35 could not parse redisearch results\n']
2024-09-18T20:05:35.3131690Z 2024-09-18 20:05:35,307 WARNING Exit status: 1 for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:35.3133631Z 	STDERR: []
2024-09-18T20:05:35.3147355Z 	STDOUT: ['    setup writes/sec          writes/sec         updates/sec           reads/sec    cursor reads/sec         deletes/sec     current ops/sec           total ops             TX BW/sRX BW/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       200 (112.063)           0 (0.000)           0 (0.000)       200 (112.063)                 200               0BB/s  23.7KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)      2492 (115.967)           0 (0.000)           0 (0.000)      2492 (115.967)                2693               0BB/s  296.5KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       500 (117.311)           0 (0.000)           0 (0.000)       500 (117.311)                3193               0BB/s  59.4KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       800 (117.311)           0 (0.000)           0 (0.000)       800 (117.311)                3993               0BB/s  95KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)      1999 (119.167)           0 (0.000)           0 (0.000)      1999 (119.167)                5993               0BB/s  237.2KB/s\n', '          0 (0.000)           0 (0.000)           0 (0.000)       400 (119.295)           0 (0.000)           0 (0.000)       400 (119.295)                6393               0BB/s  47.5KB/s\n', '2024/09/18 20:05:35 could not parse redisearch results\n']
2024-09-18T20:05:35.3158485Z ERROR:root:Exit status of remote command execution 1. Printing stdout and stderr
2024-09-18T20:05:35.3159575Z 2024-09-18 20:05:35,308 ERROR Exit status of remote command execution 1. Printing stdout and stderr
2024-09-18T20:05:35.3161910Z INFO:root:Exit status for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: 1
2024-09-18T20:05:35.3165320Z 2024-09-18 20:05:35,308 INFO Exit status for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: 1
2024-09-18T20:05:35.3167421Z INFO:root:	remote process stdout:
2024-09-18T20:05:35.3168008Z 2024-09-18 20:05:35,308 INFO 	remote process stdout:
2024-09-18T20:05:35.3168564Z ERROR:root:	remote process stderr:
2024-09-18T20:05:35.3169133Z 2024-09-18 20:05:35,308 ERROR 	remote process stderr:
2024-09-18T20:05:35.3169711Z INFO:root:Stopping CPU collecting thread
2024-09-18T20:05:35.3170335Z 2024-09-18 20:05:35,308 INFO Stopping CPU collecting thread
2024-09-18T20:05:38.7305807Z INFO:root:CPU collecting thread stopped
2024-09-18T20:05:38.7307157Z 2024-09-18 20:05:38,730 INFO CPU collecting thread stopped
2024-09-18T20:05:38.7308154Z INFO:root:Benchmark duration 28 secs.
2024-09-18T20:05:38.7309294Z 2024-09-18 20:05:38,730 INFO Benchmark duration 28 secs.
2024-09-18T20:05:38.7310878Z WARNING:root:Benchmark duration of 28 secs is bellow the considered minimum duration for a stable run (60 secs).
2024-09-18T20:05:38.7313564Z 2024-09-18 20:05:38,730 WARNING Benchmark duration of 28 secs is bellow the considered minimum duration for a stable run (60 secs).
2024-09-18T20:05:38.7317097Z ERROR:root:Given the remote tool failed, inspecting the remote results file content (/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out)
2024-09-18T20:05:38.7321835Z 2024-09-18 20:05:38,730 ERROR Given the remote tool failed, inspecting the remote results file content (/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out)
2024-09-18T20:05:38.7725112Z INFO:root:Connecting to remote server 3.14.141.238
2024-09-18T20:05:38.7726522Z 2024-09-18 20:05:38,772 INFO Connecting to remote server 3.14.141.238
2024-09-18T20:05:38.8001367Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.8003329Z 2024-09-18 20:05:38,799 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.8004342Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.8005394Z 2024-09-18 20:05:38,799 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.9493790Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:38.9495835Z 2024-09-18 20:05:38,949 INFO Authentication (publickey) successful!
2024-09-18T20:05:38.9497529Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:38.9498675Z 2024-09-18 20:05:38,949 INFO Authentication (publickey) successful!
2024-09-18T20:05:38.9499451Z INFO:root:Connected to remote server 3.14.141.238
2024-09-18T20:05:38.9500247Z 2024-09-18 20:05:38,949 INFO Connected to remote server 3.14.141.238
2024-09-18T20:05:38.9501919Z INFO:root:Executing remote command "cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:38.9504316Z 2024-09-18 20:05:38,949 INFO Executing remote command "cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:39.1038010Z WARNING:root:Exit status: 1 for command cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:39.1039955Z 	STDERR: []
2024-09-18T20:05:39.1041290Z 	STDOUT: ['cat: /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: No such file or directory\n']
2024-09-18T20:05:39.1043476Z 2024-09-18 20:05:39,103 WARNING Exit status: 1 for command cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:39.1044972Z 	STDERR: []
2024-09-18T20:05:39.1046228Z 	STDOUT: ['cat: /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: No such file or directory\n']
2024-09-18T20:05:39.1047471Z WARNING:root:Remote results file content: []
2024-09-18T20:05:39.1048154Z 2024-09-18 20:05:39,103 WARNING Remote results file content: []
2024-09-18T20:05:39.1049922Z INFO:root:Total CPU usage (233.753 %)
2024-09-18T20:05:39.1050916Z 2024-09-18 20:05:39,104 INFO Total CPU usage (233.753 %)
2024-09-18T20:05:39.1461083Z INFO:root:Connecting to remote server 3.145.163.181
2024-09-18T20:05:39.1462453Z 2024-09-18 20:05:39,145 INFO Connecting to remote server 3.145.163.181
2024-09-18T20:05:39.1746648Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.1748399Z 2024-09-18 20:05:39,174 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.1749471Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.1750442Z 2024-09-18 20:05:39,174 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.3240241Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:39.3241918Z 2024-09-18 20:05:39,323 INFO Authentication (publickey) successful!
2024-09-18T20:05:39.3242870Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:39.3243778Z 2024-09-18 20:05:39,323 INFO Authentication (publickey) successful!
2024-09-18T20:05:39.3244539Z INFO:root:Connected to remote server 3.145.163.181
2024-09-18T20:05:39.3245357Z 2024-09-18 20:05:39,323 INFO Connected to remote server 3.145.163.181
2024-09-18T20:05:39.3247183Z INFO:root:Executing remote command "zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*"
2024-09-18T20:05:39.3249874Z 2024-09-18 20:05:39,323 INFO Executing remote command "zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*"
2024-09-18T20:05:39.9417273Z WARNING:root:Exit status: 12 for command zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*.
2024-09-18T20:05:39.9422108Z 	STDERR: ['\tzip warning: name not matched: /tmp/nkskzrwangskvpxckumm/*\n', '\n', 'zip error: Nothing to do! (try: zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip . -i /tmp/nkskzrwangskvpxckumm/*)\n']
2024-09-18T20:05:39.9424156Z 	STDOUT: []
2024-09-18T20:05:39.9425671Z 2024-09-18 20:05:39,941 WARNING Exit status: 12 for command zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*.
2024-09-18T20:05:39.9428396Z 	STDERR: ['\tzip warning: name not matched: /tmp/nkskzrwangskvpxckumm/*\n', '\n', 'zip error: Nothing to do! (try: zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip . -i /tmp/nkskzrwangskvpxckumm/*)\n']
2024-09-18T20:05:39.9430051Z 	STDOUT: []
2024-09-18T20:05:39.9432360Z ERROR:root:The benchmark returned an error exit status. Fetching remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip into ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:39.9435947Z 2024-09-18 20:05:39,941 ERROR The benchmark returned an error exit status. Fetching remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip into ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:39.9439149Z INFO:root:Retrieving remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip from remote server 3.145.163.181 
2024-09-18T20:05:39.9441634Z 2024-09-18 20:05:39,941 INFO Retrieving remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip from remote server 3.145.163.181 
2024-09-18T20:05:39.9444282Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9445892Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9446194Z 
2024-09-18T20:05:39.9447705Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9449382Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9449677Z 
2024-09-18T20:05:39.9451121Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9452695Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9452988Z 
2024-09-18T20:05:39.9454476Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9456099Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9456394Z 
2024-09-18T20:05:39.9457843Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9459404Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9459698Z 
2024-09-18T20:05:39.9461177Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9462807Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9463103Z 
2024-09-18T20:05:39.9464574Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9466170Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9466462Z 
2024-09-18T20:05:39.9468079Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9469870Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9470482Z 
2024-09-18T20:05:39.9472130Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9473742Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9474204Z 
2024-09-18T20:05:39.9475710Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts.  You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9477349Z   warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9477848Z 
2024-09-18T20:05:39.9933505Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.9934668Z 2024-09-18 20:05:39,993 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.9935506Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.9936367Z 2024-09-18 20:05:39,993 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:40.1507697Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:40.1509009Z 2024-09-18 20:05:40,150 INFO Authentication (publickey) successful!
2024-09-18T20:05:40.1510119Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:40.1511181Z 2024-09-18 20:05:40,150 INFO Authentication (publickey) successful!
2024-09-18T20:05:40.3232998Z INFO:paramiko.transport.sftp:[chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3234227Z 2024-09-18 20:05:40,322 INFO [chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3235235Z INFO:paramiko.transport.sftp:[chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3236262Z 2024-09-18 20:05:40,322 INFO [chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3338987Z ERROR:root:Unable to fetch remote file: [Errno 2] No such file
2024-09-18T20:05:40.3341344Z 2024-09-18 20:05:40,333 ERROR Unable to fetch remote file: [Errno 2] No such file
2024-09-18T20:05:40.3342853Z INFO:paramiko.transport.sftp:[chan 0] sftp session closed.
2024-09-18T20:05:40.3344289Z 2024-09-18 20:05:40,333 INFO [chan 0] sftp session closed.
2024-09-18T20:05:40.3345561Z INFO:paramiko.transport.sftp:[chan 0] sftp session closed.
2024-09-18T20:05:40.3346976Z 2024-09-18 20:05:40,333 INFO [chan 0] sftp session closed.
2024-09-18T20:05:40.3351892Z INFO:root:Uploading file ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip to s3. s3 bucket name: ci.benchmarks.redislabs. s3 bucket path: RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/
2024-09-18T20:05:40.3357857Z 2024-09-18 20:05:40,333 INFO Uploading file ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip to s3. s3 bucket name: ci.benchmarks.redislabs. s3 bucket path: RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/
2024-09-18T20:05:40.3361243Z INFO:root:-- uploading results to s3 -- 
2024-09-18T20:05:40.3362308Z 2024-09-18 20:05:40,334 INFO -- uploading results to s3 -- 
2024-09-18T20:05:40.3363390Z INFO:root:-- Using default AWS credentials -- 
2024-09-18T20:05:40.3364449Z 2024-09-18 20:05:40,334 INFO -- Using default AWS credentials -- 
2024-09-18T20:05:40.3870838Z 
2024-09-18T20:05:40.3872688Z setup writes/sec          writes/sec         updates/sec           reads/sec    cursor reads/sec         deletes/sec     current ops/sec           total ops             TX BW/sRX BW/s
2024-09-18T20:05:40.3874640Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3875857Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3877034Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3878681Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3879824Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3880970Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3882117Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3883207Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3884237Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3885238Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3886231Z 0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)           0 (0.000)                   0               0BB/s  0BB/s
2024-09-18T20:05:40.3887298Z 0 (0.000)           0 (0.000)           0 (0.000)       200 (112.063)           0 (0.000)           0 (0.000)       200 (112.063)                 200               0BB/s  23.7KB/s
2024-09-18T20:05:40.3888414Z 0 (0.000)           0 (0.000)           0 (0.000)      2492 (115.967)           0 (0.000)           0 (0.000)      2492 (115.967)                2693               0BB/s  296.5KB/s
2024-09-18T20:05:40.3889519Z 0 (0.000)           0 (0.000)           0 (0.000)       500 (117.311)           0 (0.000)           0 (0.000)       500 (117.311)                3193               0BB/s  59.4KB/s
2024-09-18T20:05:40.3890606Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3891650Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3892676Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3893716Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3894738Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3895751Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3896950Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3897988Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3899036Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3900653Z 0 (0.000)           0 (0.000)           0 (0.000)         0 (117.311)           0 (0.000)           0 (0.000)         0 (117.311)                3193               0BB/s  0BB/s
2024-09-18T20:05:40.3902252Z 0 (0.000)           0 (0.000)           0 (0.000)       800 (117.311)           0 (0.000)           0 (0.000)       800 (117.311)                3993               0BB/s  95KB/s
2024-09-18T20:05:40.3904119Z 0 (0.000)           0 (0.000)           0 (0.000)      1999 (119.167)           0 (0.000)           0 (0.000)      1999 (119.167)                5993               0BB/s  237.2KB/s
2024-09-18T20:05:40.3905826Z 0 (0.000)           0 (0.000)           0 (0.000)       400 (119.295)           0 (0.000)           0 (0.000)       400 (119.295)                6393               0BB/s  47.5KB/s
2024-09-18T20:05:40.3906827Z 2024/09/18 20:05:35 could not parse redisearch results
2024-09-18T20:05:40.5283718Z   0%|          | 0/1 [00:00<?, ?files/s]
2024-09-18T20:05:40.5285246Z 100%|██████████| 1/1 [00:00<00:00,  7.09files/s]
2024-09-18T20:05:40.5286052Z 100%|██████████| 1/1 [00:00<00:00,  7.08files/s]
2024-09-18T20:05:40.5294406Z INFO:root:Artifact: search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip. URL: https://s3.***.amazonaws.com/ci.benchmarks.redislabs/RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:40.5300205Z 2024-09-18 20:05:40,528 INFO Artifact: search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip. URL: https://s3.***.amazonaws.com/ci.benchmarks.redislabs/RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:40.6204662Z CRITICAL:root:Some unexpected exception was caught during remote work on test named search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable. Failing test....
2024-09-18T20:05:40.6211067Z 2024-09-18 20:05:40,619 CRITICAL Some unexpected exception was caught during remote work on test named search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable. Failing test....
@fcostaoliveira fcostaoliveira added the bug Something isn't working label Sep 18, 2024
@fcostaoliveira fcostaoliveira self-assigned this Sep 18, 2024
fcostaoliveira added a commit to RediSearch/RediSearch that referenced this issue Sep 18, 2024
@fcostaoliveira
Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-q…
08a5a8b 
…uery-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 19, 2024
@alonre24 @fcostaoliveira
Fix benchmark to use new build path (#5026)
21f4695 
* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 19, 2024
@alonre24 @fcostaoliveira
Fix benchmark to use new build path (#5026)
57e6acb 
* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 22, 2024
@alonre24 @fcostaoliveira
Fix benchmark to use new build path (#5026)
242e5e3 
* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 22, 2024
@alonre24 @fcostaoliveira
Fix benchmark to use new build path (#5026)
fab6bd9 
* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 23, 2024
@alonre24 @fcostaoliveira
Fix benchmark to use new build path (#5026)
0a47e07 
* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>
alonre24 added a commit to RediSearch/RediSearch that referenced this issue Sep 23, 2024
@alonre24 @fcostaoliveira
Fix benchmark to use new build path (#5026)
fb4b576 
* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 25, 2024
@alonre24 @kei-nan
@DvirDukhan @fcostaoliveira
[8.0] [MOD-7480] Single build path + benchmark fix (#5036)
d30bc03 
* MOD-7596: Add mirroring support (#4937)

* * initial commit

* * Use RediSearch branch mirroring fork

* * Code Review - Round #1

* MOD-7695: Decide Ubuntu Runner Using Variable (#4975)

* * initial commit

* * code review

* Dvirdu_set_7.99.0_version_and_test_unstable (#4997)

* 7.99.0

* redis unstable tests

* CP single build path

* Fix benchmark to use new build path (#5026)

* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>

* rebase 8.0

---------

Co-authored-by: kei-nan <[email protected]>
Co-authored-by: DvirDukhan <[email protected]>
Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 25, 2024
@alonre24 @kei-nan
@DvirDukhan @fcostaoliveira
[8.0] [MOD-7480] Single build path + benchmark fix (#5036)
ddc340d 
* MOD-7596: Add mirroring support (#4937)

* * initial commit

* * Use RediSearch branch mirroring fork

* * Code Review - Round #1

* MOD-7695: Decide Ubuntu Runner Using Variable (#4975)

* * initial commit

* * code review

* Dvirdu_set_7.99.0_version_and_test_unstable (#4997)

* 7.99.0

* redis unstable tests

* CP single build path

* Fix benchmark to use new build path (#5026)

* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>

* rebase 8.0

---------

Co-authored-by: kei-nan <[email protected]>
Co-authored-by: DvirDukhan <[email protected]>
Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 26, 2024
@alonre24 @kei-nan
@DvirDukhan @fcostaoliveira
[8.0] [MOD-7480] Single build path + benchmark fix (#5036)
f2e003b 
* MOD-7596: Add mirroring support (#4937)

* * initial commit

* * Use RediSearch branch mirroring fork

* * Code Review - Round #1

* MOD-7695: Decide Ubuntu Runner Using Variable (#4975)

* * initial commit

* * code review

* Dvirdu_set_7.99.0_version_and_test_unstable (#4997)

* 7.99.0

* redis unstable tests

* CP single build path

* Fix benchmark to use new build path (#5026)

* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>

* rebase 8.0

---------

Co-authored-by: kei-nan <[email protected]>
Co-authored-by: DvirDukhan <[email protected]>
Co-authored-by: fcostaoliveira <[email protected]>
github-merge-queue bot pushed a commit to RediSearch/RediSearch that referenced this issue Sep 26, 2024
@alonre24 @kei-nan
@DvirDukhan @fcostaoliveira
[8.0] [MOD-7480] Single build path + benchmark fix (#5036)
16abfe1 
* MOD-7596: Add mirroring support (#4937)

* * initial commit

* * Use RediSearch branch mirroring fork

* * Code Review - Round #1

* MOD-7695: Decide Ubuntu Runner Using Variable (#4975)

* * initial commit

* * code review

* Dvirdu_set_7.99.0_version_and_test_unstable (#4997)

* 7.99.0

* redis unstable tests

* CP single build path

* Fix benchmark to use new build path (#5026)

* Fix benchmark to use new build path

* Take Raz's fix for benchmarks

* fix default module path

* make benchmark fail

* fix path

* fail external flow

* remove fail fast and continue on error

* addressing CR

* Splitting the standalone work among 6 groups. Only profile if explictly enabled. Only run >4 primaries if extended if enabled.

* Specify name of benchmark step on GH flow

* Using perf-cto-base-image-ubuntu20.04-redis-7.4.0-tuned-latency on spot instances as well.

* Fixed RedisJSON module path on benchmark setup. Enforcing ReJSON module to be present

* Changing from 6 to 9 oss-standalone runners to achieve a time for full feedback < 30min

* MODULE_FILE not working on Prepare ReJSON Module: using default location

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Using redisbench-admin >= 0.11.3 due to multi-module issue

* Added missing --allowed-setups info for oss-standalone config

* redisbench-admin >= 0.11.4

* Remove vecsim-ann-benchmarks_LOAD_1c_redisearch-hnsw_glove-200-angular_M-4.yml

* Using redisbench-admin >= 0.11.5 due to ssh timeout issues on heavy benchmarks or heavy prunning at the end

* Increasing concurrency of standalone benchmarks to reduce time to feedback

* redisbench-admin >= 0.11.6. removed unstable test vecsim-ann-benchmarks_QUERY_1c_redisearch-hnsw_glove-200-angular_M-4

* redisbench-admin >= 0.11.7. running cluster tests faster and also ensuring we use a redisbench-admin with keepalive on ssh tunnels

* Removed search-ftsb-10K-enwiki_abstract-hashes-term-withoutsuffix-trie from cluster tests due to keyspace error check

* Removed search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable from cluster tests due to client error. created RediSearch/ftsb#97

* Not running *.rdb based benchmarks on cluster due to orphaned keys (redis/redis#9506)

---------

Co-authored-by: fcostaoliveira <[email protected]>

* rebase 8.0

---------

Co-authored-by: kei-nan <[email protected]>
Co-authored-by: DvirDukhan <[email protected]>
Co-authored-by: fcostaoliveira <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fcostaoliveira fcostaoliveira

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@fcostaoliveira