RowsRemaining functionality present in *plugin.QueryData is not working as expected

[bigdatasourav]

The RowsRemaining is not working in child tables as expected when the query provides a limit. The RowsRemaining should gradually decrease with each streamListItem, but it is not behaving as expected. Interestingly with StreamLeafListItem(deprecated), the RowsRemaining is working fine. Below are the example outputs. Tested with v5.4.1 and v5.5.0-rc.0.

select * from okta_user limit 3

with StreamLeafListItem

2023-06-13 14:37:52.519 UTC UserSet StreamListItem Complete
2023-06-13 14:37:52.526 UTC RowsRemaining: EXTRA_VALUE_AT_END=2
2023-06-13 14:37:52.526 UTC UserSet StreamListItem Complete
2023-06-13 14:37:52.526 UTC RowsRemaining: EXTRA_VALUE_AT_END=1
2023-06-13 14:37:52.526 UTC UserSet StreamListItem Complete
2023-06-13 14:37:52.526 UTC RowsRemaining: EXTRA_VALUE_AT_END=0

select * from okta_user limit 3

with StreamListItem

2023-06-13 14:40:32.516 UTC Provided limit - user: EXTRA_VALUE_AT_END=3
2023-06-13 14:40:33.756 UTC UserSet StreamListItem Complete
2023-06-13 14:40:33.767 UTC RowsRemaining: EXTRA_VALUE_AT_END=2
2023-06-13 14:40:33.767 UTC UserSet StreamListItem Complete
2023-06-13 14:40:33.767 UTC RowsRemaining: EXTRA_VALUE_AT_END=1
2023-06-13 14:40:33.767 UTC UserSet StreamListItem Complete
2023-06-13 14:40:33.767 UTC RowsRemaining: EXTRA_VALUE_AT_END=0

select * from okta_factor limit 3. (okta_factor is child table of okta_user)

with StreamListItem. (Here it should decrease)

2023-06-13 14:42:31.067 UTC Provided limit - user: EXTRA_VALUE_AT_END=3
2023-06-13 14:42:31.067 UTC UserSet StreamListItem Complete
2023-06-13 14:42:31.067 UTC RowsRemaining: EXTRA_VALUE_AT_END=3
2023-06-13 14:42:31.067 UTC UserSet StreamListItem Complete
2023-06-13 14:42:31.067 UTC RowsRemaining: EXTRA_VALUE_AT_END=3
2023-06-13 14:42:31.067 UTC UserSet StreamListItem Complete
2023-06-13 14:42:31.067 UTC RowsRemaining: EXTRA_VALUE_AT_END=3

select * from okta_factor limit 3. (okta_factor is child table of okta_user)

with StreamLeafListItem

2023-06-13 14:46:03.132 UTC Provided limit - user: EXTRA_VALUE_AT_END=3
2023-06-13 14:46:04.391 UTC UserSet StreamListItem Complete
2023-06-13 14:46:04.404 UTC RowsRemaining: EXTRA_VALUE_AT_END=2
2023-06-13 14:46:04.405 UTC UserSet StreamListItem Complete
2023-06-13 14:46:04.405 UTC RowsRemaining: EXTRA_VALUE_AT_END=1
2023-06-13 14:46:04.405 UTC UserSet StreamListItem Complete
2023-06-13 14:46:04.405 UTC RowsRemaining: EXTRA_VALUE_AT_END=0