Fix ack failure on message listener in multi topics consumer #447
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #446
Motivation
We found an ack failure issue: #446
MessageListeners can start to process messages before subscribing all child topics are completed in "multi topics" (e.g. partitioned, list, regex) cases.
If
acknowledge()
is called in messageListeners (it is very typical usage) before subscribing completion, it will fail withAlreadyClosed
error since the state of the parent consumer is notReady
yet:pulsar-client-cpp/lib/MultiTopicsConsumerImpl.cc
Lines 643 to 648 in 8b2753a
That results in ack holes, and finally full backlog.
Modifications
MultiTopicsConsumerImpl
: Pause messageListeners at first by settingstartPaused
to true and resume them after subscribing all child topics are completed.ConsumerImpl
: Delete unused code.sendFlowPermitsToBroker()
at the first connection.firstTime
looks always false atpulsar-client-cpp/lib/ConsumerImpl.cc
Line 316 in 8b2753a
pulsar-client-cpp/lib/ConsumerImpl.cc
Lines 297 to 299 in 8b2753a
ConsumerImpl
instances, whereas it has no chance of returning to true once it becomes false.Verifying this change
Specific tests for this issue is difficult to implement because it does not occur every time.
Documentation
doc-required
(Your PR needs to update docs and you will update later)
doc-not-needed
(Please explain why)
doc
(Your PR contains doc changes)
doc-complete
(Docs have been already added)