Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
source-zendesk-support: checkpoint
TicketMetricEvents
state after e…
…very 1000 documents Previously, `TicketMetricEvents` was only emitting documents and checkpointing state after reading all available documents from Zendesk Support. `TicketMetricEvents` can take multiple hours to backfill, and any task restarts during the backfill caused `TicketMetricEvents` to start over completely instead of picking back up where it left off before the restart. Setting `state_checkpoint_interval` tells `TickeMetricEvents` to checkpoint state & emit documents after every 1000 documents and allows the stream to pick up where it left off if it's interrupted during a backfill.
- Loading branch information