POC: Early Exit 1 - app.run(number, timeout)

[gwaramadze]

Introduces an ability to collect a small batch of data and inspect interactively in a Python interpreter or a tool like Jupyter Notebook.

1. Adds ExitManager, an internal class that facilitates stopping the Application once a certain number of messages has been processed or a timeout in seconds is reached.
2. Adds LocalSink, an in-memory container to store a batch of messages. After an application is stopped, data stored in the sink may be interactively used as a list or Pandas/Polars dataframe.

How to use?

from uuid import uuid4

from quixstreams import Application
from quixstreams.sinks.core.local import LocalSink

app = Application(broker_address="localhost:19092")

topic = app.topic("some-topic")
sink = LocalSink()  # or LocalSink(metadata=True)
sdf = app.dataframe(topic=topic).sink(sink)

app.run(number=10, timeout=3)

# app runs and stops

sink.list
sink.pandas
sink.polars

Results without metadata:

Results with metadata: