Skip to content
This repository has been archived by the owner on Oct 18, 2023. It is now read-only.

streaming proxy #731

Open
wants to merge 17 commits into
base: main
Choose a base branch
from
Open

streaming proxy #731

wants to merge 17 commits into from

Conversation

MarinPostma
Copy link
Contributor

@MarinPostma MarinPostma commented Oct 4, 2023

This PR introduces the streaming proxy RPC service. This service deprecates the old version of the proxy services, and any client using the old service should use this one instead.

The advantages of the new service are:

  • The libsql connection on the primary side only lives as long as the stream is open. This solves the problem of clients disconnecting without closing connections and leaving connections open (no need for garbage collecting anymore)
  • we can now stream significant request responses from primary to replica without needing to allocate the whole response
  • Requests can be aborted in flight if a new request is sent to the proxy stream before the old one has finished executing, the previous one gets canceled, and the new one is processed instead.

@MarinPostma MarinPostma force-pushed the streaming-proxy branch 4 times, most recently from b289d66 to 1935787 Compare October 6, 2023 14:22
@MarinPostma MarinPostma marked this pull request as ready for review October 8, 2023 18:37
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant