Skip to content
This repository has been archived by the owner on Oct 18, 2023. It is now read-only.

Multi tenancy #503

Draft
wants to merge 84 commits into
base: main
Choose a base branch
from
Draft

Multi tenancy #503

wants to merge 84 commits into from

Conversation

MarinPostma
Copy link
Contributor

@MarinPostma MarinPostma commented Jul 6, 2023 •
edited
Loading

-> Placeholder naming

To-Do

  • error handling
  • log compaction
  • merge snapshots
  • unit tests
  • simulations
  • record replicated frame index
  • allocation API response
  • collect database stats
  • back port upstream fixes
  • idle shutdown
  • benchmarks
  • transaction timeouts
  • usage limiters
  • limit memory usage
  • compaction hooks
  • Use LMDB for metadata storage
  • use chichat for cluster membership? https://github.com/quickwit-oss/chitchat
  • replicate from snapshots
  • hrana over websocket
  • handle describe
  • handle replication handshake

Linked PR:

MarinPostma added 30 commits July 6, 2023 15:02
@MarinPostma
introduce libsqlx crate
825939c
@MarinPostma
Merge pull request #485 from libsql/libsqlx
ce02662 
standalone sqld lib
@MarinPostma
setup logging
e25ea8f
@MarinPostma
admin server boilerplate
e301b80
@MarinPostma
introduce allocation type to manages a single database
92c1836
@MarinPostma
sketch meta store
110c5fa
@MarinPostma
changes to libsqlx
09f7f09
@MarinPostma
bare bone allocation manager/store
19c8f4f
@MarinPostma
user API & database extractor
52c566c
@MarinPostma
port hrana for libsqlx server
c2fed59 
we can now allocate primaries, and query them
@MarinPostma
Merge pull request #511 from libsql/libsqlx-server
1c59c65 
libsqlx server
@MarinPostma
LINC protocol spec
6cefe75
@MarinPostma
implement LINC protocol
da0f743
@MarinPostma
Merge pull request #478 from libsql/sinc-proto
b40d8b9 
WIP: SINC proto
@MarinPostma
base configuration
4dad85e
@MarinPostma
load config
5433c75
@MarinPostma
add config defaults
23ca93f
@MarinPostma
peer config
4cab1b0
@MarinPostma
Merge pull request #520 from libsql/config
1d5aa26 
Multi-tenancy config boilerplate
@MarinPostma
peer config
c40482d
@MarinPostma
changes to proto
198ed75
@MarinPostma
deliver message to allocations
58b3aaf
@MarinPostma
replica: send replication request to primary
20dc440
@MarinPostma
replica sends replicate request to primary
1989ae8
@MarinPostma
primary replicate to replica
cc9c2c1
@MarinPostma
Merge pull request #525 from libsql/basic-replication
0ba8ba1 
basic replication
@MarinPostma
fully async result builder
d1e9845
@MarinPostma
Merge pull request #532 from libsql/full-async-builder
b23ec73 
Async ResultBuilder
@MarinPostma
proxy writes
95a2858
@MarinPostma
Merge pull request #535 from libsql/proxy-writes
26f781d 
proxy writes
MarinPostma added 30 commits July 26, 2023 14:54
@MarinPostma
add missing Poll::Ready for Database::Poll
c987f5c
@MarinPostma
fix periodic compaction
6337d9c
@MarinPostma
spawn compactor loop
c05dc09
@MarinPostma
changes to compactor trait
f86954c
@MarinPostma
Merge pull request #553 from libsql/mt-log-compactor
abace0d 
mt log compactor
@MarinPostma
intoduce SnapshotFrame
c815ea8
@MarinPostma
add missing test assets
e10d2f3
@MarinPostma
replicate from snapshot
03187a4
@MarinPostma
Merge pull request #554 from libsql/mt-read-from-snapshot
a528e9e 
multi-tenancy: replicate from snapshots
@MarinPostma
add txn status change callback to libsql connection
4594545
@MarinPostma
add method to register txn status cahnge callback
d0fb111
@MarinPostma
set on txn status change callback for allocation connection
c8f095f
@MarinPostma
connection monitor txn timeout
734f7cc
@MarinPostma
notify on transaction status change
dbe2520
@MarinPostma
move timeout_notifier to own module
96e52d4
@MarinPostma
test txn timeout
14b098f
@MarinPostma
Merge pull request #557 from libsql/mt-txn-timeout
0d8d86c 
multi-tenancy: transaction timeouts
@MarinPostma
replace commit handler with commit callback
9cd8c1a
@MarinPostma
record replica commit index
7031828
@MarinPostma
fix replication bootstrap bug
e6aaeb4
@MarinPostma
Merge pull request #561 from libsql/mt-store-replica-applied-frameno
855a0e8 
mt store replica applied frameno
@MarinPostma
add missing block_in_place
5955679
@MarinPostma
Merge pull request #562 from libsql/mt-fix-replication-not-starting
8c4e2d5 
mt: Fix missing block_in_place
@MarinPostma
handle allocation errors
75f77a0
@MarinPostma
wip
0d6005c
@MarinPostma
shared hrana server
88433f9
@MarinPostma
improve error handling
f1e5fad
@MarinPostma
Merge pull request #569 from libsql/mt-error-handling
7c93d7e 
mt error handling
@MarinPostma
allocation response payload
137051c
@MarinPostma
Merge pull request #570 from libsql/alloc-response-message
1f8de3f 
alloc response message
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@MarinPostma