Serving hundreds of thousands of WalletConnect sessions on nodejs?

[p0vidl0]

Working on a semi-custodial wallet system with the goal of supporting hundreds of thousands of WalletConnect sessions. We are using @walletconnect/sign-client on a Node.js backend to handle external dapps' connections and have encountered some issues. We had to implement IKeyValueStorage to persist data between restarts. The current architecture for working with IKeyValueStorage involves saving and reading all module data (session, subscription, history, messages) in bulk. This leads to large amounts of data being transferred with each change and can cause data integrity issues during concurrent writes. Horizontal scaling of the backend service also requires a change in the approach to storage management.

The question is, are there best practices and more suitable libraries for this task in Node.js?