Azure Blob Storage integration

[benbjohnson]

Azure Blob Store does not provide an S3-compatible API so in the short term support would need to be added via S3Proxy or via MinIO's azure gateway. Eventually, native integration with Azure Blob Storage should be added.

[simongottschlag]

Hi @benbjohnson!

I would be willing to give this a try if you want external help. I would most likely need some help but I think I would be able to do most of the work with review and recommendations from you.

Something you are interested in?

[benbjohnson]

Hi @simongottschlag!

I really do appreciate the offer but I'm not taking external contributions on Litestream right now. I'm doing some refactoring on the replica system right now so hopefully adding new replica types should be relatively easy after that. I'd love some feedback on it when it's done though.

[simongottschlag]

Hi @benbjohnson 😁

Sorry for missing that, fully understandable. 😊 I'll keep an eye on this issue and feel free to ping me if you want someone to test or feedback on Azure and their authentication.

I can recommend taking a look at this library, which is what Terraform is using for the remote state integration: https://github.com/tombuildsstuff/giovanni

[Xuanwo]

Hi, we are building an application-oriented unified storage layer for Golang called go-storage. With the help of go-storage, we can have native support for azblob, gcs (like #69), sftp (like #140, not supported for now but is on our roadmap) and more services as described in beyondstorage/go-storage#536.

Please take a look and leave comments to us, we will prioritize the needs that come from you!

[benbjohnson]

Hi @Xuanwo, thanks for sharing the library. I'm refactoring the replica clients right now and the resulting clients are pretty simple to implement. I prefer not to add an extra layer of abstraction if I don't need to although I can see how go-storage could be useful for a lot of folks.