Skip to content

Releases: logstash-plugins/logstash-output-google_cloud_storage

Move to the Java Google Cloud client library for increased performance and stability

18 Mar 23:02
e417c89
Compare
Choose a tag to compare

Notes

  • Move to the Java Google Cloud client library for increased performance and stability.
  • Breaking If you use the old PKCS12 authentication keys, you will need to upgrade to
    the new JSON keys. Application Default Credentials will continue to work.

Configuration Changes

New Options

  • json_key_file - The JSON IAM service account credentials to use with the plugin.

Deprecations

  • key_password - No longer used with json_key_file
  • service_account - No longer used with json_key_file

Obsoletions

  • key_path - Use json_key_file or Application Default Credentials (ADC) instead.
    See the documentation
    for help about moving to JSON key files.

Added the ability to set `gzip` as `Content-Encoding`

08 Jun 16:17
Compare
Choose a tag to compare

Added the ability to set gzip as Content-Encoding.
This saves storage size but still allows uncompressed downloads.

  • Fixes #13 - Use gzip for Content-Encoding instead of Content-Type

Added Locking and Invariant

05 Jun 20:10
4f893ad
Compare
Choose a tag to compare
  • Refactoring work to add locks to file rotation and writing.
    • Fixes #2 - Plugin crashes on file rotation.
    • Fixes #19 - Deleted files remain in use by the system eventually filling up disk space.

Job Pools

01 Jun 22:48
48f9d39
Compare
Choose a tag to compare
  • Change uploads to use a job pool for better performance
    • Fixes #22 - Refactor Job Queue Architecture
    • Fixes #5 - Major Performance Issues
  • Wait for files to upload before Logstash quits
    • Fixes #15 - Fails to upload files when Logstash exits

v3.1.0: Log UUID inclusion, fixes #23 (#26)

14 May 15:21
db32da1
Compare
Choose a tag to compare
Added the ability to include/exclude the hostname and a UUID in the filename. This will solve possible race conditions when running multiple instances of the plugin dumping into the same bucket, as well as allow a glob with a single pattern to match files (useful for uploading to BigQuery).

On a technical side the file name generation code has been broken out and is now thread-safe which takes us part of the way toward fixing #2.