Skip to content
This repository has been archived by the owner on Aug 23, 2023. It is now read-only.

Query nodes, find cache and various performance tweaks

Compare
Choose a tag to compare
@Dieterbe Dieterbe released this 14 May 14:24
· 2161 commits to master since this release
cec144f

Important changes that require your attention:

  • This release includes the "query layer" functionality.
    Versions prior to v0.11.0-184-g293b55b9 cannot handle query nodes joining the cluster and will crash.
    To deploy the new query nodes and introduce them into the cluster, you must first
    upgrade all other nodes to this version (or later)
    Also, regarding cluster.mode:

    • 'single' is now 'dev'
    • 'multi' is now 'shard'
      (The old values are still allowed for the time being)
      see #1243, #1292, #1295
  • since v0.11.0-169-g59ebb227, kafka-version now defaults to 2.0.0 instead of 0.10.0.0. Make sure to set
    this to a proper version if your brokers are not at least at version 2.0.0.
    See #1221

  • since v0.11.0-233-gcf24c43a, if queries need rollup data, but asked for a consolidateBy() without matching rollup aggregation
    we pick the most approriate rollup from what is available.

  • since v0.11.0-252-ga1e41192, remove log-min-dur flag, it was no longer used. #1275

  • Since v0.11.0-285-g4c862d8c, duplicate points are now always rejected, even with the reorder buffer enabled.
    Note from the future: this was undone in v0.13.0-188-g6cd12d6, see future notes about reorderBufferAllowUpdate

index

  • cassandra index: load partitions in parallel. #1270
  • Add partitioned index (experimental and not recommended) #1232
  • add the mt-index-prune utility #1231, #1235
  • fix index corruption: make sure defBy{Id,TagSet} use same pointers #1303

api

  • Improve performance of SetTags #1158
  • speed up cross series aggregators by being more cache friendly #1164
  • Fix summarize crash #1170
  • groupByTags Performance improvements + fix setting consolidator per group + fix alias functions name tag setting #1165
  • Meta tags part 1: meta record data structures and corresponding CRUD api calls (experimental) #1301
  • Add absolute function #1300
  • Add find cache to speed up render requests #1233, #1236, #1263, #1265, #1266, #1285
  • Added 8 functions related to filterSeries #1308
  • Added cumulative function #1309

docs

  • document startup procedure #1186
  • Better document priority ready state #1223

monitoring

  • fix render latency queries + remove old dashboards #1192
  • Dashboard: mem.to_iter fix and use UTC #1219
  • refactor ingestion related metrics, in particular wrt drops. add prometheus stats. #1278, #1288
  • fix decrement tank.total_points upon GC. fix #1239

Misc

  • Dynamic GOGC based on ready state #1194
  • improve kafka-mdm stats/priority tracking #1200
  • tweak cluster priority calculation to be resilient against GC pauses #1022, #1218
  • update messagepack to v1.1 #1214
  • mt-index-cat should use NameWithTags() when listing series #1267
  • improvement for reorder buffer. #1211
  • debug builds and images. #1187