Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update module github.com/dgraph-io/badger to v4 #16

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Feb 28, 2023

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
github.com/dgraph-io/badger v1.6.2 -> v4.3.1 age adoption passing confidence

Release Notes

dgraph-io/badger (github.com/dgraph-io/badger)

v4.3.1: Badger v4.3.1

Compare Source

What's Changed

Full Changelog: dgraph-io/badger@v4.3.0...v4.3.1

v4.3.0: Badger v4.3.0

Compare Source

What's Changed

Fixes:

CI:

Full Changelog: dgraph-io/badger@v4.2.0...v4.3.0

v4.2.0: Badger v4.2.0

Compare Source

This release contains new and updated metrics for Badger, as well as several bug fixes.

Breaking
  • feat(metrics): fix and update metrics in badger (#​1948)
  • fix(metrics): remove badger version in the metrics name (#​1982)
Fixed
  • fix(db): avoid panic in parallel reads after closing DB (#​1987)
  • fix(logging): fix direct access to logger (#​1980)
  • fix(sec): bump google.golang.org/grpc from 1.20.1 to 1.53.0 (#​1977)
  • fix(sec): update gopkg.in/yaml.v2 package (#​1969)
  • fix(test): fix flakiness of TestPersistLFDiscardStats (#​1963)
  • fix(stream): setup oracle correctly in stream writer (#​1968) (#​1904)
  • fix(stream): improve incremental stream writer (#​1901)
  • fix(test): improve the params in BenchmarkDbGrowth (#​1967)
  • fix(sync): sync active memtable and value log on Db.Sync (#​1847) (#​1953)
  • fix(test): handle draining of closed channel, speed up test. (#​1957)
  • fix(test): fix table checksum test. Test on uncompressed. (#​1952)
  • fix(level): change split key range right key to use ts=0 (#​1932)
  • fix(test): the new test case PagebufferReader5 introduced an error. (#​1936)
  • fix(test): add missing unlock in TestPersistLFDiscardStats (#​1924)
  • fix(PageBufferReader): should conform to io.Reader interface (#​1935)
  • fix(publisher): publish updates after persistence in WAL (#​1917)
CI
  • chore(ci): split off coverage workflow (#​1944)
  • chore(ci): adding trivy scanning workflow (#​1925)

v4.1.0: Badger v4.1.0

Compare Source

This release adds support for incremental stream writer. We also do some cleanup in the docs and resolve some CI issues for community PR's. We resolve high and medium CVE's and fix #​1833.

Features
Fixes
Security
  • chore(deps): bump golang.org/x/net from 0.0.0-20201021035429-f5854403a974 to 0.7.0 (#​1885)
CVE's
Chores
  • fix(docs): update README (#​1915)
  • cleanup sstable file after tests (#​1912)
  • chore(ci): add dgraph regression tests (#​1908)
  • docs: fix the default value in docs (#​1909)
  • chore: update URL for unsupported manifest version error (#​1905)
  • docs(README): add raft-badger to projects using badger (#​1902)
  • sync the docs with README with projects using badger (#​1903)
  • fix: update code comments for WithNumCompactors (#​1900)
  • docs: add loggie to projects using badger (#​1882)
  • chore(memtable): refactor code for memtable flush (#​1866)
  • resolve coveralls issue for community PR's (#​1892, #​1894, #​1896)

Full Changelog: dgraph-io/badger@v4.0.1...v4.1.0

v4.0.1: Badger DB v4.0.1

Compare Source

This release fixes a bug in the maxHeaderSize parameter that could lead to panics. We introduce an external magic number to keep track of external dependencies. We bump up the minimum required Go version to 1.19. No changes were made to the format of data on disk. This is a major release because we are making a switch to SemVer in order to make it easier for the community to understand when breaking API and data format changes are made.

Warning
The tag v4.0.0 has been retracted due to a bug in publisher.
Use v4.0.1 (see #​1889)

Fixed
  • fix(pb): fix generated protos #​1888
  • fix(publisher): initialize the atomic variable #​1889
  • fix: update maxHeaderSize #​1877
  • feat(externalMagic): Introduce external magic number (#​1745) #​1852
  • fix(bench): bring in benchmark fixes from main #​1863
Chores
  • upgrade go to 1.19 #​1868
  • moving from CalVer to SemVer
  • chore(cd): tag based deployments #​1887
  • chore(ci): fail fast when testing #​1890
  • enable linters (gosimple, govet, lll, unused, staticcheck, errcheck, ineffassign, gofmt) #​1871 #​1870 #​1876
  • remove dependency on io/ioutil #​1879
  • various doc and comment fixes #​1857

Full Changelog: dgraph-io/badger@v3.2103.5...v4.0.1

v4.0.0

Compare Source

v3.2103.5: Badger DB v3.2103.5

Compare Source

We release Badger CLI tool binaries for amd64 and now arm64. This release does not involve any core code changes to Badger. We added a CD job for building Badger for arm64.

v3.2103.4: Badger DB v3.2103.4

Compare Source

This patches an issue that could lead to manifest corruption. Fix was merged in #​1756. Addresses this issue on Discuss and this issue on Badger. We also bring the release branch to parity with main by updating the CI/CD jobs, Readme, Codeowners, PR and issue templates, etc.

Fixed
  • fix(manifest): fix manifest corruption due to race condition in concurrent compactions (#​1756)
Chores
  • Add CI/CD jobs to release branch
  • Add PR and Issue templates to release branch
  • Update Codeowners in release branch
  • Update Readme in release branch

Full Changelog: dgraph-io/badger@v3.2103.3...v3.2103.4

v3.2103.3: BadgerDB v3.2103.3

Compare Source

This is a minor patch release that fixes arm64 related issues. The issues in the z package in Ristretto were resolved in Ristretto v0.1.1.

Fixed
  • fix(arm64): bump ristretto v0.1.0 --> v0.1.1 (#​1806)

Full Changelog: dgraph-io/badger@v3.2103.2...v3.2103.3

v3.2103.2: BadgerDB v3.2103.2

Compare Source

This patch release contains:

Fixed
  • fix(compact): close vlog after the compaction at L0 has been completed (#​1752)
  • fix(builder): put the upper limit on reallocation (#​1748)
  • deps: Bump github.com/google/flatbuffers to v1.12.1 (#​1746)
  • fix(levels): Avoid a deadlock when acquiring read locks in levels (#​1744)
  • fix(pubsub): avoid deadlock in publisher and subscriber (#​1749) (#​1751)

Full Changelog: dgraph-io/badger@v3.2103.1...v3.2103.2

v3.2103.1: BadgerDB v3.2103.1

Compare Source

This release removes CGO dependency opf badger by using Klauspost's ZSTD instead of Datadog's ZSTD. Also, this has some of the fixes.

Fixed
  • fix(compaction): copy over the file ID when building tables #​1713
  • fix: Fix conflict detection for managed DB (#​1716)
  • fix(pendingWrites): don't skip the pending entries with version=0 (#​1721)
Features
  • feat(zstd): replace datadog's zstd with Klauspost's zstd (#​1709)

v3.2103.0: BadgerDB v3.2103.0

Compare Source

Breaking
  • Subscribe: Add option to subscribe with holes in prefixes. (#​1658)
Fixed
  • fix(compaction): Remove compaction backoff mechanism (#​1686)
  • Add a name to mutexes to make them unexported (#​1678)
  • fix(merge-operator): don't read the deleted keys (#​1675)
  • fix(discard): close the discard stats file on db close (#​1672)
  • fix(iterator): fix iterator when data does not exist in read only mode (#​1670)
  • fix(badger): Do not reuse variable across badger commands (#​1624)
  • fix(dropPrefix): check properly if the key is present in a table (#​1623)
Performance
  • Opt(Stream): Optimize how we deduce key ranges for iteration (#​1687)
  • Increase value threshold from 1 KB to 1 MB (#​1664)
  • opt(DropPrefix): check if there exist some data to drop before dropping prefixes (#​1621)
Features
  • feat(options): allow special handling and checking when creating options from superflag (#​1688)
  • overwrite default Options from SuperFlag string (#​1663)
  • Support SinceTs in iterators (#​1653)
  • feat(info): Add a flag to parse and print DISCARD file (#​1662)
  • feat(vlog): making vlog threshold dynamic 6ce3b7c (#​1635)
  • feat(options): add NumGoroutines option for default Stream.numGo (#​1656)
  • feat(Trie): Working prefix match with holes (#​1654)
  • feat: add functionality to ban a prefix (#​1638)
  • feat(compaction): Support Lmax to Lmax compaction (#​1615)
New APIs
  • Badger.DB
    • BanNamespace
    • BannedNamespaces
    • Ranges
  • Badger.Options
    • FromSuperFlag
    • WithNumGoRoutines
    • WithNamespaceOffset
    • WithVLogPercentile
  • Badger.Trie
    • AddMatch
    • DeleteMatch
  • Badger.Table
    • StaleDataSize
  • Badger.Table.Builder
    • AddStaleKey
  • Badger.InitDiscardStats
Removed APIs
  • Badger.DB
    • KeySplits
  • Badger.Options
    • SkipVlog
Changed APIs
  • Badger.DB
    • Subscribe
  • Badger.Options
    • WithValueThreshold

v3.2011.1: BadgerDB v3.2011.1

Compare Source

fix(compaction): Set base level correctly after stream (#​1631) (#​1651)
fix: update ristretto and use filepath (#​1649) (#​1652)
fix(badger): Do not reuse variable across badger commands (#​1624) (#​1650)
fix(build): fix 32-bit build (#​1627) (#​1646)
fix(table): always sync SST to disk (#​1625) (#​1645)

v3.2011.0: BadgerDB v3.2011.0

Compare Source

This release is not backward compatible with Badger v2.x.x

Breaking:
  • opt(compactions): Improve compaction performance (#​1574)
  • Change how Badger handles WAL (#​1555)
  • feat(index): Use flatbuffers instead of protobuf (#​1546)
Fixed:
  • Fix(GC): Set bits correctly for moved keys (#​1619)
  • Fix(tableBuilding): reduce scope of valuePointer (#​1617)
  • Fix(compaction): fix table size estimation on compaction (#​1613)
  • Fix(OOM): Reuse pb.KVs in Stream (#​1609)
  • Fix race condition in L0StallMs variable (#​1605)
  • Fix(stream): Stop produceKVs on error (#​1604)
  • Fix(skiplist): Remove z.Buffer from skiplist (#​1600)
  • Fix(readonly): fix the file opening mode (#​1592)
  • Fix: Disable CompactL0OnClose by default (#​1586)
  • Fix(compaction): Don't drop data when split overlaps with top tables (#​1587)
  • Fix(subcompaction): Close builder before throttle.Done (#​1582)
  • Fix(table): Add onDisk size (#​1569)
  • Fix(Stream): Only send done markers if told to do so
  • Fix(value log GC): Fix a bug which caused value log files to not be GCed.
  • Fix segmentation fault when cache sizes are small. (#​1552)
  • Fix(builder): Too many small tables when compression is enabled (#​1549)
  • Fix integer overflow error when building for 386 (#​1541)
  • Fix(writeBatch): Avoid deadlock in commit callback (#​1529)
  • Fix(db): Handle nil logger (#​1534)
  • Fix(maxVersion): Use choosekey instead of KeyToList (#​1532)
  • Fix(Backup/Restore): Keep all versions (#​1462)
  • Fix(build): Fix nocgo builds. (#​1493)
  • Fix(cleanup): Avoid truncating in value.Open on error (#​1465)
  • Fix(compaction): Don't use cache for table compaction (#​1467)
  • Fix(compaction): Use separate compactors for L0, L1 (#​1466)
  • Fix(options): Do not implicitly enable cache (#​1458)
  • Fix(cleanup): Do not close cache before compaction (#​1464)
  • Fix(replay): Update head for LSM entires also (#​1456)
  • fix(levels): Cleanup builder resources on building an empty table (#​1414)
Performance
  • perf(GC): Remove move keys (#​1539)
  • Keep the cheaper parts of the index within table struct. (#​1608)
  • Opt(stream): Use z.Buffer to stream data (#​1606)
  • opt(builder): Use z.Allocator for building tables (#​1576)
  • opt(memory): Use z.Calloc for allocating KVList (#​1563)
  • opt: Small memory usage optimizations (#​1562)
  • KeySplits checks tables and memtables when number of splits is small. (#​1544)
  • perf: Reduce memory usage by better struct packing (#​1528)
  • perf(tableIterator): Don't do next on NewIterator (#​1512)
  • Improvements: Manual Memory allocation via Calloc (#​1459)
  • Various bug fixes: Break up list and run DropAll func (#​1439)
  • Add a limit to the size of the batches sent over a stream. (#​1412)
  • Commit does not panic after Finish, instead returns an error (#​1396)
  • levels: Compaction incorrectly drops some delete markers (#​1422)
  • Remove vlog file if bootstrap, syncDir or mmap fails (#​1434)
Features:
  • Use opencensus for tracing (#​1566)
  • Export functions from Key Registry (#​1561)
  • Allow sizes of block and index caches to be updated. (#​1551)
  • Add metric for number of tables being compacted (#​1554)
  • feat(info): Show index and bloom filter size (#​1543)
  • feat(db): Add db.MaxVersion API (#​1526)
  • Expose DB options in Badger. (#​1521)
  • Feature: Add a Calloc based Buffer (#​1471)
  • Add command to stream contents of DB into another DB. (#​1463)
  • Expose NumAlloc metrics via expvar (#​1470)
  • Support fully disabling the bloom filter (#​1319)
  • Add --enc-key flag in badger info tool (#​1441)
New APIs
Removed APIs

v2.2007.4: BadgerDB v2.2007.4

Compare Source

Fixed
Features
  • feat(zstd): backport replacement of DataDog's zstd with Klauspost's zstd (#​1736)

v2.2007.3: BadgerDB v2.2007.3

Compare Source

This patch release contains:

Fixed
  • fix(maxVersion): Use choosekey instead of KeyToList (#​1532) #​1533
  • fix(flatten): Add --num_versions flag (#​1518) #​1520
  • fix(build): Fix integer overflow on 32-bit architectures #​1558
  • fix(pb): avoid protobuf warning due to common filename (#​1519)
Features
  • Add command to stream contents of DB into another DB. (#​1486)
New APIs
  • DB.StreamDB
  • DB.MaxVersion

v2.2007.2: BadgerDB v2.2007.2

Compare Source

Fixed
  • Compaction: Use separate compactors for L0, L1 (#​1466)
  • Rework Block and Index cache (#​1473)
  • Add IsClosed method (#​1478)
  • Cleanup: Avoid truncating in vlog.Open on error (#​1465)
  • Cleanup: Do not close cache before compactions (#​1464)
New APIs
Removed APIs [Breaking Changes]

v2.2007.1: BadgerDB v2.2007.1

Compare Source

Fixed
  • Remove vlog file if bootstrap, syncDir or mmap fails (#​1434)
  • levels: Compaction incorrectly drops some delete markers (#​1422)
  • Replay: Update head for LSM entires also (#​1456)

v2.2007.0: BadgerDB v2.2007.0

Compare Source

Fixed
  • Add a limit to the size of the batches sent over a stream. (#​1412)
  • Fix Sequence generates duplicate values (#​1281)
  • Fix race condition in DoesNotHave (#​1287)
  • Fail fast if cgo is disabled and compression is ZSTD (#​1284)
  • Proto: make badger/v2 compatible with v1 (#​1293)
  • Proto: Rename dgraph.badger.v2.pb to badgerpb2 (#​1314)
  • Handle duplicates in ManagedWriteBatch (#​1315)
  • Ensure bitValuePointer flag is cleared for LSM entry values written to LSM (#​1313)
  • DropPrefix: Return error on blocked writes (#​1329)
  • Confirm badgerMove entry required before rewrite (#​1302)
  • Drop move keys when its key prefix is dropped (#​1331)
  • Iterator: Always add key to txn.reads (#​1328)
  • Restore: Account for value size as well (#​1358)
  • Compaction: Expired keys and delete markers are never purged (#​1354)
  • GC: Consider size of value while rewriting (#​1357)
  • Force KeepL0InMemory to be true when InMemory is true (#​1375)
  • Rework DB.DropPrefix (#​1381)
  • Update head while replaying value log (#​1372)
  • Avoid panic on multiple closer.Signal calls (#​1401)
  • Return error if the vlog writes exceeds more than 4GB (#​1400)
Performance
  • Clean up transaction oracle as we go (#​1275)
  • Use cache for storing block offsets (#​1336)
Features
  • Support disabling conflict detection (#​1344)
  • Add leveled logging (#​1249)
  • Support entry version in Write batch (#​1310)
  • Add Write method to batch write (#​1321)
  • Support multiple iterators in read-write transactions (#​1286)
New APIs
Changes to Default Options
  • DefaultOptions: Set KeepL0InMemory to false (#​1345)
  • Increase default valueThreshold from 32B to 1KB (#​1346)
Deprecated
  • Badger.Option
Reverts

This section lists the changes which were reverted because of non-reproducible crashes.

  • Compress/Encrypt Blocks in the background (#​1227)

v2.0.3: BadgerDB v2.0.3

Compare Source

Fixed
  • Add support for watching nil prefix in subscribe API (#​1246)
Performance
  • Compress/Encrypt Blocks in the background (#​1227)
  • Disable cache by default (#​1257)
Features
  • Add BypassDirLock option (#​1243)
  • Add separate cache for bloomfilters (#​1260)
New APIs

v2.0.2: BadgerDB v2.0.2

Compare Source

Fixed
  • Cast sz to uint32 to fix compilation on 32 bit. (#​1175)
  • Fix checkOverlap in compaction. (#​1166)
  • Avoid sync in inmemory mode. (#​1190)
  • Support disabling the cache completely. (#​1185)
  • Add support for caching bloomfilters. (#​1204)
  • Fix int overflow for 32bit. (#​1216)
  • Remove the 'this entry should've caught' log from value.go. (#​1170)
  • Rework concurrency semantics of valueLog.maxFid. (#​1187)
Performance
  • Use fastRand instead of locked-rand in skiplist. (#​1173)
  • Improve write stalling on level 0 and 1. (#​1186)
  • Disable compression and set ZSTD Compression Level to 1. (#​1191)

v2.0.1: BadgerDB v2.0.1

Compare Source

New APIs
  • badger.Options
  • Badger.TableInfo
Features
  • Introduce in-memory mode in badger. (#​1113)
Fixed
  • Limit manifest's change set size. (#​1119)
  • Cast idx to uint32 to fix compilation on i386. (#​1118)
  • Fix request increment ref bug. (#​1121)
  • Fix windows dataloss issue. (#​1134)
  • Fix VerifyValueChecksum checks. (#​1138)
  • Fix encryption in stream writer. (#​1146)
  • Fix segmentation fault in vlog.Read. (header.Decode) (#​1150)
  • Fix merge iterator duplicates issue. (#​1157)
Performance
  • Set level 15 as default compression level in Zstd. (#​1111)
  • Optimize createTable in stream_writer.go. (#​1132)

v2.0.0: BadgerDB v2.0.0

Compare Source

New features

The main new features are:

Others

There are various bug fixes, optimizations, and new options. See the CHANGELOG for details.


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 69154d0 to 757b3af Compare February 28, 2023 23:51
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 757b3af to ede2d49 Compare April 4, 2023 20:10
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from ede2d49 to 318f387 Compare April 17, 2023 14:09
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 318f387 to bb38b9b Compare April 30, 2023 08:37
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from bb38b9b to 989a7c2 Compare August 4, 2023 13:36
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 989a7c2 to 6535d78 Compare August 22, 2023 17:49
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 6535d78 to fd5c321 Compare September 19, 2023 13:32
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch 4 times, most recently from f2f3bc4 to febb397 Compare October 20, 2023 18:07
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch 2 times, most recently from 594fb27 to 0eb678b Compare October 30, 2023 10:21
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 0eb678b to 7bf316a Compare November 16, 2023 11:48
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch 2 times, most recently from b7cb2ef to de84b40 Compare November 28, 2023 16:19
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from de84b40 to a0e1d04 Compare January 28, 2024 11:37
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from a0e1d04 to dad5cb2 Compare February 25, 2024 10:28
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from dad5cb2 to 8f4c6ce Compare March 18, 2024 17:07
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 8f4c6ce to 0f07df4 Compare March 25, 2024 17:48
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 0f07df4 to 059527d Compare April 14, 2024 10:59
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch 2 times, most recently from c0ef6d0 to 6d3fcf7 Compare May 6, 2024 21:00
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 6d3fcf7 to 95c886f Compare May 31, 2024 19:14
Copy link
Contributor Author

renovate bot commented Jun 4, 2024

ℹ Artifact update notice

File name: go.mod

In order to perform the update(s) described in the table above, Renovate ran the go get command, which resulted in the following additional change(s):

  • 9 additional dependencies were updated

Details:

Package Change
golang.org/x/crypto v0.26.0 -> v0.27.0
github.com/dgraph-io/ristretto v0.0.2 -> v1.0.0
github.com/dustin/go-humanize v1.0.0 -> v1.0.1
github.com/golang/protobuf v1.5.0 -> v1.5.4
golang.org/x/net v0.25.0 -> v0.29.0
golang.org/x/sys v0.23.0 -> v0.25.0
golang.org/x/text v0.17.0 -> v0.18.0
google.golang.org/genproto v0.0.0-20200815001618-f69a88009b70 -> v0.0.0-20230410155749-daa745c078e1
google.golang.org/grpc v1.35.0 -> v1.56.3

@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 95c886f to 1d706f4 Compare June 4, 2024 18:55
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 1d706f4 to 5ba33b5 Compare August 12, 2024 06:56
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from 5ba33b5 to d703fe1 Compare August 28, 2024 17:01
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-4.x branch from d703fe1 to 24173d8 Compare October 6, 2024 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants