v2.1.3 (Apr 09 2020)

YSQL Changes

• [YSQL] Parallel queries across tablets for SELECT COUNT|MIN|MAX|SUM (*|col_id) FROM. #3624
• [YSQL] Fixed bug when processing PgsqlConditionPB::operands::column_id. #3837
• [YSQL] IndexScan returns all rows when there is no match. #3896
• [YSQL] Partial support for operator families, ALTER OPERATOR and ALTER EXTENSION. #2711
• [YSQL] Handle transaction conflict status in case of parallel read operations. #3991
• [YSQL][YCQL] Wrong results when using DocDB reverse scans with paging #4004
• [YSQL] Flush buffered operations before calculating query time. #3696

YCQL

• [YCQL] Send proper error when we query system.peers_v2 table. #3862

System improvements

• Implement paging for index backfill. #3879
• Rename indices to indexs in the context of index-backfill. #3901
• Cleaner error reporting from process main. #3876
• Fix determining the oldest SST file for intent cleanup. #3917
• Fix the TS UI transactions link. #3922
• Fix transaction status resolution with old peer version. #3916
• Add nodiscard attribute to Status class. #3918
• [docdb] Deregister callback for common mem trackers from root mem tracker in destructor of vector. #3750
• First phase of transaction aware snapshot. #1032
• [cdc] Fix data races in CDC Poller. #3771
• [YSQL] Fix for PgGate shutdown race on shutdown_done flag. #3779
• Initial multi node yugabyted version. 2057
• Enable checksum verification for meta blocks of encrypted files. #3974
• Batch copy table operations that happen during create database. #3743
• yb-admin: flush_table_by_id, compact_table_by_id #3814
• [docdb][ysql] Reuse iterators during txn conflict resolution. #3521
• Persist backfilling timestamp across master failures. #3611
• Relax requirement on number of log segments in QLTransactionTest.PreserveLogs. #3989
• Fix encryption format for newly created files. #3976
• Move remote bootstrap call to OpenTablet to the threadpool. #3012
• Support the ability to fetch the oldest timestamp record that is more recent than a specified time. #4019
• A flag for veryfing meta block checksums. #4023
• Stop cleaning intents SST files if previous file was not actually deleted. #3917
• Fix MakeFuture utility. #3781
• Restore transaction aware snapshot. #1032
• Fix demo destroy behavior with Python 2.7.5. #3993
• Adding health check for the Tserver. #3540
• Don't block remote bootstrap service during session init. #4035
• YBClient sbould wait for all sync operation to complete upon shutdown. #3989
• Inherited permissions shouldn't replace granted permissions in the client's cache. #4062
• Fix race condition on ParseTree::stale_. #3083
• Handle RPC register failure in TransactionStatusResolver. #4064
• Handle tablet not running in /transactions page. #4071
• Propagate history cutoff from leader. #1032
• Allow yb-admin to work with any non-leader master. #4000
• Transaction aware snapshot persistence. #1032
• Optimize returning results from tserver to postgres. #3926
• Allow tracing recent operations in MvccManager. #4108
• Persist ALTER ROLE changes to disk. #4105
• colocation: cache db colocated in postgres #4101

Platform

• Fix edit flow to show encryption at rest flags properly. #3910
• Add support for disabling readonly users. #3794
• Add API to get client certificate. #3984
• Create GCP provider with shared VPC and allow specifying subnets per region. #3383
• Update AWS price info && stop auto-running update script.
• Remove devops subnetId requirement when specifying a VPC when creating GCP provider.
• Add node ip to all created universes
• Omit master servers from being counted toward total node/pod count. #4009
• Update master selection logic. #3999
• Prevent data move if there is no data to move. #4046
• UI to set region-subnet mapping when creating GCP provider for existing VPCs. #3381

Note

Prior to 2.0, YSQL was still in beta. As a result, 2.0 release includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0+. Export from old cluster and import into a new 2.0+ cluster is needed for using existing data.

v2.1.2 (Mar 10, 2020)

YSQL Changes

• [YSQL] Framework for expression pushdown. #3297
• [YSQL] Optimize relcache preloading by reducing the number of master RPCs. #3049
• [YSQL][Diesel ORM] Fix crash for nested SELECT with set-returning function and LIMIT. #3811
• [YSQL] Fix error when ybctid value matches the partition boundary. #3833
• [YSQL][Hasura] Fix 'Missing base table ybctid' error for UPDATE with RETURNING clause. #3805
• [YSQL] Update on table with multiple FK tables crashes postgres. #3583

System improvements

• [cdc] Fix DeleteTableWithCDCStream
• Ensure only Tablet leaders can confirm alter table. #2236
• Make OpenSSL usage thread-safe. #3454
• Revert removed timeout from RequestConsensusVote. #3390
• colocation: fix DFATAL on UI tables page (#3726). #3726
• Ignore writes from the same transaction while updating CQL indexes. #3718
• Update setting for default number of compaction threads. #3561
• Add functionality of resolving intents to transaction participant. #1032
• [cdc] Ability to Delete & List CDC Streams in yb-admin. #3638
• Set default manifest preallocation to 64k. #3666
• A workaround for encryption counter overflow. #3707
• Fixed SecureStream OOM during network partition. #3842
• Transactions could hang at transaction participant after write stopped. #3823
• Show backfill progress at master/tasks. #3668
• Fix apply of transaction with deleted tablets. #3828
• Comment out Connection::Shutdown info log. #3842

Platform

• Fix health check failures when YSQL auth is enabled. #3737
• Adding under-replicated tablet servers to the master health check. #1374
• Fix Tab problem when going into Tables page on Yugabyte Cloud. #3749
• Only save usable AWS instance types. #3626
• Added APIs for querying audit table. #3792
• Generate Client Certificate for TLS enabled Universes. #3839
• Onprem - allow specifying homeDir, automatically exclude installing s3cmd and ntp. #3834
• Add sorting by default to the releases list and also a search bar to allow users to quickly access the desired release by entering part of the string. #3563
• Correctly disable ntp install for onprem

Note

Prior to 2.0, YSQL was still in beta. As a result, 2.0 release includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0+. Export from old cluster and import into a new 2.0+ cluster is needed for using existing data.

v2.1.1 (March 03, 2020)

YSQL Changes

• [YSQL] Improve performance when running index scan to query data. #3103
• colocation: handle table tombstone compaction #3360

System improvements

• Decrease log segment size for transaction status tablet. #3699
• Fix data race between ~Tablet and yb::tablet::Tablet::RegularDbFilesChanged(). #3519
• MiniMaster should set master_addresses on restart. #3336
• [cdc] Alter Replication Command for CDC. #2838
• Modify ldb Tool to be Encryption Aware. #3455
• Create database fails inside docker yugabyted. #3742

Platform

• [YW] Change the Disk Usage widget on Universe overview page to show the latest value instead of the average

Note

Prior to 2.0, YSQL was still in beta. As a result, 2.0 release includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0+. Export from old cluster and import into a new 2.0+ cluster is needed for using existing data.

v2.1.0 (February 25, 2020)

We are excited to announce the general availability of YugabyteDB 2.1 release.

The blog posts below detail the features highlighted in the release notes on this page.

• YugabyteDB 2.1 is GA: Scaling New Heights with Distributed SQL
• Achieving 10x Better Distributed SQL Performance in YugabyteDB 2.1

Generally Available Features

Performance improvements in Yugabyte SQL

• YCSB - 10x gain since 2.0 release
• TPC-C - first release to run the full TPC-C suite

Geo-distributed, multi-cloud clusters

• Two data center (2DC) deployments for reducing cross-DC write latency
• Read replicas for reducing cross-DC read latency

Enterprise-grade security enhancements

• Encryption at rest
• Encryption in transit

Beta Features

• Yugabyte Cloud as fully-managed DBaaS
• Colocated tables for reducing JOIN latency
• yugabyted for simplifying getting started UX
• Change Data Capture (CDC) for streaming data out to external systems

New & Improved Ecosystem Integrations Since 2.0 Release

• Hasura GraphQL Engine
• Crossplane Multi-Cloud Control Plane
• OpenEBS Storage Platform

Changelog

YSQL API

[YSQL] Fix table location cache for system and colocated tables. #3416
[YSQL] Enable ALTER TABLE IF EXISTS syntax. #3417
[YSQL] Use std::future in PgDocOp to fetch RPC result. #3240
[YSQL] Cleanup unique index if its creation fails. #3462
[YSQL] Eliminate redundant foreign key checks. #3328
[YSQL] Batch all write operations when possible. #2934
[YSQL] allow CREATE DATABASE ENCODING unicode/utf8 #3595
[YSQL] Fixed test wrong assumption in yb_dml_systable_scan.
[YSQL] Use smart pointers for YBqlOp and YBPgsqlOp. #3641
[YSQL] Provide a GFLAG to suppress unsupported error. #3633

YCQL API

[YCQL] Add gflag to create YCQL tables as transactional by default; change GROUP from reserved word to keyword; fix duplicate column error message. #3313
[YCQL] Fixed unexpected 'Duplicate Object' error from the CatalogManager. #2475
[YCQL] Fixed: signal 11: seg fault: yb::ql::PreparedResult::PreparedResult. #3415
[YCQL] Application stuck in BoundStatement execution if a variable was not bound. #3419

DocDB Distributed Store

Set the default history retention duration to 120 seconds. #3373
Fix metrics error after resetting percentiles.. #3362
Extract classes from transaction_participant.cc to separate files. #1032
Recover after write stop. #3331
Fix issue with yugabyted process restart loop. #3207
Track replicated batches at transaction participant. #3220
Backfill Index Table. #448
[Colocation] Use 4 byte PG table ID as dockey prefix. #3365
YB inbound RPCs throttling on soft memory limit. #2563
BlockBasedMemory mem-trackers should use the "tablet" MetricsEntity instead of "servers". #3364
Mean for metrics histograms should be based on the current values, not historic values. #3470
Make yugabyted work with docker volume mounts. #3513
Added Graph to track Rocksdb write rejections. #2871
Fsync before WAL close. #3490
Enable percentiles for redis metrics. #3362
BlockBasedMemory mem-trackers may already exist in OpenKeyValueTablet. #3364
[cdc] Avoid race condition with CDCReadRpc. #3441
Call TransactionParticipant shutdown from Tablet shutdown. #3495
Point yugabyted to system conf file if present. #3169
Backfill Index Table - TServer side implementation for backfilling non-unique indices. #448
colocation: make reads aware of table tombstone #3359
Add ability to set hybrid time filter to existing rocksdb files. #1032
Server crash on startup after table truncate. #3524
Move all yugabyted modified data under central var dir. #3524
Add physical time to cdc_state table. #2837
docdb: iterate over intents past kTransactionId #3482
Prevent callback from detached rocksdb instance; prevent race condition between insert and truncate; disable rocksdb flush on truncate. #3288
Persist cdc min replicated index in the superblock. #3418
[CDC] Clean up cdc_state rows for deleted streams. #2529
yugabyted does not start with custom config file. #3634
[2DC] Create new BootstrapProducer API. #3319
Fix key processing on CDCProducer. #3582
Make yb-docker-ctl compatible with python3
Backfill index: handle failed master -> TS rpc. #3627
[cdc] Add Last Consumer Checkpoint to CDC Producer Metrics. #2154
Evict log cache at follower after operation was appended to log. #3665
Implement transaction sealing w/o abort. #3220
[Colocated] Master should issue AddTableToTable only for subsequent tables. #3681
Extract HeartbeatDataProvider from Heartbeater. #3571
Avoid sending apply intents from the follower. #3698

Yugabyte Platform

YW Alerting improvements. #2892
Add the 'snooze alerts status' of a universe to the health check panel. #2891
Added UI support to be able to snooze and enable alerts. #2891
Add toggle to take backup button. #3341
Redirect yugaware logs from yugabyted into yugabyte-logs dir. #3516
Add features for the read only user.
Add endpoint to support creation of user roles in YB database(s).
Add ability to specify list of tables to backup. #3614
Fix metrics url check. #3653
Do not merge flags during a gflag update. #3533
Add option to add, delete users
[YW][#3211] Add ESC key binding to document to close any modal on the screen by calling the onHide callback.#3211
[YW][#3332] Add default value for currentProvider and fix eslint warnings. #3332
[YW][#3680] Enable multi-table backups in CreateBackups modal. #3680
Add authentication for registering new users.
[YW][OSS] Add support to disable the Enable/Disable Backup button on the Tables tab, and change color of disabled TableActions
Handle overall exceptions in a better way. #3676

v2.0.11 (January 27, 2020)

YSQL Changes

• [YSQL] Colocation: Fix txn conflict issues due to absence of cotable ID in DocKey.#3251
• [YSQL] Table colocation drop flow. #3035
• [YSQL] Make parentheses optional for SPLIT clause. #3308
• [YSQL] Fixed restarted portal fields having wrong memory context. #3377
• [YSQL] IN clause pushdown for hash columns. #3130
• [YSQL] Reorganized and fixed INDEX implementation. #2959
• Access pg_stat_statements contents at <tserver_ip>:13000/statements. #3091
• [colocation] Create table tombstone. #3357
• [YSQL] Fix memory leak for altering temporary table. #3031

YCQL Changes

• [YCQL] Fixed Upgrade issue for SELECT from Indexed Table. #3281

System improvements

• Fix race condition on RetryingTSRpcTask::UnregisterAsyncTask. #3277
• [2DC] Change cdc_state table format. #3050
• Fix clock update during commit with committing transaction. #2571
• Don't check doc hybrid time at end of the key during rocksdb seek. #3024
• Fix redis keys command. #3311
• Move snapshot related classes from ent/ folder. #1032
• Use correct string end for char[] arg in Format function. #3396
• Fix SIGSEGV due to null consensus pointer in GetChanges. #3289
• Do not use TOMBSTONED tablets when load balancing across disks on a node. #3374
• Expose percentile metrics from histograms. #3362

Platform

• [YW] UI change for RBAC update to make Profile section functional
• [YW] Refreshing on the Edit Universe page does not load AZSelectorTable #3291
• Minor fix to ignore instances without memory specifications. #3298
• [YW] Fix missing property in newly generated cluster deviceInfo in ClusterFields. #3290
• Fix edit universe bug for region/zone update. #3323
• Cron expression validator on UI doesn't work correctly #3160. #3160
• AWS Instance Type Parsing Fix. #3063
• Added keyspace to multi-table backups. #3343
• Flow assign_public_ip through properly when creating GCP instance. #3386
• Added Audit trail for users. #3370

Note on upgrades from pre 2.0 releases

Version 2.0 release includes a backward incompatible file format change for YSQL. Note: Prior to 2.0, YSQL was still in beta. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0 or higher release.

There are two ways to address the above note.

• If you don't care about preserving your existing data, then delete your cluster, and create a new
  cluster with 2.0.x.x
• If you want to continue using your existing data, then please save your data,
  delete the cluster, create a new cluster with 2.0.x.x and then load the previously saved data.

v2.0.10 (January 06, 2020)

YSQL Changes

• [YSQL] Fixed an issue with PgDocOp lifespan sometimes being too short.
• [YSQL] "UPDATE" fails if any "NOT NULL" columns aren't updated #3174
• [YSQL] Force network library initialization on postmaster startup on macOS. 2509

YCQL Changes

• [YCQL] Table stuck in the keyspace after deletion #3032

System improvements

• Implement one way bitmap and Extract CleanupTransaction from YBTransaction. #3220
• Improved rocksdb corruption error logging. #2961
• Added TCMalloc stats when dumping memory usage. #3190

Platform

[YW] Fix infinitely updating state causing React to fail. Reason is calling setState repeatedly in componentDidUpdate will create an infinite depth nested state update.

Note on upgrades from pre 2.0 releases

Version 2.0 release includes a backward incompatible file format change for YSQL. Note: Prior to 2.0, YSQL was still in beta. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0 or higher release.

There are two ways to address the above note.

• If you don't care about preserving your existing data, then delete your cluster, and create a new
  cluster with 2.0.x.x
• If you want to continue using your existing data, then please save your data,
  delete the cluster, create a new cluster with 2.0.x.x and then load the previously saved data.

v2.0.9 (January 02, 2020)

YSQL Changes

• [YSQL] Push down LIMIT clause for INDEX_ONLY_SCAN. #3128
• [YSQL] Drop DB persist, delete sys tables. #2997
• [YSQL] Correctly report unsupported features in plpgsql grammar. #2005
• [YSQL] Enable DISCARD statement in grammar. #2491
• [YSQL] Update only the assigned columns in UPDATE statement. #3106
• [YSQL] Move YBCPgSession and PgTxnManager into PgApiImpl. #3053
• [YSQL] Deprecate num_tablets in CreateTableRequestPB
• [YSQL] Support create colocated db/table . #3033

YCQL Changes

• [YCQL] Support conditional DMLs in transaction statement block. #166
• [YCQL] Compatibility Issue - Not processing older format of protobuf message when picking index. #3175

System improvements

• Enable CXX11 ABI. #3116
• Limited transactional DDL: each DDL statement in its own transaction. #3108
• Improved TcpStream::sending_ queue memory tracking. #3041
• Per service gauge counter for number of enqueued rpcs. #2389
• Handle GetChanges(MinimumOpID) as a Request for the First Log Entry. #3036
• Fixed vmodule logging configuration. #3176
• Log over-replicated tablets in load balancer. #3173
• Fix for stuck Inbound RPC connections due to hitting memory limit. #2562
• Retry transaction status table creation if it fails. #3182
• Add ability to set transaction priority range using SQL. #3024
• Delete provisional records RocksDB SSTable files. #2186

Platform

• [YW] Change Intro dialog to only appear on login. Add checkbox in Intro dialog for permanently hiding modal. #3138
• [Platform] Fix console errors in UI code #2790
• [YW] Fix backup Universe from changing to undefined url
• [Platform] Task history not reflecting when a encryption is enabled/disabled/rotated #2929
• Add per node metrics for health. #2894
• Implement RBAC in Yugaware. #2793
• Add chrony configuration while provision step. #3038

Note on upgrades from pre 2.0 releases

Version 2.0 release includes a backward incompatible file format change for YSQL. Note: Prior to 2.0, YSQL was still in beta. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0 or higher release.

There are two ways to address the above note.

• If you don't care about preserving your existing data, then delete your cluster, and create a new
  cluster with 2.0.x.x
• If you want to continue using your existing data, then please save your data,
  delete the cluster, create a new cluster with 2.0.x.x and then load the previously saved data.

v2.0.8 (December 13, 2019)

YSQL Changes

• [YSQL] enable client-to-server TLS encryption for postgres process in case use_client_to_server_encryption is set to true. #2980
• [YSQL] Disable the unnecessary pggate-level auto read restarts. #2812
• [YSQL] yb-admin command to delete namespace, table and index. #3069
• [YSQL] Assertion failed on TRUNCATE TABLE command. #1632
• [YSQL] Consider HASH column when seeking index for ORDER BY clause. #2792

YCQL Changes

• [YCQL] Fixed 'kong migrations bootstrap' failure with yugabyte. #2829

System improvements

• Add log retention by op id policy documentation. #2773
• Switch Linuxbrew to 20181203T161736. #3044
• Check transaction status after load. #2186
• [2DC] Make cdc_poller log messages more descriptive
• Lower max timeout on master async tasks from 1 hour to 15 minutes. #1655
• Cleanup intents written for foreign key check. #3111

Platform

• [YW] Add a prometheus metrics export endpoint. #2459
• [YW] Recursively call task status API sequentially so there is no overlap. #2998
• [Platform] Move the CMK policy to be moved to KMS instead of having it universe level #2942

Note on upgrades from pre 2.0 releases

Version 2.0 release includes a backward incompatible file format change for YSQL. Note: Prior to 2.0, YSQL was still in beta. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0 or higher release.

There are two ways to address the above note.

• If you don't care about preserving your existing data, then delete your cluster, and create a new
  cluster with 2.0.x.x
• If you want to continue using your existing data, then please save your data,
  delete the cluster, create a new cluster with 2.0.x.x and then load the previously saved data.

v2.0.7 (December 04, 2019)

System improvements

• Expose rocksdb max_write_buffer_number as a gflag. #2935
• Roll forward master tablet deletion on fault during DeleteTable. #2721
• Batch Records on 2DC Consumer. #2580
• Use raft commit hybrid time for write batch frontier. #2912
• Remove aborted transaction from follower. #2186
• Add leader_stepdown to yb-admin.#1943
• [2DC] TLS support for 2DC
• CDC op id retention policy. #2486
• Fix double cleanup of provisional records. #2186
• Improved RPC heartbeats sending. #2964

Platform

• [YW] Fix node metrics on Universe specific Nodes page. #3006
• Fix the host info query to be called only on provider config page. #1342

Note on upgrades from pre 2.0 releases

Version 2.0 release includes a backward incompatible file format change for YSQL. Note: Prior to 2.0, YSQL was still in beta. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0 or higher release.

There are two ways to address the above note.

• If you don't care about preserving your existing data, then delete your cluster, and create a new
  cluster with 2.0.x.x
• If you want to continue using your existing data, then please save your data,
  delete the cluster, create a new cluster with 2.0.x.x and then load the previously saved data.

v2.0.6 (November 23, 2019)

YSQL changes

• [YSQL] Transparent read restarts for general queries. #1237
• [YSQL] Support row level security (RLS) as per Postgres. #1870
• [YSQL] use database type in catalog_manager for keyspace name uniqueness. #1476
• [YSQL] Enable fmgr cache for C functions. #2596
• [YSQL] fix delete from table returning * query with dropped columns. #2398
• [YSQL] Update catalog manager data while renaming YSQL table, DB and columns. #2280
• [YSQL] FOR [NO KEY] UPDATE. #2842
• Use transaction pool for YSQL. #2909
• [YSQL] Increase default PostgreSQL output buffer size; fix a bug with unnamed_stmt_psrc. #2975
• [YSQL] use ~/.yugabytedb as default certificate folder for ysqlsh #2985
• [YSQL] Pick transaction id such that its leader is local to transaction coordinator #2889

System improvements

• [docdb] Speedup data loading in Master Leader startup. #2663
• [docdb] Speedup CREATE DATABASE for YSQL.
• Set Timeout and elapsed time in same units #2826
• Track memory taken by CDC producer. #2888
• Cleanup TIMED_OUT calls from /rpcz. #2807
• Improve logging of shutting down idle and broken connections. #2918
• Do not display user index tables as system tables in master UI. #2921
• CDC Producer Metrics. #2154
• yb-admin support for in-memory encryption keys. #2916
• Poll TCMalloc stats on update of root MemTracker. #2566
• Fix LB enable / disable handling. #1942
• Propagate hybrid time from follower. #2956

Platform

• [Platform] - Rotate key with service should not rely on alias/cmk already existing #2943
• [YW] Enable alerts email button is not clickable #2827
• [Platform] - Fix SetUniverseKey task for unencrypted universes #2976
• Fix k8s metrics for CPU and Disk Usage.
• [Platform] Support instance profiles for default CMK policy #2949

Note on upgrades from pre 2.0 releases

Version 2.0 release includes a backward incompatible file format change for YSQL. Note: Prior to 2.0, YSQL was still in beta. This means that if you have an existing cluster running releases older than 2.0 with YSQL enabled, then you will not be able to upgrade to version 2.0 or higher release.

There are two ways to address the above note.

• If you don't care about preserving your existing data, then delete your cluster, and create a new
  cluster with 2.0.x.x
• If you want to continue using your existing data, then please save your data,
  delete the cluster, create a new cluster with 2.0.x.x and then load the previously saved data.