Releases: GoogleCloudDataproc/spark-bigquery-connector
Releases · GoogleCloudDataproc/spark-bigquery-connector
0.42.0
- PR #1333: Initial implementation of a BigQuery backed Spark Catalog
- PR #1335: Adding indirect write GCS cleanup logs
- BigQuery API has been upgraded to version 2.47.0
- BigQuery Storage API has been upgraded to version 3.11.2
- GAX has been upgraded to version 2.60.0
- Netty has been upgraded to version 4.1.117.Final
- Guava has been upgraded to version 33.4.0-jre
0.41.1
- Issue #1290: Stopped using metadata for optimized count path
- Issue #1317: Improving OpenLineage 1.24.0+ compatibility
- PR #1311: Improve read session expired error message
- PR #1320: Set the
temporaryGcsBucket
to default tofs.gs.system.bucket
if exists, negating the need to set it in Dataproc clusters. - BigQuery API has been upgraded to version 2.45.0
- BigQuery Storage API has been upgraded to version 3.11.0
- GAX has been upgraded to version 2.59.0
- Netty has been upgraded to version 4.1.115.Final
- Arrow has been upgraded to version 17.0.0
- Avro has been upgraded to version 1.11.4
0.41.0
- PR #1265 : Add additional parentheses for EqualNullSafe filter generation. Thanks @tom-s-powell !
- PR #1267 : Implement OpenLineage spark-extension-interfaces
- PR #1281 : Configure alternative BigNumeric precision and scale defaults
- Issue #1175: Add details to schema mismatch message
- BigQuery API has been upgraded to version 2.42.2
- BigQuery Storage API has been upgraded to version 3.9.0
- GAX has been upgraded to version 2.52.0
- Netty has been upgraded to version 4.1.113.Final
0.40.0
- PR #1259 : Encode snapshotTimeMillis in view materialization query. Thanks @tom-s-powell !
- PR #1261 : Adding IdentityToken header in readRows call
- Issue #1043 : Fix Indirect write drops policy tags
- Issue #1244 : Set schema Field Nullables as per ALLOW_FIELD_RELAXATION
- Issue #1254 : fix getting partitioning fields for pseudo columns
- Issue #1263 : Support ClusteredFields in Direct Write
- BigQuery API has been upgraded to version 2.42.0
- BigQuery Storage API has been upgraded to version 3.8.0
- GAX has been upgraded to version 2.51.0
- gRPC has been upgraded to version 1.65.1
- Netty has been upgraded to version 4.1.112.Final
0.36.4
0.39.1
0.36.3
0.39.0
- PR #1221: Adding support for table snapshots. Thanks @tom-s-powell !
- PR #1222: Add option to request lz4 compressed ReadRowsResponse
- PR #1225: Fixing multi-release jar shading
- PR #1227: Optimizing dynamic partition overwrite for Time partitioned tables
- BigQuery API has been upgraded to version 2.40.1
- BigQuery Storage API has been upgraded to version 3.5.1
- GAX has been upgraded to version 2.48.1
- gRPC has been upgraded to version 1.64.0
0.36.2
0.38.0
- PR #1205: Sending Identity token in the read API header
- Issue #1195: Support map type with complex value
- Issue #1215: Support predicate pushdown for DATETIME
- BigQuery API has been upgraded to version 2.39.0
- BigQuery Storage API has been upgraded to version 3.5.0
- GAX has been upgraded to version 2.47.0
- Arrow has been upgraded to version 16.0.0
- gRPC has been upgraded to version 1.63.0
- Netty has been upgraded to version 4.1.109.Final