Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MINOR][DNM][Testing] Release 0.15.0 RC2 #11333

Closed
wants to merge 412 commits into from
Closed

[MINOR][DNM][Testing] Release 0.15.0 RC2 #11333

wants to merge 412 commits into from

Conversation

yihua
Copy link
Contributor

@yihua yihua commented May 27, 2024

Change Logs

As above

Impact

Testing only

Risk level

none

Documentation Update

none

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

codope and others added 30 commits May 14, 2024 11:47
@codope @yihua
[MINOR] Improve mdt validator and upsert partitioner logs (#10656)
6746f44
@vinishjail97 @yihua
[HUDI-7450] Fix offset computation bug when allocedEvents > actualNum…
fbe4d37 
…Events (#10768)
@wombatu-kun @yihua
[HUDI-5292] Exclude the test resources from every module packaging (#…
b1c7528 
…10702)

Co-authored-by: Vova Kolmakov <[email protected]>
@the-other-tim-brown @yihua
[MINOR] Modify filter to allow removal of column stats from metadata …
d62b245 
…table for bootstrap table files (#10238)
@vinishjail97 @yihua
[HUDI-7450] Address minor comments on Fix offset computation bug when…
292b1d8 
… allocedEvents > actualNumEvents (#10771)

* Address comments

* Addressed comments
@yihua
[HUDI-7431] Add replication and block size to StoragePathInfo to be b…
91e176c 
…ackwards compatible (#10717)
@vinishjail97 @yihua
[HUDI-7452] Repartition row dataset in S3/GCS based on task size (#10777
eccd183 
)
@majian1998 @yihua
[HUDI-7456] Set 'hudi' as the explicit provider for new table propert…
1360b82 
…ies when create table by spark (#10776)
@jonvex @yihua
[HUDI-7385] Add config for custom write support for parquet row writer (
fb456d5 
#10598)

Co-authored-by: Jonathan Vexler <=>
@geserdugarov @yihua
Revert "[HUDI-6438] Config parameter 'MAKE_NEW_COLUMNS_NULLABLE' to a…
7a4f86a 
…llow for marking a newly created column as nullable." (#10782)
@jp0317 @yihua
[HUDI-7459] Update hudi-gcp-bundle pom (#10790)
e358530 
Co-authored-by: jp0317 <[email protected]>
@sampan-s-nayak @yihua
[HUDI-7462] Refactor checkTopicCheckpoint in KafkaOffsetGen for reusa…
56c4937 
…bility (#10794)
@the-other-tim-brown @yihua
[HUDI-7464] Fix minor bugs in kafka post-processing related code (#10772
d36e526 
)
@KUTEJiang @yihua
[MINOR] Fix violations of Sonarqube rule java:S2184 (#10444)
0a4bed6 
Co-authored-by: Y Ethan Guo <[email protected]>
@wenbingshen @yihua
[HUDI-7447] Fix not bootstrap when subTask restart when OPCoordinator…
d81f2bb 
… handle CheckPointComplete not finished (#10767)
@cmmp6 @yihua
[HUDI-9424] Support using local timezone when writing flink TIMESTAMP…
99d52b7 
… data (#10594)
@yihua
[HUDI-7465] Split tests in CI further to reduce total CI elapsed time (…
68659a1 
…#10795)
@wombatu-kun @yihua
[HUDI-6089] Handle default insert behaviour to ingest duplicates (#10728
4bdb98b 
)

Co-authored-by: Vova Kolmakov <[email protected]>
@yihua
[HUDI-7469] Reduce redundant tests with Hudi record types (#10800)
53725e8
@nsivabalan @yihua
[HUDI-6953] Adding test for composite keys with bulk insert row writer (
7c3437f 
#10214)
@CTTY @yihua
[HUDI-3625] Update RFC-60 (#9462)
e2ec366 
Co-authored-by: Shawn Chang <[email protected]>
@stayrascal @yihua
[MINOR] Clean code of FileSystemViewManager (#10797)
734e0cf 
Co-authored-by: wuzhiping <[email protected]>
@yihua
[HUDI-7471] Use existing util method to get Spark conf in tests (#10802)
05e16b7
@yihua
[MINOR] Add PR description validation on documentation updates (#10799)
e35fa8d
@jonvex @yihua
[HUDI-7479] SQL confs don't propagate to spark row writer properly (#…
a4aa005 
…10786)
@kbuci @yihua
[HUDI-7337] Implement MetricsReporter that reports metrics to M3 (#10565
5deb196 
)


---------

Co-authored-by: Krishen Bhan <“[email protected]”>
@jonvex @yihua
[HUDI-7413] Fix schema exception types and error messages thrown with…
78bf676 
… schema exceptions (#10677)

Co-authored-by: Jonathan Vexler <=>
@rmahindra123 @yihua
[HUDI-7418] Create a common method for filtering in S3 and GCS source…
4538fb2 
…s and add tests for filtering out extensions (#10724)

Co-authored-by: rmahindra123 <[email protected]>
@yihua
[MINOR] Fix Azure publishing of JUnit results (#10817)
81fe5ad
@yihua
[MINOR] Publish test results from the containerized job to Azure (#10818
111d138 
)
nsivabalan and others added 27 commits May 15, 2024 21:54
@nsivabalan
[HUDI-7771] Making OverwriteWithLatestPayload as default payload in 0…
2b81e6b 
….15.0 (#11240)
@nsivabalan
[HUDI-6386] Branch 0.x failing tests test multi writer archival (#11239)
2815aef
@yihua
[HUDI-7770] Parse partition path from hudi directory for bootstrap ta…
a04390b 
…bles (#11237)
@yihua
[HUDI-7769] Fix Hudi CDC read on Spark 3.3.4 and 3.4.3 (#11242)
c028842
@yihua
[HUDI-7766] Adding staging jar deployment command for Spark 3.5 and S…
1b97582 
…cala 2.13 profile (#11234)
@yihua
Create release branch for version 0.15.0
9c90a7b
@yihua
Remove local change from 0.14.0
16ba7f2
@ad1happy2go @yihua
[MINOR] [BRANCH-0.x] Added condition to check default value to fix ex…
f5a7c0f 
…tracting password from credential store (#11247)
@yihua
[HUDI-7784] Fix serde of HoodieHadoopConfiguration in Spark (#11270)
ed2dc91
@nsivabalan @yihua
[HUDI-7786] Fix roaring bitmap dependency in hudi-integ-test-bundle (#…
0de2e80 
…11283)
@yihua
[HUDI-7785] Keep public APIs in utilities module the same as before H…
b71da93 
…oodieStorage abstraction (#11280)
@yihua
[HUDI-7775] Remove unused APIs in HoodieStorage (#11281)
670f131
@yihua
[HUDI-7788] Fixing exception handling in AverageRecordSizeUtils (#11290)
b350a26
@yihua
[HUDI-7776] Simplify HoodieStorage instance fetching (#11292)
77b1ded
@yihua
[HUDI-7792] Bump h2 from 1.4.200 to 2.2.220 (#11296)
2e763c9
@yihua
[HUDI-7790] Revert changes in DFSPathSelector and UtilHelpers.readCon…
72dd518 
…fig (#11294)
@yihua @dependabot
[HUDI-7794] Bump org.apache.hive:hive-service from 2.3.1 to 2.3.4 (#1…
b607899 
…1298)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@yihua
[HUDI-7777] Allow HoodieTableMetaClient to take HoodieStorage instanc…
f5b8088 
…e directly (#11303)
@yihua
[HUDI-7796] Gracefully cast file system instance in Avro writers (#11304
b9ffa97 
)
@yihua @nsivabalan
[HUDI-7778] Fixing global index for duplicate updates (#11305)
86552da 
Co-authored-by: sivabalan <[email protected]>
@yihua
[HUDI-7798] Mark configs included in 0.15.0 release (#11307)
b4d52c0
@yihua
[HUDI-7797] Use HoodieIOFactory to return pluggable FileFormatUtils i…
b8796d0 
…mplementation (#11310)
@yihua
[MINOR] Fix bundle validation script on branch-0.x (#11331)
bd4256b
@yihua
[HUDI-7707] Enable bundle validation on Java 8 and 11 (#11313)
bbebda4
@yihua
[HUDI-7802] Fix bundle validation scripts (#11332)
27e45ac
@yihua
Bumping release candidate number 2
7100227
@yihua
[MINOR] Change release candidate validation target
f80c416
@github-actions github-actions bot added the size:XL PR with lines of changes > 1000 label May 27, 2024
@yihua yihua closed this May 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
size:XL PR with lines of changes > 1000
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.