-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GH-32566: [C++] Connect parquet to the new scan node #35889
Closed
Closed
Commits on Jul 14, 2023
-
Added Parquet support for the new scan node. Refactored the scan node…
… considerably. Now each fragment contains one or more scan tasks. Each scan task can yield a stream of batches. So, CSV, for example, is a single scan task that covers the entire file. Parquet, on the other hand, has a scan task per row group. This also makes explicit a lot of the logic that was implicit around sequencing and trying to figure out the correct batch index.
Configuration menu - View commit details
-
Copy full SHA for 13da110 - Browse repository at this point
Copy the full SHA 13da110View commit details -
Configuration menu - View commit details
-
Copy full SHA for 01776ec - Browse repository at this point
Copy the full SHA 01776ecView commit details -
Configuration menu - View commit details
-
Copy full SHA for dfcc907 - Browse repository at this point
Copy the full SHA dfcc907View commit details -
Configuration menu - View commit details
-
Copy full SHA for 83ab027 - Browse repository at this point
Copy the full SHA 83ab027View commit details -
Configuration menu - View commit details
-
Copy full SHA for 85d72a2 - Browse repository at this point
Copy the full SHA 85d72a2View commit details
Commits on Jul 15, 2023
-
Configuration menu - View commit details
-
Copy full SHA for e687c70 - Browse repository at this point
Copy the full SHA e687c70View commit details
Commits on Jul 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 80786f7 - Browse repository at this point
Copy the full SHA 80786f7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 87f7b4e - Browse repository at this point
Copy the full SHA 87f7b4eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f549145 - Browse repository at this point
Copy the full SHA f549145View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d2b2b9 - Browse repository at this point
Copy the full SHA 8d2b2b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5999301 - Browse repository at this point
Copy the full SHA 5999301View commit details -
Configuration menu - View commit details
-
Copy full SHA for b6ff36d - Browse repository at this point
Copy the full SHA b6ff36dView commit details -
Configuration menu - View commit details
-
Copy full SHA for a667c1d - Browse repository at this point
Copy the full SHA a667c1dView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.