Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-32566: [C++] Connect parquet to the new scan node #35889

Closed
wants to merge 13 commits into from

Commits on Jul 14, 2023

  1. Added Parquet support for the new scan node. Refactored the scan node…

    … considerably. Now each fragment contains one or more scan tasks. Each scan task can yield a stream of batches. So, CSV, for example, is a single scan task that covers the entire file. Parquet, on the other hand, has a scan task per row group. This also makes explicit a lot of the logic that was implicit around sequencing and trying to figure out the correct batch index.
    westonpace committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    13da110 View commit details
    Browse the repository at this point in the history
  2. WIP

    westonpace committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    01776ec View commit details
    Browse the repository at this point in the history
  3. WIP

    westonpace committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    dfcc907 View commit details
    Browse the repository at this point in the history
  4. WIP

    westonpace committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    83ab027 View commit details
    Browse the repository at this point in the history
  5. WIP

    westonpace committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    85d72a2 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2023

  1. Configuration menu
    Copy the full SHA
    e687c70 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. Configuration menu
    Copy the full SHA
    80786f7 View commit details
    Browse the repository at this point in the history
  2. Added row group filtering

    westonpace committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    87f7b4e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f549145 View commit details
    Browse the repository at this point in the history
  4. include fixes

    westonpace committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    8d2b2b9 View commit details
    Browse the repository at this point in the history
  5. Fixing bad include

    westonpace committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    5999301 View commit details
    Browse the repository at this point in the history
  6. Minor lint fixes

    westonpace committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    b6ff36d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    a667c1d View commit details
    Browse the repository at this point in the history