Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking issue for Polars Cloud #21487

Open
22 of 41 tasks
ritchie46 opened this issue Feb 27, 2025 · 0 comments
Open
22 of 41 tasks

Tracking issue for Polars Cloud #21487

ritchie46 opened this issue Feb 27, 2025 · 0 comments

Comments

@ritchie46
Copy link
Member

ritchie46 commented Feb 27, 2025

Tracking issue that shows the available features in Polars-cloud. This is an extension on the tracking issue of the new streaming engine as this will be serving as preferred engine on our workers.

Generic

  • full API
  • All optimizations
  • Native compilation
  • Interactive mode
  • Batch mode
  • UDF's
  • Package management
  • AWS
  • Cancellable queries
  • Catalog support
  • Dynamic scaling
  • Serverless
  • GCP
  • Azure
  • K8
  • Fault tolerance
  • streaming engine
  • GPU support
  • Plugin support
  • IO Plugins

Single node

  • All data types except objects

Distributed

Shows which operations can run in an distributed fashion, non supported operations will finish on a single node with the streaming engine (which can often be faster).

  • Group-by
    • partitioned pre-agg
  • Equi joins
  • Semi / Anti Joins
  • Filter
  • Explode
  • Elementwise functions/expression
  • Partitioned multi-file read
  • Worker/file affinity (file cache)
  • Rolling
  • Dynamic group-by
  • Expression lowering (to distirbuted nodes)
  • Partitioned single file read
  • Sort
  • CSE
  • Categoricals
  • row index

Shuffles

  • By keys
  • Round robin
  • Ordered
@ritchie46 ritchie46 pinned this issue Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant