Upgrade to DataFusion 43, fix a bug, add more tests (#53)

* Implementing Unit testing for Python * Installing all deps in CI * Adding maturin develop * Restoring correct input partitioning * Generated new plans * Restored test plans for ignored tests * tests * fix * fix * update expected plans * update expected plans * revert some changes * remove comment * updated plans * upgrade to DF 43 * update deps, more tests * bug fix --------- Co-authored-by: Edmondo Porcu <[email protected]>
apache · Dec 14, 2024 · 151a0e2 · 151a0e2
1 parent 31f8833
commit 151a0e2
Show file tree

Hide file tree

Showing 31 changed files with 346 additions and 280 deletions.
diff --git a/.github/workflows/rust.yml b/.github/workflows/rust.yml
@@ -32,14 +32,14 @@ jobs:
     runs-on: ubuntu-latest
 
     steps:
-      - uses: actions/checkout@v3
+      - uses: actions/checkout@v4
       - name: Install protobuf compiler
         shell: bash
         run: sudo apt-get install protobuf-compiler
       - name: Build Rust code
         run: cargo build --verbose
       - name: Set up Python
-        uses: actions/setup-python@v2
+        uses: actions/setup-python@v5
         with:
           python-version: ${{ env.PYTHON_VERSION }}
       - name: Install test dependencies
@@ -49,5 +49,12 @@ jobs:
       - name: Generate test data
         run: |
           ./scripts/gen-test-data.sh
-      - name: Run tests
+      - name: Run Rust tests
         run: cargo test --verbose
+      - name: Run Python tests
+        run: |
+          python -m venv venv
+          source venv/bin/activate
+          pip install -r requirements-in.txt
+          maturin develop
+          python -m pytest