Skip to content

Pull requests: uber/petastorm

New pull request New
21 Open 474 Closed
21 Open 474 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add a ThreadPool which respects the order of Parquet dataset pieces.
#796 opened May 12, 2023 by wbeardall Loading…
3
Add missing field_name in ValueError
#792 opened Mar 16, 2023 by chasleslr Loading…
3
[Test] Run CI against pyspark 3.4
#791 opened Feb 28, 2023 by WeichenXu123 Loading…
3
Update CI to use latest versions of pyarrow and numpy. Drop pyarrow 4 test config.
#778 opened Sep 15, 2022 by selitvin Loading…
2
Add a collate_lists_fn
#772 opened Aug 29, 2022 by selitvin • Draft
1
Wrapper for Arrow Datasets & Dataset Pieces
#754 opened Apr 28, 2022 by aperiodic Loading…
5
Update README.rst
#753 opened Apr 22, 2022 by FeU-aKlos • Draft
1
Add Python3.10 to CI docker image
#752 opened Apr 21, 2022 by selitvin Loading…
2
Fix type of the a batch returned by make_batch_reader when TransformSpec's function returns column with all values being None
#750 opened Apr 8, 2022 by selitvin Loading…
1
3
Enable batch fetching in parallel
#748 opened Mar 23, 2022 by jarandaf • Draft
17
Use spark_test_ctx fixture instead of constructing spark manually
#711 opened Jul 30, 2021 by selitvin Loading…
1
Remove very old pickle compatibility code modifying old atg package names
#702 opened Jul 26, 2021 by selitvin Loading…
2
Use pyarrow.fs.LocalFileSystem as per arrow 4.x
#698 opened Jul 5, 2021 by JayjeetAtGithub Loading…
2
fix get_dataset_path() in fs_utils.py
#663 opened Apr 10, 2021 by dongpohezui Loading…
7
Remove Unischema __getattr__ implementation
#656 opened Mar 18, 2021 by v01dXYZ Loading…
2
Use new pyarrow.fs filesystem objects
#619 opened Nov 7, 2020 by selitvin • Draft
1
Reading lists of numpy arrays
#605 opened Sep 19, 2020 by selitvin • Draft
1
Fix GCSFS walk() method
#561 opened Jun 14, 2020 by megaserg Loading…
1
13
Parallelize encoding of a single row
#546 opened Apr 20, 2020 by selitvin • Draft
2
[WIP] Auto infer schema (including fields shape) from the first row
#512 opened Mar 23, 2020 by WeichenXu123 Loading…
7
Add make_reader support for parquet partitioned on more than one key
#488 opened Feb 14, 2020 by jamesprinc3 Loading…
2
ProTip! Follow long discussions with comments:>50.