to_geopandas method returns an error

[nagyrobir]

Hi!

This is sort of a continuation of #16. When i try to convert the original dataset with the "to_geopandas" method i get the error bellow. Is there anything i am doing improperly?

import geopandas as gpd
import pyarrow.parquet as pa
from pyarrow.parquet import read_table
import shapely
import geoarrow.pyarrow as ga

tb = read_table(r"/home/parquet/buildings.parquet")
dataset = ga.dataset(tb,geometry_columns=["geometry"])

gp=ga.to_geopandas(dataset.to_table())

gp=ga.to_geopandas(dataset.to_table())
Traceback (most recent call last):
File "", line 1, in
File "/home/venv/lib/python3.10/site-packages/geoarrow/pyarrow/_compute.py", line 592, in to_geopandas
wkb_array_or_chunked = as_wkb(obj)
File "/home/venv/lib/python3.10/site-packages/geoarrow/pyarrow/_compute.py", line 267, in as_wkb
return as_geoarrow(obj, _type.wkb())
File "/home/venv/lib/python3.10/site-packages/geoarrow/pyarrow/_compute.py", line 280, in as_geoarrow
obj = obj_as_array_or_chunked(obj)
File "/home/venv/lib/python3.10/site-packages/geoarrow/pyarrow/_compute.py", line 30, in obj_as_array_or_chunked
return array(obj_in, validate=False)
File "/home/venv/lib/python3.10/site-packages/geoarrow/pyarrow/_array.py", line 152, in array
arr = pa.array(obj, *args, **kwargs)
File "pyarrow/array.pxi", line 327, in pyarrow.lib.array
File "pyarrow/array.pxi", line 39, in pyarrow.lib._sequence_to_array
File "pyarrow/error.pxi", line 144, in pyarrow.lib.pyarrow_internal_check_status
File "pyarrow/error.pxi", line 100, in pyarrow.lib.check_status
pyarrow.lib.ArrowInvalid: Could not convert <pyarrow.lib.ChunkedArray object at 0x7f021c19b740>
[
[
1,
2,
3,
4,
5,
...
65532,
65533,
65534,
65535,
65536
],
[
65537,
65538,
65539,
65540,
65541,
...
131068,
131069,
131070,
131071,
131072
],
...,
[
196609,
196610,
196611,
196612,
196613,
...
262140,
262141,
262142,
262143,
262144
],
[
262145,
262146,
262147,
262148,
262149,
...
318059,
318060,
318061,
318062,
318063
]
] with type pyarrow.lib.ChunkedArray: did not recognize Python value type when inferring an Arrow data type

[paleolimbot]

I think this one is because to_geopandas() doesn't currently handle a pyarrow.Table. It perhaps should (or at least should do a better job erroring), but in the meantime I think you can do:

# ...
df = dataset.to_table().to_pandas()
df.geometry = df.geometry.geoarrow.to_geopandas()
# ...I forget exactly how to get a pandas.DataFrame into a geopandas.GeoDataFrame

[nagyrobir]

I saw that the type( dataset.to_table()) returns a pyarrow.lib.Table.I guess getting it into geopandas from pandas works well then so i can stick to that, i thought i was doing something wrong. I think you guys are doing a wonderful job! and thank you again. I'll hang around to see what new things you push to the repo!

[jorisvandenbossche]

(re-opening, because we should make this work)