Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ValueError with version 3.14.0 of google-cloud-bigquery #6709

Open
achave11-ucsc opened this issue Nov 14, 2024 · 1 comment
Open

ValueError with version 3.14.0 of google-cloud-bigquery #6709

achave11-ucsc opened this issue Nov 14, 2024 · 1 comment
Labels
- [priority] Medium bug [type] A defect preventing use of the system as specified debt [type] A defect incurring continued engineering cost dependencies [subject] External software packages that the system depends on orange [process] Done by the Azul team

Comments

@achave11-ucsc
Copy link
Member

achave11-ucsc commented Nov 14, 2024

Causing indexer.test_tdr.TestTDRHCAPlugin.test_subgraph_stitching to error.

Error
Traceback (most recent call last):
  File "/Users/achave11/Pycharm/Azul/azul.sc/test/indexer/test_tdr.py", line 341, in test_subgraph_stitching
    self._test_fetch_bundle(bundle, load_tables=True)
  File "/Users/achave11/Pycharm/Azul/azul.sc/test/indexer/test_tdr.py", line 353, in _test_fetch_bundle
    emulated_bundle = plugin.fetch_bundle(test_bundle.fqid)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/src/azul/plugins/repository/tdr.py", line 197, in fetch_bundle
    bundle = self._emulate_bundle(bundle_fqid)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/src/azul/plugins/repository/tdr_hca/__init__.py", line 323, in _emulate_bundle
    entities, root_entities, links_jsons = self._stitch_bundles(bundle)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/src/azul/plugins/repository/tdr_hca/__init__.py", line 394, in _stitch_bundles
    upstream = self._find_upstream_bundles(source, all_dangling_inputs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/src/azul/plugins/repository/tdr_hca/__init__.py", line 511, in _find_upstream_bundles
    for row in rows:
  File "/Users/achave11/Pycharm/Azul/azul.sc/.venv/lib/python3.11/site-packages/google/api_core/page_iterator.py", line 209, in _items_iter
    for item in page:
  File "/Users/achave11/Pycharm/Azul/azul.sc/.venv/lib/python3.11/site-packages/google/api_core/page_iterator.py", line 131, in __next__
    result = self._item_to_value(self._parent, item)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/.venv/lib/python3.11/site-packages/google/cloud/bigquery/table.py", line 2962, in _item_to_row
    _helpers._row_tuple_from_json(resource, iterator.schema),
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/.venv/lib/python3.11/site-packages/google/cloud/bigquery/_helpers.py", line 300, in _row_tuple_from_json
    row_data.append(_field_from_json(cell["v"], field))
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/.venv/lib/python3.11/site-packages/google/cloud/bigquery/_helpers.py", line 276, in _field_from_json
    return converter(resource, field)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/achave11/Pycharm/Azul/azul.sc/.venv/lib/python3.11/site-packages/google/cloud/bigquery/_helpers.py", line 142, in _timestamp_from_json
    return _datetime_from_microseconds(int(value))
                                       ^^^^^^^^^^
ValueError: invalid literal for int() with base 10: '1597094666.174274'

At a glance, and because of the Azul source code site …

… it didn't appear to be a trivial fix.

@achave11-ucsc achave11-ucsc added the orange [process] Done by the Azul team label Nov 14, 2024
@achave11-ucsc
Copy link
Member Author

Limiting the updated google-cloud-bigquery version in #6511.

@dsotirho-ucsc dsotirho-ucsc changed the title Bumping google-cloud-bigquery beyod 3.13.0 raises errors within the client google-cloud-bigquery 3.14.0 raises errors within the client Nov 15, 2024
@dsotirho-ucsc dsotirho-ucsc changed the title google-cloud-bigquery 3.14.0 raises errors within the client ValueError with google-cloud-bigquery 3.14.0 Nov 15, 2024
@dsotirho-ucsc dsotirho-ucsc changed the title ValueError with google-cloud-bigquery 3.14.0 ValueError with version 3.14.0 of google-cloud-bigquery Nov 15, 2024
@dsotirho-ucsc dsotirho-ucsc added dependencies [subject] External software packages that the system depends on bug [type] A defect preventing use of the system as specified debt [type] A defect incurring continued engineering cost - [priority] Medium labels Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
- [priority] Medium bug [type] A defect preventing use of the system as specified debt [type] A defect incurring continued engineering cost dependencies [subject] External software packages that the system depends on orange [process] Done by the Azul team
Projects
None yet
Development

No branches or pull requests

2 participants