Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Explorer: Support for URLs without .parquet file extensions #809

Open
trygu opened this issue May 23, 2024 · 0 comments
Open

Data Explorer: Support for URLs without .parquet file extensions #809

trygu opened this issue May 23, 2024 · 0 comments
Milestone

Comments

@trygu
Copy link
Contributor

trygu commented May 23, 2024

Description:

The Data Explorer component in Onyxia currently does not support accessing parquet data from URLs that do not have the .parquet file extension. This limitation hinders the ability to fetch and explore parquet data provided by APIs, which often do not include file extensions in their URLs.

Problem:

When attempting to access parquet data from URLs provided by APIs, such as the example below, the Data Explorer fails to process the data correctly:

Example URL:

https://data.qa.ssb.no/pxapi2-beta/api/v2/tables/12462/data?lang=no&valueCodes[ContentsCode]=Indeksnivo&valueCodes[Tid]=2023M01,2023M02,2023M03,2023M04&codelist[NaringUtenriks]=vs_NaringPPI1&outputformat=parquet

Steps to Reproduce:

  1. Open the Data Explorer component.
  2. Attempt to load parquet data from the example URL above.
  3. Observe that the Data Explorer fails to load the data.

Expected Behavior:
The Data Explorer should correctly handle URLs pointing to parquet data regardless of whether they include a .parquet file extension.

Additional Context:
This feature is essential for working with data APIs that dynamically generate and serve parquet files without including the .parquet extension in the URL.

@fcomte fcomte added this to the Data explorer milestone May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants