Skip to content

Registry Workshop 2022‐07‐26

thomas loubrieu edited this page Aug 22, 2023 · 1 revision

Agenda:

  • Discuss development activity
  • Discuss how to submit issues
  • Review issues / Q&A

Meeting Recording: https://jpl.webex.com/jpl/ldr.php?RCID=7def1b8f4dbc1a9e4ecb6669f49c12f7

Mailing list

We are using a Google group list which contains many personal emails: list [email protected] [email protected]

It is being replaced by a groups.io list for which you received an invitation: [email protected]

Action An email will be sent next week using this email list to prepare the following workshop

Development Activity

Tickets are distributed in the repositories of the different components of the registry

The overall application tickets can be found here: https://github.com/NASA-PDS/registry/issues

The API documentation has been improved: https://nasa-pds.github.io/pds-api/

Other specific tickets associated to components of the registry are:

Harvest Batch Processing

See https://github.com/NASA-PDS/harvest/issues

Harvest-as-a-Service (Scalable Harvest)

See https://github.com/NASA-PDS/registry-harvest-service/issues

Registry API

See https://github.com/NASA-PDS/registry-api/issues

New requests

  • Propose the latest endpoint for the API, for users who don’t care/know which version to use and just want the latest, the version wil redirect on the latest version, currently 1.0
  • Cache on cloud front: provide a no-cache hidden parameter or an administration end-point with no cache
  • Clean the old pages from the updated PDS-API documentation (done)

Registry Discussion Topics

Scalable harvest vs command line harvest

We advise to use parallel batch harvest for now since scalable harvest can be easily deployed only on a single host (no cluster management, e.g. kubernetes is ready yet for the deployment of the scalable harvest).

API Errors (Patricia Lawton)

The PDS-API documentation (https://nasa-pds.github.io/pds-api) contains many example requests which do not work, mostly because the parameter's value are not encoded in the curl requests.

The documentation has been updated (for example https://nasa-pds.github.io/pds-api/guides/search/endpoints.html#) with working curl request.

A detailed review of the documentation will be done by Engineering Node to eliminate the errors or lack of clarity in the documentation.

Harvest Command line entry without having to update the configuration file for each bundle ?

A harvest configuration file can specify multiple bundles (see online doc) or a single directory being the parent of the multiple bundles (see online doc

Bulk Updates

EN will prepare on that for next workshop

Time out on Harvest (Dan Scholes)

Report on that at the next workshop.

EN will provide recommendations to avoid that for all the nodes (for example the Atlas Sky Surveys need to be supported by harvest by the end of year)

Improve Documentation Navigation

Need links that are well-publicized for user/contributor manual e.g., ​​ https://github.com/NASA-PDS/registry/wiki/Registry-Workshop---06-28-2022 Currently nasa-pds.github.io doesn’t link to much useful user/contributor documentations

Dictionary Issue (Irma Trejo)

Irma will send an email with the log errors that she is seeing.

Next workshop

Next workshop is scheduled 08-23-2022 at 10:05AM PDT

A document with the agenda and asking for topics to be discussed will be shared beforehand.

Clone this wiki locally