Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create shelves files for pds4 #57

Draft
wants to merge 42 commits into
base: main
Choose a base branch
from
Draft

Create shelves files for pds4 #57

wants to merge 42 commits into from

Commits on Dec 6, 2023

  1. Add validation directory (moved from rms-webtools repo)

    @juzen2003
    juzen2003 committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    2e94c7b View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2023

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    4be35d4 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    5e5fe97 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    fd70eb6 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    9f9c733 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    077c359 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    291555e View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    d195a79 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    1f762cb View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    92bd65c View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    205b9df View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Add command line tool to show opus products output with the given 

    absolute path of a filespec.
    @juzen2003
    juzen2003 committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    ab669f9 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    c7d84e5 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    a075bbc View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    428d727 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Merge remote-tracking branch 'origin/main' into create_shelves_files_… 

    …for_pds4
    @juzen2003
    juzen2003 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    fd4c7b6 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    756547c View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Merge remote-tracking branch 'origin/main'

    @juzen2003
    juzen2003 committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d2d3803 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into create_shelves_files_for_pds4

    @juzen2003
    juzen2003 committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a875899 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Create pds4 directory to store maintenance files for pds4.

    @juzen2003
    juzen2003 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    4ffbc45 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into create_shelves_files_… 

    …for_pds4
    @juzen2003
    juzen2003 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    4b9b154 View commit details
    Browse the repository at this point in the history

  3. Update pds4/pds4checksums.py so that checksum files can be created under 

    checksums-bundles directory for pds4
    @juzen2003
    juzen2003 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    cd66002 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Merge remote-tracking branch 'origin/main' into create_shelves_files_… 

    …for_pds4
    @juzen2003
    juzen2003 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    fe7c687 View commit details
    Browse the repository at this point in the history

  2. Update pds4/pds4infoshelf.py to create info sheleves files under 

    _infoshelf-bundles
    @juzen2003
    juzen2003 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ddbbb2a View commit details
    Browse the repository at this point in the history

  3. Removed the debug print statement in the pdsfile.py

    @juzen2003
    juzen2003 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    69bfd7a View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. Merge remote-tracking branch 'origin/main' into create_shelves_files_… 

    …for_pds4
    @juzen2003
    juzen2003 committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    cb08184 View commit details
    Browse the repository at this point in the history

  2. Create pds4/pds4indexshelf.py & pds4/pds4linkshelf.py

    @juzen2003
    juzen2003 committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    bc74047 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Update pds4linkshelf.py to make sure we can create files in 

    _linkshelf-* directory
    @juzen2003
    juzen2003 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    5509b5a View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Remove the code that bypass _support & ring_modeles when creating 

    checksums, infoshelf, and linkshelf files.
    @juzen2003
    juzen2003 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    b0a7944 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Add an intelligence to link a file to its correspsonding label if the 

    file is in that label's file_name tags. (line 323-336, pds4linkshelf.py)
    @juzen2003
    juzen2003 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    10b6743 View commit details
    Browse the repository at this point in the history

  2. Fixed the code indentation from line 112-428 in pds4linkshelf.py

    @juzen2003
    juzen2003 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    c3f1572 View commit details
    Browse the repository at this point in the history

  3. Add the intelligence to ignore files when there is no label at the same 

    directory (line 149-154, pds4linkshelf.py)
    @juzen2003
    juzen2003 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    0ef4578 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Add the intelligence to identify files like errata.txt, or checksum 

    files that don't exist in the label nor exist in the csv. They are not
part of the archive, so they don't have labels. (line 369-378 in
pds4linkshelf.py)
    @juzen2003
    juzen2003 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    3f3d2da View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. Separate BUNDLENAME* and BUNDLESET* regex, put them under PDS3 & PDS4 

    subclasses.
    @juzen2003
    juzen2003 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    a7c725d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into create_shelves_files_… 

    …for_pds4
    @juzen2003
    juzen2003 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    1890a8f View commit details
    Browse the repository at this point in the history

  3. Removed redundant BUNDLESET* and BUNDLENAME* regex for PDS3.

    @juzen2003
    juzen2003 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    e059710 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Change is_volume_dir to is_bundle_dir in pds4checksums.py

    @juzen2003
    juzen2003 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    d83b146 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Update read_links function in pds4linkshelf.py to capture file names 

    in the file_name tags and avoid capturing the file name in the title tag
of the label. This will prevent us from getting duplicated file name of
the LinkInfo object when the file name exists in the title tag.
    @juzen2003
    juzen2003 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    1c06fe9 View commit details
    Browse the repository at this point in the history

  2. Remove the commented out code in the read_links function of 

    pds4linkshelf.py.
    @juzen2003
    juzen2003 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    0eea1fe View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Update generate_links and improve its running time by: 

    - moving the intelligence to check if a file is in the file_name tag
  of a label. Now this step is done after checking whether the file
  is in the label_dict already.
- moving the intelligence to check if a file is in the collection csv
  files. Now this step is done right before raising an error when we
  can't find its corresponding label.
These two modifications can avoid unnecessary looping of linkinfo_dict
and collection_basename_dict.
    @juzen2003
    juzen2003 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b2fca02 View commit details
    Browse the repository at this point in the history

  2. Remove commented out logger.debug generate_links

    @juzen2003
    juzen2003 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    8fa331d View commit details
    Browse the repository at this point in the history

  3. At line 156-158 of pds4linkshelf.py, skip the empty entry of a csv file 

    when trying to parse each entry to get the basename of a file in the
archive.
    @juzen2003
    juzen2003 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    39639c6 View commit details
    Browse the repository at this point in the history