Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merging all changes to the IMBG-refactoring to the main branch #4

Open
wants to merge 109 commits into
base: main
Choose a base branch
from

Commits on Jun 28, 2024

  1. Configuration menu
    Copy the full SHA
    b9afcf9 View commit details
    Browse the repository at this point in the history
  2. add test suite skeleton

    d-goryslavets committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    1d2aabb View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Configuration menu
    Copy the full SHA
    9ed44a1 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. minimal refactoring. add tmp_dir config. add mk43_ prefix to shared i…

    …ntermediate files and output files.
    mkrooted256 committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    117b2d1 View commit details
    Browse the repository at this point in the history
  2. draft of a get_path util

    mkrooted256 committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    df04bd0 View commit details
    Browse the repository at this point in the history
  3. successful 2.1. replace + with os.path.join. annotate hardcoded paths…

    …. add WES_CONFIG env var to specify config file programmatically. make header file optional.
    mkrooted256 committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    268affd View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Configuration menu
    Copy the full SHA
    8354844 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0023053 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5890acd View commit details
    Browse the repository at this point in the history
  4. cleanup 1.1

    mkrooted256 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    f77d107 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. first attempts

    mkrooted256 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    7bec087 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Configuration menu
    Copy the full SHA
    2cdf407 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. add todo

    mkrooted256 committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    68c2413 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. upload documentation

    lbombini committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    1412199 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    73a6373 View commit details
    Browse the repository at this point in the history
  3. change string concat to os.path.join in steps 1-2, make some function…

    …s in step 2 return mts and change spark init way
    d-goryslavets committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    efab22d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e2cf204 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    261ac9b View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    052ee3d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    b5329a8 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    1990d99 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. Finish config refactoring for 2.1.

    Adopt path_spark. remove file:// paths from config. Add example cvar usage.
    mkrooted256 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    f02b394 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. update the docs

    lbombini committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    e6c5f64 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'imbg-refactoring' of https://github.com/wtsi-hgi/wes-qc

    …into imbg-refactoring
    lbombini committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    10a28fa View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. fix the code blocks

    lbombini committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    835f77a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6ee2fcb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0de9822 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2024

  1. Configuration menu
    Copy the full SHA
    ffe66fd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3b8fb10 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    adfc9c1 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Configuration menu
    Copy the full SHA
    c44116a View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Configuration menu
    Copy the full SHA
    7790826 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. revert stratified_sample_qc to be general

    do identical sample QC for all population (no difference between AFR and others)
    y-popov committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    1beef0f View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Configuration menu
    Copy the full SHA
    9e05cee View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f24d3e2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0a4d776 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Merge pull request #1 from wtsi-hgi/fix-2.4

    Change `stratified_sample_qc`
    d-goryslavets authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    55bd50c View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Configuration menu
    Copy the full SHA
    1404f95 View commit details
    Browse the repository at this point in the history
  2. Refactor 2.2. Minor change in config naming. Change config fields ann…

    …otation style. Add new dict utils
    mkrooted256 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    36e6588 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    32ad76a View commit details
    Browse the repository at this point in the history
  4. integrate tesr data download

    lbombini committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    3001b1c View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Configuration menu
    Copy the full SHA
    4d3635f View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Configuration menu
    Copy the full SHA
    5e956b7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c11b704 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    090b5b7 View commit details
    Browse the repository at this point in the history
  4. refactor step 2.3

    d-goryslavets committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    80f0c01 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    58074c4 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    42a0972 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    ac10add View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Configuration menu
    Copy the full SHA
    721f5f6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    469b6b4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f1a6b36 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8d81160 View commit details
    Browse the repository at this point in the history
  5. fix config and add ref_mtdir

    lbombini committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    99151ea View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Merge branch 'mk43/refactor-hardcoded-config/2.5' of https://github.c…

    …om/wtsi-hgi/wes-qc into mk43/refactor-hardcoded-config/2.5
    lbombini committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    0f7b5b1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b26eb21 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Merge branch 'dh24/refactor-hardcoded-config/2.3' into imbg-refactori…

    …ng (includes refactored steps 2.2-2.3)
    d-goryslavets committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    0874a4b View commit details
    Browse the repository at this point in the history
  2. Merge branch 'vk11/refactor-unit-test/2.3' into imbg-refactoring, upd…

    … download from s3 and refactor var names
    d-goryslavets committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    635a6ed View commit details
    Browse the repository at this point in the history
  3. minor fixes to run 2.4 test

    lbombini committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    240995d View commit details
    Browse the repository at this point in the history
  4. Merge branch 'mk43/refactor-hardcoded-config/2.5' into imbg-refactori…

    …ng (includes refactored steps 2.4-2.5)
    d-goryslavets committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    9ca3f28 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    15a995e View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Configuration menu
    Copy the full SHA
    d606ccc View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Configuration menu
    Copy the full SHA
    de8c82e View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. add test data downloading from s3 to integration tests, upd configs, …

    …fix errors in main functions caused by wrong param names
    d-goryslavets committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    c2100da View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cf2d327 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6cdf3ab View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Configuration menu
    Copy the full SHA
    b1f45c3 View commit details
    Browse the repository at this point in the history
  2. step 3.2: extract hardcoded params and add path type adapters for tri…

    …os and non-trios scripts separately
    d-goryslavets committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    4dd26f6 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Configuration menu
    Copy the full SHA
    b2fed93 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9c770a5 View commit details
    Browse the repository at this point in the history
  3. Merge branch 'mk43/new-config-parser' into mk43/parser/v2.0-pre

    (and remove a flattened config parser)
    mkrooted256 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c84c2de View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d6419d2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    445219d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    e6f968b View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Configuration menu
    Copy the full SHA
    1b37f73 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3122a1e View commit details
    Browse the repository at this point in the history
  3. steps 3.4-3.9: add missing path adapters, fix incorrect paths, refact…

    …or non-trios case, create variant qc random forest result folder in test suite
    d-goryslavets committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    2f71069 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Configuration menu
    Copy the full SHA
    04892e1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1c67082 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d1ae745 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    09fee1e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    6d291b5 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. add step 3 integration tests

    lbombini committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    3bf274c View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Configuration menu
    Copy the full SHA
    6df11c8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b8f12f0 View commit details
    Browse the repository at this point in the history
  3. switch to http-based test data downloading in unit tests; fix incorre…

    …ct input in test_2_3_5_predict_pops
    d-goryslavets committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    ace32eb View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    afe7460 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Configuration menu
    Copy the full SHA
    f2a98fe View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    504d3a9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    831f558 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a47837a View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    15d9742 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    3afeaa1 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    8b0e7b5 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    0f12c2f View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    03cea82 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Configuration menu
    Copy the full SHA
    88f98ef View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c270e9b View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. adjust variant qc scripts

    y-popov committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    0613997 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. refactor evaluation script

    y-popov committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    2112dad View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e720546 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Configuration menu
    Copy the full SHA
    0a1defa View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Configuration menu
    Copy the full SHA
    d802b70 View commit details
    Browse the repository at this point in the history
  2. more robust path join

    y-popov committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    c23ce27 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Merge pull request #2 from wtsi-hgi/ip13-1kg-trio-test

    Changes to run manual tests on 1kg data with trios
    d-goryslavets authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    3793952 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Configuration menu
    Copy the full SHA
    0bd3b8d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    bd5bbe1 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Configuration menu
    Copy the full SHA
    6a7e641 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7fca5f9 View commit details
    Browse the repository at this point in the history