Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add in SILO docker-compose and importer utils #58

Open
wants to merge 17 commits into
base: dev
Choose a base branch
from
Open

Add in SILO docker-compose and importer utils #58

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
7b2e495
stash state of SILO ww_test for demo
Dec 17, 2024
c9b0ef7
corrected version of ww_test
Taepper Dec 18, 2024
6d6d187
enhancing the ReadMe with Prerequisites
Jan 24, 2025
d2e80e3
add swagger ui comment
Jan 24, 2025
998caf5
update docker compose due to breaking changes in SILO 0.5 and fix ver…
Taepper Jan 29, 2025
a7e90f4
first version
Taepper Mar 3, 2025
38b9674
splitter and merger for sorting files
Taepper Mar 3, 2025
bb2a424
clean up code paths
Taepper Mar 5, 2025
caa124e
consistent naming
Taepper Mar 5, 2025
2415fe3
create output dir if not present
Taepper Mar 5, 2025
9444788
Use Path::exists instead of fs::exists
Taepper Mar 5, 2025
7cafd7f
process batches in parallel
Taepper Mar 5, 2025
f4c2508
use proper Args struct from clap
Taepper Mar 5, 2025
b4fe4c7
working solution without manual thread pooling
Taepper Mar 5, 2025
88c1c0e
limit rayon threads to user provided value, if supplied
Taepper Mar 5, 2025
360561b
also create parent directories if missing
Taepper Mar 5, 2025
4c0f608
fix incomplete paths of last chunk
Taepper Mar 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -148,3 +148,7 @@ results

# Snakemake
.snakemake/

# Rust
/target
/.idea/
Loading
Loading