Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update khmer #49276

Open
wants to merge 68 commits into
base: master
Choose a base branch
from
Open

update khmer #49276

wants to merge 68 commits into from

Conversation

lskatz
Copy link
Contributor

@lskatz lskatz commented Jul 15, 2024

khmer does not play well with python 3.12 and so I have updated the requirement. More information: dib-lab/khmer#1927


Please read the guidelines for Bioconda recipes before opening a pull request (PR).

General instructions

  • If this PR adds or updates a recipe, use "Add" or "Update" appropriately as the first word in its title.
  • New recipes not directly relevant to the biological sciences need to be submitted to the conda-forge channel instead of Bioconda.
  • PRs require reviews prior to being merged. Once your PR is passing tests and ready to be merged, please issue the @BiocondaBot please add label command.
  • Please post questions on Gitter or ping @bioconda/core in a comment.

Instructions for avoiding API, ABI, and CLI breakage issues

Conda is able to record and lock (a.k.a. pin) dependency versions used at build time of other recipes.
This way, one can avoid that expectations of a downstream recipe with regards to API, ABI, or CLI are violated by later changes in the recipe.
If not already present in the meta.yaml, make sure to specify run_exports (see here for the rationale and comprehensive explanation).
Add a run_exports section like this:

build:
  run_exports:
    - ...

with ... being one of:

Case run_exports statement
semantic versioning {{ pin_subpackage("myrecipe", max_pin="x") }}
semantic versioning (0.x.x) {{ pin_subpackage("myrecipe", max_pin="x.x") }}
known breakage in minor versions {{ pin_subpackage("myrecipe", max_pin="x.x") }} (in such a case, please add a note that shortly mentions your evidence for that)
known breakage in patch versions {{ pin_subpackage("myrecipe", max_pin="x.x.x") }} (in such a case, please add a note that shortly mentions your evidence for that)
calendar versioning {{ pin_subpackage("myrecipe", max_pin=None) }}

while replacing "myrecipe" with either name if a name|lower variable is defined in your recipe or with the lowercase name of the package in quotes.

Bot commands for PR management

Please use the following BiocondaBot commands:

Everyone has access to the following BiocondaBot commands, which can be given in a comment:

@BiocondaBot please update Merge the master branch into a PR.
@BiocondaBot please add label Add the please review & merge label.
@BiocondaBot please fetch artifacts Post links to CI-built packages/containers.
You can use this to test packages locally.

Note that the @BiocondaBot please merge command is now depreciated. Please just squash and merge instead.

Also, the bot watches for comments from non-members that include @bioconda/<team> and will automatically re-post them to notify the addressed <team>.

@dr-joe-wirth
Copy link
Contributor

oops. looks like i duplicated this in PR #49350. maybe this PR should be closed?

@rpetit3
Copy link
Member

rpetit3 commented Jul 17, 2024

closing in favor of the merged #49350

@rpetit3 rpetit3 closed this Jul 17, 2024
@rpetit3
Copy link
Member

rpetit3 commented Jul 17, 2024

reopening, since it looks like we'll need it

@rpetit3 rpetit3 reopened this Jul 17, 2024
@dr-joe-wirth
Copy link
Contributor

tests passed, but it didn't actually build anything.

@dr-joe-wirth
Copy link
Contributor

i have a hunch that the problem is with the patch. the highest release that the khmer github page lists is 2.1.2. i'm not sure where the 3.0+ versions are coming from other than the patch.

@aliciaaevans
Copy link
Contributor

I made PR #49494 just to update the build failure file (recipes/khmer/build_failure.linux-64.yaml) on master so it doesn't try to build it on the nightly in the current broken state, but that build_failure file can be removed on this branch once my PR is merged to master and then this branch updated from master.

@dr-joe-wirth
Copy link
Contributor

dr-joe-wirth commented Aug 6, 2024

not sure why this is failing, but it looks like a certain folder (src) isn't being found. here is the relevant output from the bioconda test.

.18:54:44 BIOCONDA INFO (OUT)   /opt/conda/conda-bld/khmer_1722279080981/_build_env/bin/x86_64-conda-linux-gnu-c++ -shared -Wl,--allow-shlib-undefined -Wl,-rpath,/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -Wl,-rpath-link,/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -L/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -Wl,--allow-shlib-undefined -Wl,-rpath,/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -Wl,-rpath-link,/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -L/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined -Wl,-rpath,/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -Wl,-rpath-link,/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -L/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/include -fdebug-prefix-map=/opt/conda/conda-bld/khmer_1722279080981/work=/usr/local/src/conda/khmer-3.0.0a3 -fdebug-prefix-map=/opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho=/usr/local/src/conda-prefix -DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /opt/conda/conda-bld/khmer_1722279080981/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/include build/temp.linux-x86_64-cpython-38/khmer/_oxli/oxli_exception_convert.o build/temp.linux-x86_64-cpython-38/khmer/_oxli/utils.o build/temp.linux-x86_64-3.8/src/khmer/_cpy_khmer.o build/temp.linux-x86_64-3.8/src/khmer/_cpy_utils.o build/temp.linux-x86_64-3.8/src/khmer/_cpy_readparsers.o build/temp.linux-x86_64-3.8/src/oxli/read_parsers.o build/temp.linux-x86_64-3.8/src/oxli/kmer_hash.o build/temp.linux-x86_64-3.8/src/oxli/hashtable.o build/temp.linux-x86_64-3.8/src/oxli/hashgraph.o build/temp.linux-x86_64-3.8/src/oxli/labelhash.o build/temp.linux-x86_64-3.8/src/oxli/subset.o build/temp.linux-x86_64-3.8/src/oxli/read_aligner.o build/temp.linux-x86_64-3.8/src/oxli/hllcounter.o build/temp.linux-x86_64-3.8/src/oxli/traversal.o build/temp.linux-x86_64-3.8/src/oxli/kmer_filters.o build/temp.linux-x86_64-3.8/src/oxli/assembler.o build/temp.linux-x86_64-3.8/src/oxli/alphabets.o build/temp.linux-x86_64-3.8/src/oxli/storage.o build/temp.linux-x86_64-3.8/third-party/smhasher/MurmurHash3.o third-party/cqf/gqf.o -lz -lbz2 -o build/lib.linux-x86_64-cpython-38/khmer/_oxli/utils.cpython-38-x86_64-linux-gnu.so -fopenmp
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/khmer/_cpy_khmer.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/khmer/_cpy_utils.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/khmer/_cpy_readparsers.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/read_parsers.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/kmer_hash.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/hashtable.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/hashgraph.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/labelhash.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/subset.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/read_aligner.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/hllcounter.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/traversal.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/kmer_filters.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/assembler.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/alphabets.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/src/oxli/storage.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   x86_64-conda-linux-gnu-c++: error: build/temp.linux-x86_64-3.8/third-party/smhasher/MurmurHash3.o: No such file or directory
18:54:44 BIOCONDA INFO (OUT)   error: command '/opt/conda/conda-bld/khmer_1722279080981/_build_env/bin/x86_64-conda-linux-gnu-c++' failed with exit code 1
18:54:44 BIOCONDA INFO (OUT)   error: subprocess-exited-with-error

@dr-joe-wirth
Copy link
Contributor

For whatever reason, it cannot find the directory where the included header files for seqan live. When I install seqan using an environment file locally, the header files are in the directory <env name>/include/seqan. I thought this might be euivalent to lib because that is also where zlib.h and bzlib.h live.

@dr-joe-wirth
Copy link
Contributor

giving up for now. khmer compiles but does not run. gzerror is an undefined symbol at runtime...prob has something to do with the fact that third-party/zlib appears to be static linked in the setup.py file, but we want it to link to conda-installed zlib instead of relying on the third-party directory as this would be more stable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants