Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

512 Open 696 Closed
512 Open 696 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Publish the latest llama.cpp?
#1951 opened Feb 27, 2025 by curvedinf
cannot pip install
#1950 opened Feb 27, 2025 by wenlanzhang
DeepSeek-R1-Distill-Qwen-1.5B inference answer is wrong
#1949 opened Feb 27, 2025 by jhxiang
successfully installed !! CUDA/v12.6 !! Visual Studio 2022!!
#1948 opened Feb 26, 2025 by dw5189
ERROR: Failed building wheel for llama-cpp-python Failed to build llama-cpp-python ERROR: Could not build wheels for llama-cpp-python which use PEP 517 and cannot be installed directly
#1947 opened Feb 26, 2025 by ArmsNorton
3
The results generated are different from those produced by executing commands with the llama cpp library
#1946 opened Feb 25, 2025 by HengruiZYP
4 tasks done
OK!!! ggml_cuda_init: found 1 CUDA devices:
#1945 opened Feb 24, 2025 by dw5189
CUDA Memory Allocation Failure and mlock Memory Lock Issue in llama-cpp-python
#1944 opened Feb 24, 2025 by caiyuanhangDicp
CMake build failed //Building wheel for llama-cpp-python (pyproject.toml) ... error
#1943 opened Feb 23, 2025 by dw5189
2
Current vendored llama.cpp won't build with MSVC 17.13
#1942 opened Feb 22, 2025 by Janzert
3
-- CUDA Toolkit found
#1941 opened Feb 21, 2025 by dw5189
No GPU usage, occupied VRAM but only CPU is working
#1939 opened Feb 18, 2025 by 0xb1te
8
Specifying additional_files for model files in directory adds additional copy of directory to download URL
#1938 opened Feb 17, 2025 by zhudotexe
4 tasks done
Segmentation fault when converting embeddings into tensor
#1937 opened Feb 17, 2025 by devashishraj
Getting seg faults intermittently prior to streaming generation
#1936 opened Feb 17, 2025 by ekcrisp
Using OpenBlas to accelerate has no effect？
#1935 opened Feb 17, 2025 by buptmengjj
I cannot install this package with cuda12.4
#1933 opened Feb 13, 2025 by BoogonClothman
3
Failed building wheel for llama-cpp-python
#1932 opened Feb 12, 2025 by pklochowicz
3
llama.cpp transfer
#1931 opened Feb 11, 2025 by d-kleine
Please release a cuda build for v0.3.5
#1925 opened Feb 7, 2025 by ParisNeo
9
Installing Llama cpp python on Debian with no git installed throws an error
#1924 opened Feb 7, 2025 by ekcrisp
Unable to Build llama-cpp-python with Vulkan (Core Dump on Model Load)
#1923 opened Feb 6, 2025 by Talnz007
Distributed Inference
#1921 opened Feb 5, 2025 by lipere123
1
Macos Metal Github Release for python 3.12 is broken
#1918 opened Feb 4, 2025 by haixuanTao
See No CUDA toolset found log after -- CUDA Toolkit found. log
#1917 opened Feb 3, 2025 by TomaszDlubis
1
ProTip! Exclude everything labeled bug with -label:bug.