Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 5
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

343 Open 4,265 Closed
343 Open 4,265 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Eval bug: In RISC-V, output tokens are broken bug-unconfirmed
#12124 opened Mar 1, 2025 by op21beyond
Eval bug: Error running Phi4-mini gguf: unknown pre-tokenizer type: 'gpt-4o' bug-unconfirmed
#12122 opened Mar 1, 2025 by crisdesivo
Misc. bug: Server web UI: Complete output is lost due to the „normal“ context shift message bug-unconfirmed
#12120 opened Feb 28, 2025 by Optiuse
Feature Request: Support for Phi4MMForCausalLM Architecture enhancement New feature or request
#12117 opened Feb 28, 2025 by ns3284
4 tasks done
2
Misc. bug: While running llama-simple-chat, it throws "context size exceeded" bug-unconfirmed
#12113 opened Feb 28, 2025 by emmetra
Eval bug: llama-cpp-deepseek-r1.jinja template will miss the <think> tag bug-unconfirmed
#12107 opened Feb 28, 2025 by Sherlock-Holo
1
Regarding llama-bench and llama-parallel commands
#12106 opened Feb 28, 2025 by vineelabhinav
Misc. bug: When using streaming output, if stream_options={"include_usage": True} is not set, the returned result should not include usage stats bug-unconfirmed
#12102 opened Feb 28, 2025 by allenz92
Compile bug: fatal error: 'ggml.h' file not found bug-unconfirmed
#12101 opened Feb 28, 2025 by peekaboolabs-appdev
Eval bug: llama.cpp returns gibberish on Intel Core Ultra 7 (155H) with ARC iGPU bug-unconfirmed
#12096 opened Feb 27, 2025 by cgruver
15
Compile bug: Failed to compile on centos8 system bug-unconfirmed
#12092 opened Feb 27, 2025 by hbuxiaofei
Compile bug: How to build llama.android example with -DGGML_VULKAN=ON through android studio. bug-unconfirmed
#12085 opened Feb 26, 2025 by gaykawadpk
Misc. bug: Loop range computation question of Vulkan matmul shaders bug-unconfirmed
#12082 opened Feb 26, 2025 by blurSong
1
Eval bug: getting assertion error when trying to use a gguf quantized model at inference "GGML_ASSERT(n_outputs_enc > 0 && "call llama_encode() first") failed" bug-unconfirmed
#12080 opened Feb 26, 2025 by Vedapani0402
1
Eval bug: MUSA error: operation not supported bug-unconfirmed
#12077 opened Feb 26, 2025 by yeungtuzi
3
Misc. bug: llama-cli llama_backend_free may not free all the gpu memory bug-unconfirmed
#12057 opened Feb 25, 2025 by GaoXiangYa
3
Misc. bug: cannot scroll to right side when input too long bug-unconfirmed
#12054 opened Feb 24, 2025 by gnusupport
Eval bug: granite-vision-3.1-2b-preview ERROR:hf-to-gguf:Model LlavaNextForConditionalGeneration is not supported bug-unconfirmed
#12053 opened Feb 24, 2025 by gnusupport
6
Compile bug: llama.cpp-b4749/ggml/src/ggml-cpu/ggml-cpu-quants.c:5141:26: error: initialization of ‘uint32_t *’ {aka ‘unsigned int *’} from incompatible pointer type ‘const uint8_t (*)[12]’ {aka ‘const unsigned char (*)[12]’} [-Wincompatible-pointer-types] bug-unconfirmed
#12050 opened Feb 24, 2025 by Arniiiii
Misc. bug: ggml-backend.cpp:746: pre-allocated tensor (cache_k_l0 (view) (copy of cache_k_l0 (view))) in a buffer (Vulkan0) that cannot run the operation (CPY) bug-unconfirmed
#12045 opened Feb 24, 2025 by simonchen
1
Eval bug: TikTokenTokenizer has no attribute vocab bug-unconfirmed
#12044 opened Feb 24, 2025 by zhanghui-china
5
Eval bug: Error when converting moonlight from bf16 to q4km bug-unconfirmed
#12040 opened Feb 23, 2025 by qiyuxinlin
2
Misc. bug: --no-context-shift OR --context-shift ? bug-unconfirmed
#12038 opened Feb 23, 2025 by simonchen
1
llama-cli misbehaving (changed?)
#12036 opened Feb 23, 2025 by 0wwafa
2
Misc. bug: Web-UI now unusably slow - over network or locally. bug-unconfirmed
#12026 opened Feb 22, 2025 by clort81
5
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.