Discussions

• 1 You must be logged in to vote

  🙏

  iOS/Safari - continue generating text when closed - mostly solved with 1.58 (run in background)

  help wanted Extra attention is needed

  FrostyMisa asked Jan 23, 2024 in Q&A · Unanswered

  

  

  12
• 1 You must be logged in to vote

  💡

  Request: A termination/exit/shutdown command

  mirshalak started Feb 16, 2024 in Ideas

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does koboldcpp make use of tensor cores?

  VL4DST3R asked Feb 16, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Vulkan Question

  staberas asked Feb 15, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is MMQ supposed to speed up prompt processing on a single 3090?

  tmsingson asked Feb 13, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Quantum K Cache from LlamaCPP in KoboldCPP?

  Nexesenex started Jan 24, 2024 in Ideas

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Curious if the save and load of the story and scenario is possible to be directly loaded using llama.cpp args

  hgftrdw45ud67is8o89 asked Feb 9, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  ContextShift vs Smart Context

  VL4DST3R asked Feb 2, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙌

  Performance on Steam deck

  FrostyMisa started Jan 28, 2024 in Show and tell

  

  

  2
• 2 You must be logged in to vote

  💬

  Some of my benchmark for v1.56

  TheBill2001 started Jan 28, 2024 in General

  

  

  0
• 4 You must be logged in to vote

  🙏

  ggml-cuda was compiled without support for the current GPU architecture. WSL error

  KraiiFox asked Jan 6, 2024 in Q&A · Unanswered

  

  

  

  

  9
• 1 You must be logged in to vote

  🙏

  Multiple instances?

  dreemur99 asked Jan 21, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Detokenize API endpoint

  neCo2 asked Jan 18, 2024 in Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Group chat example?

  BarfingLemurs asked Jan 10, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  MacOS Metal --gpulayers setting question

  wilsonics asked Jan 4, 2024 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Running from an extracted path

  courrier1 started Dec 26, 2023 in General

  

  

  6
• 1 You must be logged in to vote

  🙏

  Settiing the number of Mixtral MOE Experts

  tmsingson asked Dec 23, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  launch and configure kobold via python code

  madrooky asked Dec 16, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Trying to run this locally

  ldericher asked Dec 14, 2023 in Q&A · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  Optimizing Performance of Internal Horde Worker?

  CallMeAl1973 asked Dec 10, 2023 in Q&A · Unanswered

  

  

  8
• 1 You must be logged in to vote

  💡

  Save State (not just json)

  dreemur99 started Dec 14, 2023 in Ideas

  

  

  1
• 1 You must be logged in to vote

  💬

  Hey, HI! My novel front end consumes your api. Can we be friends?

  aseichter2007 started Nov 26, 2023 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  What's the intended string format for grammars for endpoints?

  Calandiel asked Nov 17, 2023 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  CPU usage drops only on the "generating" part.

  silmarine asked Nov 7, 2023 in Q&A · Answered

  

  

  6
• 1 You must be logged in to vote

  💬

  rocm fork very slow on some/large models (goliath q3_k_s)

  ChristophHaag started Nov 15, 2023 in General

  

  

  0