Skip to content

Commit

Permalink
docs: fix title for the decoding blog
Browse files Browse the repository at this point in the history
  • Loading branch information
wsxiaoys authored Oct 26, 2023
1 parent e08a08b commit 6e59aa8
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions website/blog/2023-10-21-incremental-decoding/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ tags: [tech design]

image: ./twitter-decoding.png
---
# Decoding the Decoding in Tabby
# Decode the Decoding in Tabby

In the context of the Transformer model, which is widely used across LLMs, ***decoding*** refers to the process of generating an output sequence from an encoded input. Tabby recenty [implemented ***incremental decoding***](https://github.com/TabbyML/tabby/pull/491) as part of the greedy search. This blog will explain our thoughts behind this πŸ› οΈπŸ’‘.

Expand Down Expand Up @@ -69,4 +69,4 @@ Incremental decoding: ......, 207, 211 -> "......[ hello]" βœ…

For interested folks, you can refer to Tabby's exact implementation in `IncrementalDecoding` funcion in [`creates/tabby-inference/src/decoding.rs`](https://github.com/TabbyML/tabby/pull/491).

Have you found our new decoding methods effective? Share your thoughts with us in our [Slack](https://join.slack.com/t/tabbyml/shared_invite/zt-22thejc0z-7ePKeWNCHPX31pEtnT4oYQ) channel 🌍😊!
Have you found our new decoding methods effective? Share your thoughts with us in our [Slack](https://join.slack.com/t/tabbyml/shared_invite/zt-22thejc0z-7ePKeWNCHPX31pEtnT4oYQ) channel 🌍😊!

0 comments on commit 6e59aa8

Please sign in to comment.