Skip to content

Test Constrained Decoding Libraries for LLM output

Notifications You must be signed in to change notification settings

alexanderchen750/CDTool

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

CDTool

CDTool is in-development a tool meant to test grammar constriants of different constrained-decoding libraries. Current plans for the tool are that user can choose a local model, constrained-decoding library, and grammar, and generate output of that grammar with insight into logit probabilites and parsing tree.

Setup

Currently only have basic UI.

To set up, run in terminal

git clone https://github.com/alexanderchen750/CDTool.git
cd frontend
npm install
npm run dev

About

Test Constrained Decoding Libraries for LLM output

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published