llm-mysteries

Highlights

Attempt 1

Base lines are generated by main and main_gpt.

Attempt 2

graph asks the LLM for exonerating and incriminating evidence for each suspect and symbolically combines the result.

Attempt 3

Inspired by LMs for Rationality,

mystery transforms a belief graph into a MaxSAT problem to be optimized for debugging consistency;
belief_graph elicits a belief graph for a story.

Libraries

Truth-Maintenance System

tms is a basic probabilistic Truth-Maintenance System (TMS) with a MaxSAT backend.
- tms_z3 is the Z3 backend.
- tms_rc2 is the RC2 backend.
- tms_mystery is mystery re-written to use the TMS.

Installation

In this repo

git submodule init
git submodule update

Python env

pip install git+https://github.com/huggingface/transformers.git
pip install "outlines @ git+https://github.com/outlines-dev/outlines.git@main"
pip install z3-solver
pip install python-sat