Skip to content

tinfoilsh/tinfoil-python

Repository files navigation

Tinfoil Python Library

PyPI - Version

A Python client for secure AI model inference through Tinfoil.

Installation

pip install tinfoil

Usage

from tinfoil import TinfoilAI

client = TinfoilAI(
    enclave="inference.delta.tinfoil.sh",
    repo="tinfoilsh/provably-private-deepseek-r1",
    api_key="<API_KEY>",
)

chat_completion = client.chat.completions.create(
    messages=[
        {
            "role": "user",
            "content": "Hi",
        }
    ],
    model="deepseek-r1:70b",
)
print(chat_completion.choices[0].message.content)

Requirements

  • Linux (amd64), MacOS 13 (Intel), or MacOS 14 (Apple Silicon)
  • CPython 3.10 through 3.13