A Python client for secure AI model inference through Tinfoil.
pip install tinfoil
from tinfoil import TinfoilAI
client = TinfoilAI(
enclave="inference.delta.tinfoil.sh",
repo="tinfoilsh/provably-private-deepseek-r1",
api_key="<API_KEY>",
)
chat_completion = client.chat.completions.create(
messages=[
{
"role": "user",
"content": "Hi",
}
],
model="deepseek-r1:70b",
)
print(chat_completion.choices[0].message.content)
- Linux (amd64), MacOS 13 (Intel), or MacOS 14 (Apple Silicon)
- CPython 3.10 through 3.13