Skip to content

Latest commit

 

History

History
41 lines (32 loc) · 1.73 KB

developer_cookbook.md

File metadata and controls

41 lines (32 loc) · 1.73 KB

Llama Stack Developer Cookbook

Based on your developer needs, below are references to guides to help you get started.

Hosted Llama Stack Endpoint

  • Developer Need: I want to connect to a Llama Stack endpoint to build my applications.
  • Effort: 1min
  • Guide:
    • Checkout our DeepLearning course on building with Llama Stack apps on pre-hosted Llama Stack endpoint.

Local meta-reference Llama Stack Server

  • Developer Need: I want to start a local Llama Stack server with my GPU using meta-reference implementations.
  • Effort: 5min
  • Guide:

Llama Stack Server with Remote Providers

  • Developer need: I want a Llama Stack distribution with a remote provider.
  • Effort: 10min
  • Guide

On-Device (iOS) Llama Stack

  • Developer Need: I want to use Llama Stack on-Device
  • Effort: 1.5hr
  • Guide:

Assemble your own Llama Stack Distribution

  • Developer Need: I want to assemble my own distribution with API providers to my likings
  • Effort: 30min
  • Guide
    • Please see our Building Distribution guide for assembling your own Llama Stack distribution with your choice of API providers.

Adding a New API Provider

  • Developer Need: I want to add a new API provider to Llama Stack.
  • Effort: 3hr
  • Guide