Skip to content

Commit

Permalink
upgrade to llama3.3 70B
Browse files Browse the repository at this point in the history
  • Loading branch information
gabrielchua authored Dec 7, 2024
1 parent 6f81c66 commit 704569b
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ short_description: Personalised Podcasts For All - Available in 13 Languages
This project is inspired by the NotebookLM tool, and implements it with open-source LLMs and text-to-speech models. This tool processes the content of a PDF, generates a natural dialogue suitable for an audio podcast, and outputs it as an MP3 file.

Built with:
- [Llama 3.1 405B πŸ¦™](https://huggingface.co/meta-llama/Llama-3.1-405B) via [Fireworks AI πŸŽ†](https://fireworks.ai/) and [Instructor πŸ“](https://github.com/instructor-ai/instructor)
- [Llama 3.3 70B πŸ¦™](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) via [Fireworks AI πŸŽ†](https://fireworks.ai/) and [Instructor πŸ“](https://github.com/instructor-ai/instructor)
- [MeloTTS 🐚](https://huggingface.co/myshell-ai/MeloTTS-English)
- [Bark 🐢](https://huggingface.co/suno/bark)
- [Jina Reader πŸ”](https://jina.ai/reader/)
Expand Down Expand Up @@ -53,7 +53,7 @@ To set up the project, follow these steps:
## Usage

1. **Set up API Key(s):**
For this project, I am using LLama 3.1 405B hosted on Fireworks API as its JSON Mode supports passing a pydantic object. So, please set the API key as the `FIREWORKS_API_KEY` environment variable
For this project, I am using LLama 3.3 70B hosted on Fireworks API as its JSON Mode supports passing a pydantic object. So, please set the API key as the `FIREWORKS_API_KEY` environment variable

2. **Run the application:**
```bash
Expand Down
4 changes: 2 additions & 2 deletions constants.py
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@
# Fireworks API-related constants
FIREWORKS_API_KEY = os.getenv("FIREWORKS_API_KEY")
FIREWORKS_MAX_TOKENS = 16_384
FIREWORKS_MODEL_ID = "accounts/fireworks/models/llama-v3p1-405b-instruct"
FIREWORKS_MODEL_ID = "accounts/fireworks/models/llama-v3p3-70b-instruct"
FIREWORKS_TEMPERATURE = 0.1

# MeloTTS
Expand Down Expand Up @@ -78,7 +78,7 @@
Generate Podcasts from PDFs using open-source AI.
Built with:
- [Llama 3.1 405B πŸ¦™](https://huggingface.co/meta-llama/Llama-3.1-405B) via [Fireworks AI πŸŽ†](https://fireworks.ai/) and [Instructor πŸ“](https://github.com/instructor-ai/instructor)
- [Llama 3.3 70B πŸ¦™](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) via [Fireworks AI πŸŽ†](https://fireworks.ai/) and [Instructor πŸ“](https://github.com/instructor-ai/instructor)
- [MeloTTS 🐚](https://huggingface.co/myshell-ai/MeloTTS-English)
- [Bark 🐢](https://huggingface.co/suno/bark)
- [Jina Reader πŸ”](https://jina.ai/reader/)
Expand Down

0 comments on commit 704569b

Please sign in to comment.