🎯 Always available expertise powered by AI
🚧 Warning: Under Heavy Construction.🚧
Input: Your Data | ➡️ | Output: Your Model |
---|---|---|
➡️ |
This project has 2 goals:
- 🧠 Educate: Empower builders by providing a comprehensive, step-by-step guide on how to develop their own AI language models
- 🚀 Ship: Versatile end-to-end framework for quickly generating open-source AI language models with expertise in diverse domains
List of included projects with completed guide, code, models, and datasets:
Step by step guide to generate your own AI language models from scratch & deploy to production.
- Data Generation
- YouTube Playlist
- Training
- Axolotl
- H2O LLM Studio
- Testing
- oobabooga/text-generation-webui
- Axolotl
- H2O LLM Studio
- Python
- Optimizating
- Quantization
- AutoGPTQ
- GPTQ-for-LLaMa
- ExLLaMa
- Deployment
- Replicate
- Runpod
- Huggingface
Let's get started.
Disclaimer: These datasets (e.g. from YouTube) and models (e.g. LLaMA) are intended for non-commercial research and educational purposes only. Feel free to edit the source code to suit your needs to generate models with your own data.