This script is a launcher for the Text Generation WebUI project, which provides an easy-to-use interface for generating text using pre-trained language models.
- Automatic updating of the WebUI
- Customizable settings through command-line options
- Support for LLaMA models and other popular language models
- Streaming text output (optional)
- Chatbot mode and Notebook mode
- Sharing options and authentication support
- Conda environment management
- Clone the Text Generation WebUI repository and follow the installation instructions.
- Save this script to a file, e.g.,
launch_webui.sh
, in your preferred directory. - Make the script executable with
chmod +x launch_webui.sh
. - Execute the script using
./launch_webui [OPTIONS]
.
-h, --help
: Display the help message and exit.-s, --stream
: Enable streaming text output.-C, --cai-chat, --cai_chat
: Enable chatbot mode.-N, --notebook
: Enable notebook mode.--settings-file
: Specify the path to the settings file.-t, --threads <NUM_THREADS>
: Set the number of threads (0-16).-m, --model <MODEL_NAME>
: Set the model name.--model-dir
: Set the model directory.--webui-path
: Set the webui path.--conda-env
: Set the conda environment.-U, --update
: Check for updates and exit.
This script requires the Text Generation WebUI to be installed and set up. Make sure you have followed the instructions in the repository before using this script.
This script is provided under the same license as the Text Generation WebUI project.