New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

update HowToRun_vLLM_Models.md #165

Open

tstescoTT opened this issue Jan 31, 2025 · 0 comments

Contributor

tstescoTT commented Jan 31, 2025

The instructions in HowToRun_vLLM_Models.md also need to be updated to:

reflect changes to the new .env procedures (no more HF_TOKEN and no more copying the file)
reflect how the process needs to be done for the Llama herd

Other than that I was able to run all the new Llama herds! (didn't try 3.3-70B)

Originally posted by @bgoelTT in #164 (review)

tstescoTT mentioned this issue

Llama 3.x integration using new setup.sh and LLM code base #164

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment