Skip to content

Commit

Permalink
add dependencies
Browse files Browse the repository at this point in the history
  • Loading branch information
0xshawn committed Nov 2, 2024
1 parent a3880fe commit 9101c81
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,16 @@ FROM vllm-base AS vllm-openai

# install additional dependencies for openai api server
RUN --mount=type=cache,target=/root/.cache/pip \
pip install accelerate hf_transfer 'modelscope!=1.15.0'
pip install accelerate hf_transfer 'modelscope!=1.15.0' \
nv-local-gpu-verifier bitsandbytes>=0.42.0

# This way failed
# RUN add-apt-repository -y ppa:kobuk-team/tdx-attestation-release \
# && apt install -y libtdx-attest-dev

# This way failed too
RUN cd /tmp/ && git clone https://github.com/canonical/tdx \
&& cd tdx/attestation && ./setup-attestation-guest.sh

ENV VLLM_USAGE_SOURCE production-docker-image

Expand Down

0 comments on commit 9101c81

Please sign in to comment.