Building Speaches: Stuck due to uv install on system python environment

[JonnyTran]

Hi,

I'm trying to build Speaches for STT and TTS integration with OpenWebUI and Ollama. Since it uses faster-whisper backend, I figured I would be able to extend the base image faster-whisper to build speaches from their Dockerfile.

This has proved very difficult due to their use of uv to install python virtual environments. Since we have to use the pre-built python binding stored at /usr/local/lib/python3.11/dist-packages to make use of the CUDA libs, it is not straight forward to uv pip install or pip install directly to the python system environment without setting the proper PATH, making extending jetson-containers as a base images to other framework difficult.

Is there a way we can switch away from using the system python installation in packages/build/python to something like ~/.venv/, or even use micromamba env by default? This would make dealing with python environments much easier.

Model: NVIDIA AGX Orin DevKit - Jetpack 6.2 L4T 36.4.3