Running LocalGPT on Debian 12

[freggala]

Hi,
I'm a total noob in the AI world, and I'm trying to run LocalGPT in Debian 12 (Bookworm) based VM.
The first obstacle is Python 3.10. For some reason, Debian 11 and 12 don't have it. After some detours, trying to add a foreign deb source, which didn't work and effectively messed up the entire package management on that system, I decided to give Python 3.11 a try.

I'm not sure if the problem is really related to 3.11 or if it's caused by something else, but pip install -r requirements.txt takes forever just to fail eventually. I've tried to install some requirements manually beforehand but to no avail.
This is what I usually end up with:

Collecting charset-normalizer>=2.0.0 (from pdfminer.six==20221105->-r localGPT/requirements.txt (line 4)) Downloading charset_normalizer-2.0.12-py3-none-any.whl.metadata (11 kB) Collecting unstructured[pdf] (from -r localGPT/requirements.txt (line 17)) Downloading unstructured-0.16.13-py3-none-any.whl.metadata (24 kB) ERROR: Exception: Traceback (most recent call last): File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_internal/cli/base_command.py", line 106, in _run_wrapper status = _inner_run() ^^^^^^^^^^^^ File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_internal/cli/base_command.py", line 97, in _inner_run return self.run(options, args) ^^^^^^^^^^^^^^^^^^^^^^^ File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_internal/cli/req_command.py", line 67, in wrapper return func(self, options, args) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_internal/commands/install.py", line 386, in run requirement_set = resolver.resolve( ^^^^^^^^^^^^^^^^^ File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 95, in resolve result = self._result = resolver.resolve( ^^^^^^^^^^^^^^^^^ File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_vendor/resolvelib/resolvers.py", line 546, in resolve state = resolution.resolve(requirements, max_rounds=max_rounds) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/localgpt-venv01/lib/python3.11/site-packages/pip/_vendor/resolvelib/resolvers.py", line 457, in resolve raise ResolutionTooDeep(max_rounds) pip._vendor.resolvelib.resolvers.ResolutionTooDeep: 200000
Here's the entire scrollback history and some info about the packages already installed:
pip_install_requirements_localgpt_scrollback.txt
From what I can see, the problem is that the versions of many packages are not pinned down in requirements.txt, so Pip tries every possible combination.

Am I right, or is there something else going wrong?
Has anyone (successfully) tried to run LocalGPT with Python 3.11? What do I have to consider?
Can anyone provide a requirements.txt with package versions pinned down?
What else could I try?

Thank you very much!