[Bug]: Error type: APIConnectionError

[GrahamboJangles]

Is there an existing issue for the same bug?

• I have checked the existing issues.

Describe the bug and reproduction steps

RuntimeError: There was an unexpected error while running the agent. Please report this error to the developers. Your session ID is b024e0c130f444dd8851e5f2911643dd. Error type: APIConnectionError

Windows 11 Pro
OpenHands 0.27.0

WSL version: 2.4.11.0
Kernel version: 5.15.167.4-1
WSLg version: 1.0.65
MSRDC version: 1.2.5716
Direct3D version: 1.611.1-81528511
DXCore version: 10.0.26100.1-240331-1435.ge-release
Windows version: 10.0.26100.3194

Docker version 27.5.1, build 9f9e405

OpenHands Installation

Docker command in README

OpenHands Version

main

Operating System

WSL on Windows

Logs, Errors, Screenshots, and Additional Context

I can manually curl the model via terminal but I cannot get local LM Studio API to work with OpenHands.

These are my settings in OpenHands:

Softare versions:
Windows 11 Pro
Docker version 27.5.1, build 9f9e405

WSL version: 2.4.11.0
Kernel version: 5.15.167.4-1
WSLg version: 1.0.65
MSRDC version: 1.2.5716
Direct3D version: 1.611.1-81528511
DXCore version: 10.0.26100.1-240331-1435.ge-release
Windows version: 10.0.26100.3194

[enyst]

Please try using:

• the prefix "openai/" with the model name, because afaik LMStudio has an openai-compatible API and that's how LiteLLM, which we use to support models, knows how to format the request.
• port 1234, which is the default for LMStudio, afaik, or what you have configured if you are using LM Studio. 11434 is the default port for Ollama.

[GrahamboJangles]

Please try using:

• the prefix "openai/" with the model name, because afaik LMStudio has an openai-compatible API and that's how LiteLLM, which we use to support models, knows how to format the request.
• port 1234, which is the default for LMStudio, afaik, or what you have configured if you are using LM Studio. 11434 is the default port for Ollama.

@enyst Thank you for your reply.

After applying those changes in OpenHands, I get error:
BadRequestError: litellm.BadRequestError: OpenAIException -

[enyst]

Can you please tell more about that exception? From the logs, perhaps?