Unable to run LLM in AI Playground

[PyryAnttila]

Describe the bug

Unable to run Microsofts Phi4:14.7B model in AI Playground.

To Reproduce

Steps to reproduce the behavior:

1. Download NyxKrage/Microsoft_Phi-4
2. Enter prompt
3. Press enter
4. "An unknown error occurred. failed to generate from model."

Expected behavior

I expected the LLM to receive my message and get an answer back.

Screenshots

Environment (please complete the following information):

• OS: Windows 11 Pro
• GPU: Intel Arc B580 12GB
• CPU: Intel Core i9-14900KS
• Version: v2.0.0-alpha-prev

Additional context

Downloaded a model from Huggingface.co, but it doesnt work in AI Playground.

[fceci90]

I am having the same issue with both models I have downloaded from Huggingface.co as well. Models are:
deepseek-ai---DeepSeek-R1-Distill-Llama-70B
mistralai---Mistral-Small-24B-Instruct-2501

The default model microsoft---Phi-3-mini-4k-instruct works with no issues.

Environment Info:
OS: Windows 11 Pro
GPU: Intel Arc B580 12GB
CPU: AMD Ryzen 5 5600x
Version: v2.0.0-alpha-prev