Embeding LLamaSharp inside .NET MAUI Android App

[Karimiprogramer]

Description

I am a .NET MAUI develpoer and I am interested in embeding a LLM inside my application with LLamaSharp. After build llama.cpp with ndk , How can I embed libraries on my application??

[andersonvieiragomeslopes]

Description

I am a .NET MAUI develpoer and I am interested in embeding a LLM inside my application with LLamaSharp. After build llama.cpp with ndk , How can I embed libraries on my application??

I'm also interested, did you manage to use it?

[Karimiprogramer]

After solving some problems with embeding model inside app , I will publish it into my github.

[Darlanio]

Looking forward to your solution to this problem. I am not sure if llamasharp would work out of the box on android/ios, but maybe it is possible to compile llama.cpp for the specified platform?

At least llama.cpp runs under Termux on Android...

I will keep an eye on your repository:
https://github.com/Karimiprogramer/Sigma

[Darlanio]

Tested on 0.19 without compiling the binaries myself and got the exception System.PlatformNotSupportedException: 'Operation is not supported on this platform.' on the ModelParams constructor.

[Darlanio]

Looking foward to Android supported nuget libraries.