Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inconsistent Text Results Between Android App and Google AI Console for Same Prompt #226

Open
surajsahani opened this issue Nov 26, 2024 · 2 comments

Comments

@surajsahani
Copy link

surajsahani commented Nov 26, 2024

Description of the bug:

I tried this prompt on my android app with text samples providing bellow it's giving Me different results in app and ai console

Prompt - ```
"Please correct the following text for any spelling and grammatical errors only in English. \n" +
"Do not change the meaning, translate, or paraphrase the text. \n" +
"For longer texts, carefully structure the content into clear, coherent paragraphs. \n" +
"Each paragraph should focus on a single idea or topic, while preserving the original meaning. \n" +
"Ensure proper grammar and spelling throughout without altering the overall structure unnecessarily. \n" +
"For shorter texts, only fix grammar and spelling:\n



My actual text

default Jo WhatsApp per Ek Mike and rehta hai an vahan per Hath Chala Jata Hai intuitive

Result I got from gemini

Default Jion WhatsApp per ek mic aur rehta hai an, vahan per haath chala jata hai intuitively

Same input result I for from google ai console

Default, you know, WhatsApp, like, a mic is there, right? And there, my hand moves intuitively.



### Actual vs expected behavior:


_No response_

### Any other information you'd like to share?

![Screenshot 2024-11-26 at 1 11 56 PM](https://github.com/user-attachments/assets/d49381c4-5a77-4f54-ac46-0b4e1d495122)

_No response_
@surajsahani
Copy link
Author

Screenshot 2024-11-26 at 1 11 56 PM

@surajsahani surajsahani changed the title Same Prompt Providing different results Inconsistent Text Results Between Android App and Google AI Console for Same Prompt Nov 26, 2024
@Taewan-P
Copy link

That is typically normal for LLMs. Not a bug. Did you modify your temperature settings or Top P sampling? If not, it is very likely that the results are different every time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants