Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression in handling of large model alias #996

Closed
AlexandreBouffard opened this issue Jan 10, 2025 · 4 comments
Closed

Regression in handling of large model alias #996

AlexandreBouffard opened this issue Jan 10, 2025 · 4 comments

Comments

@AlexandreBouffard
Copy link

Using large model alias together with genaiscript.config.yaml was working fine, then broke around 1-2 weeks ago (do not recall specific version).

Now with:

repro.genai.mjs:

script({
  model: "large",
});
$`Write a poem in code.`;

and

genaiscript.config.yaml:

modelAliases:
  large: google:gemini-exp-1206
  vision: google:gemini-exp-1206

I get the following error:

genaiscript: repro
 large: undefined (script)
 vision: google:gemini-exp-1206 (config)
No LLM provider configured for large (see https://microsoft.github.io/genaiscript/getting-started/configuration/)

Using vision alias works as expected but I cannot make large alias work.

Same error with:

  • only large alias defined in config file
  • another large model defined
  • json config file instead of yaml
Copy link

github-actions bot commented Jan 10, 2025

Comment:
The issue seems to be related to the handling of large model aliases in genaiscript. The use of the "large" alias was previously working, but now it is breaking with an error indicating that no LLM provider is configured for "large". This suggests that there might have been a change in how model aliases are resolved or configured recently.

To resolve this issue:

  1. Verify that the alias definitions in genaiscript.config.yaml are correct and properly formatted.
  2. Check if there are any updates or changes to the genaiscript configuration that might affect how model aliases are handled.
  3. Ensure that the LLM provider for "large" is correctly specified either within genaiscript.config.yaml or via an environment variable.
  4. If the issue persists, consider reaching out to the maintainers of genaiscript or checking their release notes and FAQs for any known issues related to model alias handling.

Here is a potential fix based on the above suggestions:

modelAliases:
  large: "google:gemini-exp-1206"

Make sure that the provider name is correctly specified as a string. If the issue continues, please provide more details about the error message and any relevant configuration files for further assistance.

AI-generated content by issue-reviewer may be incorrect

@pelikhan
Copy link
Member

investigating

@pelikhan
Copy link
Member

I can repro : )

@pelikhan
Copy link
Member

fixed by fd82b6b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants