Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cms/calinator444/ssw.rules.content/rule/choosing large language models/rule #9819

Conversation

Calinator444
Copy link
Member

  1. What triggered this change? (PBI link, Email Subject, conversation + reason, etc)

✏️ Requested topic for Chewing The Fat

  1. What was changed?

✏️ Added a new rule "Do you test before you invest In Large Language Models?"

  1. I paired or mob programmed with:

✏️ @isaaclombardssw

@github-actions github-actions bot added the Age: 🥚 - New About 2 hours old label Jan 30, 2025
Copy link
Member

@isaaclombardssw isaaclombardssw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

- title: ""
guid: e6891815-5e9b-4626-a1f7-42f13ce53aec
---
When building an AI-powered solution, developers have access to a wide variety of Large Language Models (LLMs), such as Llama, GPT-4o, and Mistral. However, tools exist to evaluate these models in development **for free**, especially when integrating them into an application.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
When building an AI-powered solution, developers have access to a wide variety of Large Language Models (LLMs), such as Llama, GPT-4o, and Mistral. However, tools exist to evaluate these models in development **for free**, especially when integrating them into an application.
When building an AI-powered solution, developers have access to a wide variety of Large Language Models (LLMs), such as Llama, GPT-4o, and Mistral. Tools exist to evaluate these models in development **for free**.


## The challenge of trying out AI models

Many AI providers charge per API call, making it expensive to experiment with different models.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Many AI providers charge per API call, making it expensive to experiment with different models.
Developing with AI can be prohibitive for a few reasons.


Many AI providers charge per API call, making it expensive to experiment with different models.

- **Decision Fatigue** There's a large number of Language models to choose from. The market size is expected to reach 13.52 billion in 2029.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Decision Fatigue** There's a large number of Language models to choose from. The market size is expected to reach 13.52 billion in 2029.
- **Decision Fatigue** There's a large number of Language models to choose from. The market size is expected to reach 13.52 billion US dollars by 2029.

?

- **Different Implementations** AI services generally provide their own API's with separate documentation for use.


- **Fine Tuning** Finding a cost to performance ratio for an LLM can be difficult to do.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Fine Tuning** Finding a cost to performance ratio for an LLM can be difficult to do.
- **Fine Tuning** Getting the right behaviour and performance by testing against various model parameters.

@Calinator444 Calinator444 merged commit c1b8662 into SSWConsulting:main Jan 30, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Age: 🥚 - New About 2 hours old
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants