Skip to content

Commit

Permalink
feat: Update README.md (#281)
Browse files Browse the repository at this point in the history
Add compatible versions

---------

Signed-off-by: Ishaan Sehgal <[email protected]>
  • Loading branch information
ishaansehgal99 authored and helayoty committed Mar 29, 2024
1 parent a9b14d8 commit a29d3bb
Showing 1 changed file with 7 additions and 9 deletions.
16 changes: 7 additions & 9 deletions presets/README.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,13 @@
# Kaito Preset Configurations
The current supported model families with preset configurations are listed below.

|Model Family |
|----|
|[falcon](./models/falcon)|
|[llama2](./models/llama2)|
|[llama2chat](./models/llama2chat)|
|[mistral](./models/mistral)|
|[phi2](./models/phi)|


| Model Family | Compatible Kaito Versions |
|-----------------|---------------------------|
|[falcon](./models/falcon)| v0.0.1+|
|[llama2](./models/llama2)| v0.0.1+|
|[llama2chat](./models/llama2chat)| v0.0.1+|
|[mistral](./models/mistral)| v0.2.0+|
|[phi2](./models/phi)| v0.2.0+|

## Validation
Each preset model has its own hardware requirements in terms of GPU count and GPU memory defined in the respective `model.go` file. Kaito controller performs a validation check of whether the specified SKU and node count are sufficient to run the model or not. In case the provided SKU is not in the known list, the controller bypasses the validation check which means users need to ensure the model can run with the provided SKU.
Expand Down

0 comments on commit a29d3bb

Please sign in to comment.