-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
(feat): Novelai tokenizer re-implement || New LLM #75
Commits on Sep 24, 2024
-
♻️ refactor(enum): add type aliases and reintroduce functions
♻️ refactor(cost): use ModelTypeAlias for model parameter ♻️ refactor(generate_image): use type aliases for fields ♻️ refactor(login): update debug log message
Configuration menu - View commit details
-
Copy full SHA for 9828ee8 - Browse repository at this point
Copy the full SHA 9828ee8View commit details
Commits on Sep 25, 2024
-
♻️ refactor(enum): add type aliases and reintroduce functions
♻️ refactor(cost): use ModelTypeAlias for model parameter ♻️ refactor(generate_image): use type aliases for fields ♻️ refactor(login): update debug log message
Configuration menu - View commit details
-
Copy full SHA for bd426a0 - Browse repository at this point
Copy the full SHA bd426a0View commit details -
♻️ refactor(enum): add type aliases and reintroduce functions
♻️ refactor(cost): use ModelTypeAlias for model parameter ♻️ refactor(generate_image): use type aliases for fields ♻️ refactor(login): update debug log message
Configuration menu - View commit details
-
Copy full SHA for f94dfc6 - Browse repository at this point
Copy the full SHA f94dfc6View commit details -
♻️ refactor(enum): add type aliases and reintroduce functions
♻️ refactor(cost): use ModelTypeAlias for model parameter ♻️ refactor(generate_image): use type aliases for fields ♻️ refactor(login): update debug log message
Configuration menu - View commit details
-
Copy full SHA for fbc9fa1 - Browse repository at this point
Copy the full SHA fbc9fa1View commit details
Commits on Sep 26, 2024
-
🔄 refactor(playground): update model and improve prompt handling
- Switch model from KRAKE_V2 to ERATO in `generate.py` - Adjust `print` statement formatting in `generate.py` - Provide explicit prompt in `generate.py` for `chat` function - Remove unnecessary comments and update variable names in `generate_stream.py` - Update tokenizer model and add additional functionality in `usage.py`
Configuration menu - View commit details
-
Copy full SHA for 24d40a0 - Browse repository at this point
Copy the full SHA 24d40a0View commit details -
🚀 feat: add frontend directory to .gitignore and update README
- Added `/frontend/` to `.gitignore` - Updated README with new `tokenizer` task - Enhanced `chat` function with default preset parameters - Added tokenizer example in README
Configuration menu - View commit details
-
Copy full SHA for 34a0660 - Browse repository at this point
Copy the full SHA 34a0660View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3a98ed9 - Browse repository at this point
Copy the full SHA 3a98ed9View commit details -
🐛 fix: ensure correct dtype for token decoding in generate methods ```
Configuration menu - View commit details
-
Copy full SHA for 61cbcf7 - Browse repository at this point
Copy the full SHA 61cbcf7View commit details -
✨ feat(generate): add new theme and schema for LLM generation
- Added `themes.json` to support new AI generation themes. - Introduced `_schema.py` with data classes and models for AI generation. - Updated `_const.py` with new repetition penalty and ban words lists. - Enhanced `_enum.py` to manage themes and presets with caching. - Improved `__init__.py` to support advanced LLM settings and parameters.
Configuration menu - View commit details
-
Copy full SHA for 5064555 - Browse repository at this point
Copy the full SHA 5064555View commit details -
✨ feat(generate): add new theme and schema for LLM generation
- Added `themes.json` to support new AI generation themes. - Introduced `_schema.py` with data classes and models for AI generation. - Updated `_const.py` with new repetition penalty and ban words lists. - Enhanced `_enum.py` to manage themes and presets with caching. - Improved `__init__.py` to support advanced LLM settings and parameters.
Configuration menu - View commit details
-
Copy full SHA for ba8d904 - Browse repository at this point
Copy the full SHA ba8d904View commit details -
♻️ refactor(ai): simplify LLMStream build and request logic
Refactored the build method and request logic in LLMStream class. Simplified parameters handling and improved error messages.
Configuration menu - View commit details
-
Copy full SHA for 52a806a - Browse repository at this point
Copy the full SHA 52a806aView commit details -
♻️ refactor(utils): update encoding and json functions
- Refactored `b64_to_tokens` and `tokens_to_b64` to support different dtypes - Added `default_when_error` parameter to `try_jsonfy` function
Configuration menu - View commit details
-
Copy full SHA for c2d266e - Browse repository at this point
Copy the full SHA c2d266eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f4af2e6 - Browse repository at this point
Copy the full SHA f4af2e6View commit details