Skip to content

v0.7.0

Compare
Choose a tag to compare
@tjake tjake released this 21 Oct 02:53
· 32 commits to main since this release

What's Changed

  • Rest http port fix by @tjake in #76
  • Overloads download method to specify progress by @lordofthejars in #71
  • Set the max tokens based on the model and fix temp for now by @tjake in #77
  • Creates ProgressReporter interface instead of functional interface by @lordofthejars in #80
  • Add Qwen2 support and fix bug with small models using I8Q4 by @tjake in #82
  • Add support for gemma-2 models by @tjake in #83

Full Changelog: v0.6.0...v0.7.0