-
Notifications
You must be signed in to change notification settings - Fork 523
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rework recipes section of README and simplify models ref #2349
base: main
Are you sure you want to change the base?
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchtune/2349
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 59bf1da with merge base 9f14fe9 (): This comment was automatically generated by Dr. CI and updates every 15 minutes. |
README.md
Outdated
|
||
| Method | Type of Weight Update | 1 Device | >1 Device | >1 Node | | ||
|------------------------------|-----------------------|:--------:|:---------:|:-------:| | ||
| DPO | Full | ✅ | | | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
link to live docs (as and when we have them)? https://pytorch.org/torchtune/main/recipes/dpo.html
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #2349 +/- ##
===========================================
+ Coverage 23.72% 64.37% +40.65%
===========================================
Files 361 356 -5
Lines 21492 20969 -523
===========================================
+ Hits 5098 13498 +8400
+ Misses 16394 7471 -8923 ☔ View full report in Codecov by Sentry. |
README.md
Outdated
| [Qwen2.5](https://qwenlm.github.io/blog/qwen2.5/) | 0.5B, 1.5B, 3B, 7B, 14B, 32B, 72B [[models](torchtune/models/qwen2_5/), [configs](recipes/configs/qwen2_5/)] | ||
|
||
We're always adding new models, but feel free to [file an issue](https://github.com/pytorch/torchtune/issues/new) if there's a new one you would like to see in torchtune. | ||
torchtune supports different kinds of post-training. A successful post-trained model will likely utilize several of the below methods. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe we should also just link to the recipe overview in here https://pytorch.org/torchtune/main/recipes/recipes_overview.html
No description provided.