Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add nv_enable_options and nv_disable_options #1432

Open
wants to merge 14 commits into
base: main
Choose a base branch
from
Open

Conversation

Priya2698
Copy link
Collaborator

@Priya2698 Priya2698 commented Nov 13, 2024

nvFuser version >= 0.2.23 will support setting NVFUSER_ENABLE/NVFUSER_DISABLE through the python frontend using _enable_options and _disable_options flags. This is to enable matmul/linear codegen for nvfuser through Thunder using flags nv_enable_options=["fuse_matmul"], nv_disable_options=["matmul_expr_eval"]
Issue: NVIDIA/Fuser#3022

nvFuser PR: NVIDIA/Fuser#3270

@Priya2698 Priya2698 marked this pull request as ready for review November 13, 2024 06:50
@mruberry
Copy link
Collaborator

Maybe @jjsjann123 or @kevinstephano would like to review this?

Copy link
Collaborator

@jjsjann123 jjsjann123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nitpick on the test. Code change looks good to me otherwise.

thunder/executors/nvfuserex_impl.py Outdated Show resolved Hide resolved
thunder/tests/test_nvfuser.py Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants