Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Great work! Any plan to release more detailed documentation? #5

Open
xjtupanda opened this issue Apr 18, 2024 · 0 comments
Open

Great work! Any plan to release more detailed documentation? #5

xjtupanda opened this issue Apr 18, 2024 · 0 comments

Comments

@xjtupanda
Copy link

xjtupanda commented Apr 18, 2024

Thanks for the great work! I wonder if there would be documentation/tutorial on how to access the quantities (e.g., importance) and draw plots in a customized way (Like Fig.9 in the paper)?

The GUI is very friendly for specific case studies. But if I want to calculate the importance of attention heads for a specific dataset (e.g., reasoning task), is there a simple class/interface to access related quantities and calculate them in batches?

Though I noticed that there's an argument called "preloaded_dataset_filename":

preloaded_dataset_filename: Optional[str] = field(
default=None,
metadata={"help": "The name of the text file to load the lines from."},
)

I think this is just for the ease of loading multiple cases as in sample_input.txt.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant