Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add experiments notebooks #193

Merged
merged 76 commits into from
Oct 1, 2023
Merged

Add experiments notebooks #193

merged 76 commits into from
Oct 1, 2023

Commits on Jun 17, 2023

  1. small todo

    @mivanit
    mivanit committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    1841739 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. WIP notebooks

    @mivanit
    mivanit committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    42fcb47 View commit details
    Browse the repository at this point in the history

  2. data and trained model for hallway

    @mivanit
    mivanit committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    f21f8eb View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. merge main

    @mivanit
    mivanit committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    463b525 View commit details
    Browse the repository at this point in the history

  2. removing duplicate notebook

    @mivanit
    mivanit committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    46614db View commit details
    Browse the repository at this point in the history

  3. update dataset demo nb

    @mivanit
    mivanit committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    a8886e0 View commit details
    Browse the repository at this point in the history

  4. update maze-dataset dep to be from pypi

    @mivanit
    mivanit committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    2f22ae6 View commit details
    Browse the repository at this point in the history

  5. fixed up dataset cfg refs

    @mivanit
    mivanit committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    ffd6a34 View commit details
    Browse the repository at this point in the history

  6. fixed gen_dfs kwarg name change

    @mivanit
    mivanit committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    1acbbc1 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. wip direct logit attribution refactor

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    6688402 View commit details
    Browse the repository at this point in the history

  2. plotting logits

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    7e66e16 View commit details
    Browse the repository at this point in the history

  3. logit plots

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    61f6f95 View commit details
    Browse the repository at this point in the history

  4. moved plot logits out

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    729dc1f View commit details
    Browse the repository at this point in the history

  5. wip

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    0d0d652 View commit details
    Browse the repository at this point in the history

  6. direct logit attribution logit diff wip 

    i have no idea why, but the scaling is wrong. The relationship is clearly linear,
but its different depending on whether it's diff to all other tokens or some random set of tokens
    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    f559458 View commit details
    Browse the repository at this point in the history

  7. wip

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    05841d1 View commit details
    Browse the repository at this point in the history

  8. direct logit attribution

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    1ec8260 View commit details
    Browse the repository at this point in the history

  9. split up notebook

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    3e518b6 View commit details
    Browse the repository at this point in the history

  10. minor fixes

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    0b3ebb3 View commit details
    Browse the repository at this point in the history

  11. format, manually fix some imports

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    0e6c181 View commit details
    Browse the repository at this point in the history

  12. added a few different tasks to logit attribution

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    4151077 View commit details
    Browse the repository at this point in the history

  13. moved plot_attention.py

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    82feee9 View commit details
    Browse the repository at this point in the history

  14. updated path start notebook still has activation patching

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    14d5010 View commit details
    Browse the repository at this point in the history

  15. ???

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    be1934c View commit details
    Browse the repository at this point in the history

  16. git add .git add .!

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    a54c5a2 View commit details
    Browse the repository at this point in the history

  17. wip

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    7ea1c18 View commit details
    Browse the repository at this point in the history

  18. bumped maze-dataset dep

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    1519224 View commit details
    Browse the repository at this point in the history

  19. format

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    213f920 View commit details
    Browse the repository at this point in the history

  20. fixed paths in eval_model notebook

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    0a536a3 View commit details
    Browse the repository at this point in the history

  21. run eval_model, rename wandb conversion nb

    @mivanit
    mivanit committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    18036ef View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. wip

    @mivanit
    mivanit committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    82868b3 View commit details
    Browse the repository at this point in the history

  2. better maze plotting

    @mivanit
    mivanit committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    1abe25b View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. dla report automation, more flexible functions

    @mivanit
    mivanit committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    5fcfda2 View commit details
    Browse the repository at this point in the history

  2. fixed bug in maze attention plots, improved logit plots

    @mivanit
    mivanit committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    9971ed6 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. wip

    @mivanit
    mivanit committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    7c2edb8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-experiments-notebooks

    @mivanit
    mivanit committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    22b9a85 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. wip

    @mivanit
    mivanit committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    dcd4920 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. wip???

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    ecb1c7d View commit details
    Browse the repository at this point in the history

  2. dla for neurons

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    e2ed0ce View commit details
    Browse the repository at this point in the history

  3. viewing weights

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    64b1064 View commit details
    Browse the repository at this point in the history

  4. wip

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    9124ffa View commit details
    Browse the repository at this point in the history

  5. run dla notebook

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    0185eb6 View commit details
    Browse the repository at this point in the history

  6. wip

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    ea6ad15 View commit details
    Browse the repository at this point in the history

  7. exporting embeddings vis

    @mivanit
    mivanit committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    2f1ea5c View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. PCA of embeddings

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    6395160 View commit details
    Browse the repository at this point in the history

  2. wip

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    478ad56 View commit details
    Browse the repository at this point in the history

  3. add pca result options

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    1fe7df4 View commit details
    Browse the repository at this point in the history

  4. Exported embeddings PCA functionality

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    7528e57 View commit details
    Browse the repository at this point in the history

  5. log scale for PCA option

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    6172b53 View commit details
    Browse the repository at this point in the history

  6. fixing up some tests -- they should all pass

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    09219b1 View commit details
    Browse the repository at this point in the history

  7. wip distance correlations

    @mivanit
    mivanit committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    d516d05 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. wip residual stream structure

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    5c851d4 View commit details
    Browse the repository at this point in the history

  2. exporting functions wip

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    73a0f00 View commit details
    Browse the repository at this point in the history

  3. refactoring, added correlation info

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    a95b49e View commit details
    Browse the repository at this point in the history

  4. wip

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    27b2a4d View commit details
    Browse the repository at this point in the history

  5. distance plot

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    4bad3aa View commit details
    Browse the repository at this point in the history

  6. wip

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    9dd4258 View commit details
    Browse the repository at this point in the history

  7. embedding similarity refactor

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    b9bfe4d View commit details
    Browse the repository at this point in the history

  8. more refactor, cleanup

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    888a407 View commit details
    Browse the repository at this point in the history

  9. format

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    906e49b View commit details
    Browse the repository at this point in the history

  10. update maze-dataset to 0.4.1 (out soon)

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    3437120 View commit details
    Browse the repository at this point in the history

  11. update deps

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    c973321 View commit details
    Browse the repository at this point in the history

  12. added seaborn to deps

    @mivanit
    mivanit committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    1a654e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2023

  1. workflow for multiple python/torch versions

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    7c79c64 View commit details
    Browse the repository at this point in the history

  2. workflow for multiple python/torch versions

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    fd910f9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'add-experiments-notebooks' of https://github.com/unders… 

    …tanding-search/maze-transformer into add-experiments-notebooks
    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    3cc9481 View commit details
    Browse the repository at this point in the history

  4. error in github actions

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    fb88d89 View commit details
    Browse the repository at this point in the history

  5. oops

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    ac47c5c View commit details
    Browse the repository at this point in the history

  6. update poetry and torch_cpu source

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    9d671d9 View commit details
    Browse the repository at this point in the history

  7. im dumb

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    fc7c5d8 View commit details
    Browse the repository at this point in the history

  8. wip fixing test

    @mivanit
    mivanit committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    aa32679 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2023

  1. fixed tokenizer padding issue in tests

    @mivanit
    mivanit committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    074f19c View commit details
    Browse the repository at this point in the history

  2. added scipy dep, specified python<3.10

    @mivanit
    mivanit committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    1add09e View commit details
    Browse the repository at this point in the history

  3. added scikit-learn dep

    @mivanit
    mivanit committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    9b04206 View commit details
    Browse the repository at this point in the history

  4. format

    @mivanit
    mivanit committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    8975fac View commit details
    Browse the repository at this point in the history

  5. fixed device issues in dla notebook

    @mivanit
    mivanit committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    3493c33 View commit details
    Browse the repository at this point in the history