Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reproducibility #43

Merged
merged 67 commits into from
Oct 2, 2024
Merged

Reproducibility #43

merged 67 commits into from
Oct 2, 2024

Commits on Sep 4, 2024

  1. core functions

    @recursix
    recursix committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    d5d067e View commit details
    Browse the repository at this point in the history

  2. switch to dask

    @recursix
    recursix committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    df2aaeb View commit details
    Browse the repository at this point in the history

  3. removing joblib dependency and adding dask

    @recursix
    recursix committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    edb162c View commit details
    Browse the repository at this point in the history

  4. fixing imports

    @ThibaultLSDC
    ThibaultLSDC committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    82ff348 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. handles multiple backends

    @recursix
    recursix committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    0dbdd98 View commit details
    Browse the repository at this point in the history

  2. ensure asyncio loop creation

    @recursix
    recursix committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    7da5cac View commit details
    Browse the repository at this point in the history

  3. more tests

    @recursix
    recursix committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    25e241a View commit details
    Browse the repository at this point in the history

  4. setting dashboard address to None

    @recursix
    recursix committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    01c8652 View commit details
    Browse the repository at this point in the history

  5. minor

    @recursix
    recursix committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    c6370bd View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into switch-to-dask

    @recursix
    recursix committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    775f135 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Merge branch 'main' into switch-to-dask

    @recursix
    recursix committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0198811 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Finally found a way to make it work

    @recursix
    recursix committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7ad0e67 View commit details
    Browse the repository at this point in the history

  2. initial reproducibility files

    @recursix
    recursix committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a396d9a View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Seems to be superflus

    @recursix
    recursix committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    3db84f7 View commit details
    Browse the repository at this point in the history

  2. adding a reproducibility journal

    @recursix
    recursix committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ed9e568 View commit details
    Browse the repository at this point in the history

  3. minor update

    @recursix
    recursix committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    85ac6fa View commit details
    Browse the repository at this point in the history

  4. more robust

    @recursix
    recursix committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ad5110e View commit details
    Browse the repository at this point in the history

  5. adding reproducibility tools

    @recursix
    recursix committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    baf9afa View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. fix white listing

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    b0268b6 View commit details
    Browse the repository at this point in the history

  2. minor

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    bb7ddb0 View commit details
    Browse the repository at this point in the history

  3. minor

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    8b4884f View commit details
    Browse the repository at this point in the history

  4. minor

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    e685f10 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into reproducibility

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    c99bdf7 View commit details
    Browse the repository at this point in the history

  6. minor

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    ac8b7f8 View commit details
    Browse the repository at this point in the history

  7. minor fix

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    295f010 View commit details
    Browse the repository at this point in the history

  8. more tests

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    5ac4a7c View commit details
    Browse the repository at this point in the history

  9. more results yay

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    d4cf969 View commit details
    Browse the repository at this point in the history

  10. disabling this test

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    1dc720b View commit details
    Browse the repository at this point in the history

  11. update

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    82f6181 View commit details
    Browse the repository at this point in the history

  12. update

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    eb871ac View commit details
    Browse the repository at this point in the history

  13. black

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    fa0c489 View commit details
    Browse the repository at this point in the history

  14. maybe fixing github workflow ?

    @ThibaultLSDC
    ThibaultLSDC committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    abd3212 View commit details
    Browse the repository at this point in the history

  15. make get_git_username great again

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    4ebee28 View commit details
    Browse the repository at this point in the history

  16. trigger change

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    58f5ec7 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'reproducibility' of github.com:ServiceNow/AgentLab into… 

    … reproducibility
    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    37bbb5f View commit details
    Browse the repository at this point in the history

  18. new browsergym

    @recursix
    recursix committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    f621648 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. GPT-4o result (and new comment column)

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    60a1b22 View commit details
    Browse the repository at this point in the history

  2. Seems like there was a change to 4o flags, trying these

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    dd9aa0d View commit details
    Browse the repository at this point in the history

  3. minor comment

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    54ea0af View commit details
    Browse the repository at this point in the history

  4. better xray

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    24214e5 View commit details
    Browse the repository at this point in the history

  5. minor fix

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    b8da07b View commit details
    Browse the repository at this point in the history

  6. addming a comment field

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    1ecaf9b View commit details
    Browse the repository at this point in the history

  7. new agent

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    5aba9bc View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into reproducibility

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    fe561b9 View commit details
    Browse the repository at this point in the history

  9. another test with GPT-4o

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    7bf424e View commit details
    Browse the repository at this point in the history

  10. adding llama3 from openrouter

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    7e0ab03 View commit details
    Browse the repository at this point in the history

  11. fix naming

    @recursix
    recursix committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    03eae32 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. unused import

    @recursix
    recursix committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    796c37e View commit details
    Browse the repository at this point in the history

  2. new summary tools and remove "_args" from columns in results

    @recursix
    recursix committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    8fc49e9 View commit details
    Browse the repository at this point in the history

  3. add Llama

    @recursix
    recursix committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    7e2afd3 View commit details
    Browse the repository at this point in the history

  4. initial code for reproducibility agent

    @recursix
    recursix committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    f08e47b View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into reproducibility

    @recursix
    recursix committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    326710a View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. adjust inspect results

    @recursix
    recursix committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    f7494cb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into reproducibility

    @recursix
    recursix committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    37d8961 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. infer from benchmark

    @recursix
    recursix committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    4066da3 View commit details
    Browse the repository at this point in the history

  2. fix reproducibility agent

    @recursix
    recursix committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    ef204d3 View commit details
    Browse the repository at this point in the history

  3. prevent the repro_dir to be an index variable

    @recursix
    recursix committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    5112abe View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. updating repro agent stats

    @recursix
    recursix committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    5325c69 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into reproducibility

    @recursix
    recursix committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    02e028f View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Reproducibility agent

    @recursix
    recursix committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    d8ad4bd View commit details
    Browse the repository at this point in the history

  2. instructions to setup workarena

    @recursix
    recursix committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    fe27819 View commit details
    Browse the repository at this point in the history

  3. fixing tests

    @ThibaultLSDC
    ThibaultLSDC committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    4a8f078 View commit details
    Browse the repository at this point in the history

  4. handles better a few edge cases

    @recursix
    recursix committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    6474558 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'reproducibility' of github.com:ServiceNow/AgentLab into… 

    … reproducibility
    @recursix
    recursix committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    42fdcf1 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. default progress function to None

    @recursix
    recursix committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    628d1c8 View commit details
    Browse the repository at this point in the history

  2. minor formatting

    @recursix
    recursix committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    69f147a View commit details
    Browse the repository at this point in the history

  3. minor

    @recursix
    recursix committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    146ad62 View commit details
    Browse the repository at this point in the history