Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mathvista #2321

Draft
wants to merge 16 commits into
base: main
Choose a base branch
from
Draft

Mathvista #2321

wants to merge 16 commits into from

Commits on Sep 16, 2024

  1. add mathvista

    @baberabb
    baberabb committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    0d187ed View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. add processing code

    @baberabb
    baberabb committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b27bc18 View commit details
    Browse the repository at this point in the history

  2. doc_to_image is list[img]

    @baberabb
    baberabb committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c6259cf View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. add custom regex

    @baberabb
    baberabb committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    1a28d18 View commit details
    Browse the repository at this point in the history

  2. add ai2d

    @baberabb
    baberabb committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6dc55fb View commit details
    Browse the repository at this point in the history

  3. pad images if exception

    @baberabb
    baberabb committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    1c24248 View commit details
    Browse the repository at this point in the history

  4. fix regex

    @baberabb
    baberabb committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    9d5ea23 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. add ai2d doc_to_image

    @baberabb
    baberabb committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a84c102 View commit details
    Browse the repository at this point in the history

  2. fix yaml

    @baberabb
    baberabb committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a6b1750 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. add target delimiter

    @baberabb
    baberabb committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    56f40c5 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Merge branch 'main' into mathvista 

    # Conflicts:
#	lm_eval/models/hf_vlms.py
    @baberabb
    baberabb committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    2586960 View commit details
    Browse the repository at this point in the history

  2. add mathvista_mcq

    @baberabb
    baberabb committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    b174663 View commit details
    Browse the repository at this point in the history

  3. fix logprobs

    @baberabb
    baberabb committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    9a4fa69 View commit details
    Browse the repository at this point in the history

  4. fix logprobs

    @baberabb
    baberabb committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    4142b7b View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. add attn_mask (llava models need it)

    @baberabb
    baberabb committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    3c77259 View commit details
    Browse the repository at this point in the history

  2. add pixtral_api

    @baberabb
    baberabb committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    2ef1573 View commit details
    Browse the repository at this point in the history