New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can you reproduce the Llava results in this project? #97

Open

Yangr116 opened this issue Jul 17, 2024 · 2 comments

Yangr116 commented Jul 17, 2024

Hi! a very nice work!
Do you reproduce the Llava results in your project?

Author

Yangr116 commented Jul 23, 2024

Wrong GQA eval path.

TinyLLaVA_Factory/scripts/eval/gqa.sh

Line 42 in a9d37c1

python eval/eval.py --tier testdev_balanced

Collaborator

ZhangXJ199 commented Jul 30, 2024

Hello, the GQA data organization is fine, 'testdev_balanced' is just the name of the dataset, not the name of a folder.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment