-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Evaluation Results - ALL SQ and Stuff SQ Lower than Reported in Paper #21
Comments
Hi, In section 4.2.2 of the Readme, I showed the results I got with the released model when I released the code and models. I copy paste it here. The mIoU is 22.07 and All PQ is 28.43.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
When I reproduced the results for Section 4.2.2 (Evaluation) using both the pretrained checkpoint and my own trained checkpoint, I noticed that the ALL SQ and Stuff SQ scores are consistently 3 to 4 points lower than those reported in the paper.
Are there any known factors or configuration details that could lead to this discrepancy?
Thank you in advance for your assistance!
The text was updated successfully, but these errors were encountered: