Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Add SHIFT reference evaluators #45

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

[WIP] Add SHIFT reference evaluators #45

wants to merge 3 commits into from

Conversation

suniique
Copy link
Collaborator

@suniique suniique commented Mar 27, 2023

Task Metrics Status
Semantic segmentation mIoU, mAcc, fwIoU, fwAcc [x]
Object detection 2D COCO (mAP, AP50 AP75) [x]
Instance segmentation COCO (mAP, AP50 AP75) [x]
Depth estimation MAE, Delta_{1,2,5}, SILog [x]
Optical flow EPE [x]
MOT MOTA, HOTA, IDSw [ ]
Object detection 3D nuScene (mAP, AP50 AP75) [ ]
MOT 3D nuScene (MOTA, HOTA, IDSw) [ ]
Trajectory forecasting EPE, APE [ ]
Pose estimation (human) PCK [ ]
Dump to eval.ai format [x]

@suniique suniique changed the title Add SHIFT reference evaluators [WIP] Add SHIFT reference evaluators Mar 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant