Skip to content
This repository has been archived by the owner on Feb 22, 2020. It is now read-only.

Added detection evaluation method for detection #301

Merged
merged 3 commits into from
Jan 26, 2018

Conversation

swarm-ai
Copy link
Contributor

Description

Correct detection
A detection can be treated as a correct detection if the intersection-over-union (IoU) of the ground truth and the detected bounding boxes is larger than a predefined threshold. The concept is shown as below. (Images are borrowed from https://www.pyimagesearch.com/2016/11/07/intersection-over-union-iou-for-object-detection/)

Reference to official issue

Issue #271

Motivation and Context

We extend the IoU calculation from 2D to 3D but in order to be simple, we only deal with 3D boxes / cubes. Although the detections we have are 3D spheres output from the grt123 system. The threshold we currently use is 0.5 but can easily be changed (‘correct_detection_threshold’ in evaluate_detection.py). We also did some experiments using different thresholds, please check the evaluation results below.

How Has This Been Tested?

We have tested the performance on the NSCLC Radiogenomics data set found here: http://www.cibl-harvard.org/data

You can see we include a results file that can be compared with the ground truth file in
concept-to-clinic/prediction/src/algorithms/training/detector/label/custom_annos.csv

Screenshots (if appropriate):

screen shot 2018-01-25 at 3 57 17 pm

CLA

  • I have signed the CLA; if other committers are in the commit history, they have signed the CLA as well

@lamby
Copy link
Contributor

lamby commented Jan 26, 2018

This is awesome :)

@lamby lamby merged commit a70f638 into drivendataorg:master Jan 26, 2018
@vessemer vessemer mentioned this pull request Feb 1, 2018
1 task
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants