Skip to content

Commit

Permalink
Updated readme to use fast mask decode mode
Browse files Browse the repository at this point in the history
  • Loading branch information
probicheaux committed Dec 4, 2023
1 parent e1a09ed commit 98b4be7
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions inference/enterprise/parallel/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,14 +23,14 @@ We measure and report performance across a variety of different task types by se

### Methodology

The following metrics are taken on a machine with eight cores and one gpu. The FPS metrics reflect best out of three trials. The column labeled 0.9.5.parallel reflects the latest concurrent FPS metrics.
The following metrics are taken on a machine with eight cores and one gpu. The FPS metrics reflect best out of three trials. The column labeled 0.9.5.parallel reflects the latest concurrent FPS metrics. Instance segmentation metrics are calculated using `"mask_decode_mode": "fast"` in the request body. Requests are posted concurrently with a parallelism of 1000.

### Results
| Workspace | Model | Model Type | split | 0.9.5.rc FPS| 0.9.5.parallel FPS | 0.9.5.parallel (orjson) FPS |
| ----------|------ | ----------- |------|-------------| -------------------|-----------------------------|
| senior-design-project-j9gpp | nbafootage/3| object-detection | train | 30.2 fps | 44.03 fps | 54.5 fps |
| niklas-bommersbach-jyjff | dart-scorer/8| object-detection | train | 26.6 fps | 47.0 fps | 52.3 fps |
| geonu | water-08xpr/1 | instance-segmentation | valid | 2.3 fps | 2.5 fps | 4.1 fps |
| university-of-bradford | detecting-drusen_1/2 | instance-segmentation | train | 2.3 fps | 2.4 fps | 4.4 fps |
| geonu | water-08xpr/1 | instance-segmentation | valid | 4.7 fps | 6.1 fps | 10.4 fps |
| university-of-bradford | detecting-drusen_1/2 | instance-segmentation | train | 6.2 fps | 7.2 fps | 10.4 fps |
| fy-project-y9ecd | cataract-detection-viwsu/2 | classification | train | 48.5 fps | 65.4 fps | 64.9 fps |
| hesunyu | playing-cards-ir0wr/1 | classification | train | 44.6 fps | 57.7 fps | 57.7 fps |

0 comments on commit 98b4be7

Please sign in to comment.