Skip to content

Commit

Permalink
fix: removed cifar10 and mnist
Browse files Browse the repository at this point in the history
  • Loading branch information
init-22 committed Nov 14, 2024
1 parent 1983899 commit 76b084b
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions DOCUMENTATION.md
Original file line number Diff line number Diff line change
Expand Up @@ -421,19 +421,15 @@ Default Dropout Values for Different Workloads:

| Workload | Dropout Values |
|------------------------|------------------------------------------------------------------------------------------------------|
| cifar | dropout not used |
| criteo 1tb | dropout_rate: 0.0 |
| fastmri | dropout_rate: 0.0 |
| imagenet_resnet | dropout not used |
| imagenet_vit | dropout_rate: 0.0 |
| librispeech_conformer | attention_dropout_rate: 0.0 <br> attention_residual_dropout_rate: 0.1 <br> conv_residual_dropout_rate: 0.0 <br> feed_forward_dropout_rate: 0.0 <br> feed_forward_residual_dropout_rate: 0.1 <br> input_dropout_rate: 0.1 |
| librispeech_deepspeech | input_dropout_rate: 0.1 <br> feed_forward_dropout_rate: 0.1 <br> (Only for JAX - dropout_rate in CudnnLSTM class: 0.0) |
| mnist | dropout not used |
| ogbg | dropout_rate: 0.1 |
| wmt | dropout_rate: 0.1 <br> attention_dropout_rate: 0.1 |



#### Randomized workloads

In addition to the [fixed and known workloads](#fixed-workloads), there will also be randomized workloads in our benchmark. These randomized workloads will introduce minor modifications to a fixed workload (e.g. small model changes). The exact instances of these randomized workloads will only be created after the submission deadline and are thus unknown to both the submitters as well as the benchmark organizers. The instructions for creating them, i.e. providing a set or distribution of workloads to sample from, will be defined by this working group and made public with the call for submissions, to allow the members of this working group to submit as well as ensure that they do not possess any additional information compared to other submitters. We will refer to the unspecific workloads as *randomized workloads*, e.g. the set or distribution. The specific instance of such a randomized workload we call a *held-out workload*. That is, a held-out workload is a specific sample of a randomized workload that is used for one iteration of the benchmark. While we may reuse randomized workloads between iterations of the benchmark, new held-out workloads will be sampled for each new benchmark iteration.
Expand Down

0 comments on commit 76b084b

Please sign in to comment.