The following table lists the Docker image URLs that will be used by Amazon ECS in task definitions. Replace the <repository-name> and <image-tag> values based on your desired container.
Once you've selected your desired Deep Learning Containers image, continue with one of the following tutorials:
-
To run training and inference on Deep Learning Containers for Amazon EC2 using MXNet, PyTorch, TensorFlow, and TensorFlow 2, see Amazon EC2 Tutorials
-
To run training and inference on Deep Learning Containers for Amazon ECS using MXNet, PyTorch, and TensorFlow, see Amazon ECS tutorials
-
Deep Learning Containers for Amazon EKS offer CPU, GPU, and distributed GPU-based training, as well as CPU and GPU-based inference. To run training and inference on Deep Learning Containers for Amazon EKS using MXNet, PyTorch, and TensorFlow, see Amazon EKS Tutorials
-
For information on security in Deep Learning Containers, see Security in AWS Deep Learning Containers
-
For a list of the latest Deep Learning Containers release notes, see Release Notes for Deep Learning Containers
Deep Learning Containers Docker Images are available in the following regions:
| Region | Code | General Container | Elastic Inference Container | Neuron Container | Example URL |
|---|---|---|---|---|---|
| US East (N. Virginia) | us-east-1 | Available | Available | Available | 763104351884.dkr.ecr.us-east-1.amazonaws.com/<repository-name>:<image-tag> |
| US East (Ohio) | us-east-2 | Available | Available | Available | 763104351884.dkr.ecr.us-east-2.amazonaws.com/<repository-name>:<image-tag> |
| US West (N. California) | us-west-1 | Available | None | None | 763104351884.dkr.ecr.us-west-1.amazonaws.com/<repository-name>:<image-tag> |
| US West (Oregon) | us-west-2 | Available | Available | Available | 763104351884.dkr.ecr.us-west-2.amazonaws.com/<repository-name>:<image-tag> |
| Africa (Cape Town) | af-south-1 | Available | Available | None | 626614931356.dkr.ecr.af-south-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Hong Kong) | ap-east-1 | Available | None | None | 871362719292.dkr.ecr.ap-east-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Mumbai) | ap-south-1 | Available | None | Available | 763104351884.dkr.ecr.ap-south-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Osaka) | ap-northeast-3 | Available | None | None | 364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Seoul) | ap-northeast-2 | Available | Available | None | 763104351884.dkr.ecr.ap-northeast-2.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Singapore) | ap-southeast-1 | Available | None | Available | 763104351884.dkr.ecr.ap-southeast-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Sydney) | ap-southeast-2 | Available | None | Available | 763104351884.dkr.ecr.ap-southeast-2.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Tokyo) | ap-northeast-1 | Available | Available | Available | 763104351884.dkr.ecr.ap-northeast-1.amazonaws.com/<repository-name>:<image-tag> |
| Canada (Central) | ca-central-1 | Available | None | None | 763104351884.dkr.ecr.ca-central-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Frankfurt) | eu-central-1 | Available | None | Available | 763104351884.dkr.ecr.eu-central-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Ireland) | eu-west-1 | Available | Available | Available | 763104351884.dkr.ecr.eu-west-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (London) | eu-west-2 | Available | None | None | 763104351884.dkr.ecr.eu-west-2.amazonaws.com/<repository-name>:<image-tag> |
| EU (Milan) | eu-south-1 | Available | None | None | 692866216735.dkr.ecr.eu-south-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Paris) | eu-west-3 | Available | None | Available | 763104351884.dkr.ecr.eu-west-3.amazonaws.com/<repository-name>:<image-tag> |
| EU (Stockholm) | eu-north-1 | Available | None | None | 763104351884.dkr.ecr.eu-north-1.amazonaws.com/<repository-name>:<image-tag> |
| Middle East (Bahrain) | me-south-1 | Available | None | None | 217643126080.dkr.ecr.me-south-1.amazonaws.com/<repository-name>:<image-tag> |
| South America (Sao Paulo) | sa-east-1 | Available | None | Available | 763104351884.dkr.ecr.sa-east-1.amazonaws.com/<repository-name>:<image-tag> |
| China (Beijing) | cn-north-1 | Available | None | None | 727897471807.dkr.ecr.cn-north-1.amazonaws.com.cn/<repository-name>:<image-tag> |
| China (Ningxia) | cn-northwest-1 | Available | None | None | 727897471807.dkr.ecr.cn-northwest-1.amazonaws.com.cn/<repository-name>:<image-tag> |
Note: eu-north-1 is available starting in the version 2.0 release. As a result, MXNet-1.4.0 is not available in this region.
ECR is a regional service and the Image table contains the URLs for us-east-1 images. To pull from one of the regions mentioned previously, insert the region in the repository URL following this example:
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-training:1.15.2-cpu-py27-ubuntu18.04
Important
You must login to access the DLC image repository before pulling the image. Ensure your CLI is up to date using the steps in Installing the current AWS CLI Version Then, specify your region and its corresponding ECR Registry from the previous table in the following command:
aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin 763104351884.dkr.ecr.us-east-1.amazonaws.com
You can then pull these Docker images from ECR by running:
docker pull <name of container image>
To use the following tables, select your desired framework, the kind of job you're starting, and your desired Python version. Your
job type is either training or inference. Your Python version is
either py27, py36, py37, or py38, depending on availability. Plug this information into the replaceable portions of the URL as shown in the example URL.
You can pin your version by adding the version tag to your URL as follows:
763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.4.1-cpu-py37-ubuntu18.04-v1.0
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| PyTorch 1.11.0 | training | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.11.0-cpu-py38-ubuntu20.04-e3 |
| PyTorch 1.11.0 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.11.0-gpu-py38-cu115-ubuntu20.04-e3 |
| PyTorch 1.11.0 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.11.0-cpu-py38-ubuntu20.04-e3 |
| PyTorch 1.11.0 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.11.0-gpu-py38-cu115-ubuntu20.04-e3 |
| TensorFlow 2.9.1 | training | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.9.1-cpu-py39-ubuntu20.04-e3 |
| TensorFlow 2.9.1 | training | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.9.1-gpu-py39-cu112-ubuntu20.04-e3 |
| TensorFlow 2.9.0 | inference | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.9.0-cpu-py39-ubuntu20.04-e3 |
| TensorFlow 2.9.0 | inference | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.9.0-gpu-py39-cu112-ubuntu20.04-e3 |
| MXNet 1.9.0 | training | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.9.0-cpu-py38-ubuntu20.04-e3 |
| MXNet 1.9.0 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.9.0-gpu-py38-cu112-ubuntu20.04-e3 |
| MXNet 1.9.0 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.9.0-cpu-py38-ubuntu20.04-e3 |
| MXNet 1.9.0 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.9.0-gpu-py38-cu112-ubuntu20.04-e3 |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| PyTorch 1.10.0 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference-graviton:1.10.0-cpu-py38-ubuntu20.04-e3 |
| TensorFlow 2.7.0 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-graviton:2.7.0-cpu-py38-ubuntu20.04-e3 |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| PyTorch 1.11.0 | training | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.11.0-cpu-py38-ubuntu20.04-sagemaker |
| PyTorch 1.11.0 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.11.0-gpu-py38-cu113-ubuntu20.04-sagemaker |
| PyTorch 1.11.0 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.11.0-cpu-py38-ubuntu20.04-sagemaker |
| PyTorch 1.11.0 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.11.0-gpu-py38-cu113-ubuntu20.04-sagemaker |
| MXNet 1.9.0 | training | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.9.0-cpu-py38-ubuntu20.04-sagemaker |
| MXNet 1.9.0 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.9.0-gpu-py38-cu112-ubuntu20.04-sagemaker |
| MXNet 1.9.0 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.9.0-cpu-py38-ubuntu20.04-sagemaker |
| MXNet 1.9.0 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.9.0-gpu-py38-cu112-ubuntu20.04-sagemaker |
| TensorFlow 2.9.1 | training | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.9.1-cpu-py39-ubuntu20.04-sagemaker |
| TensorFlow 2.9.1 | training | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.9.1-gpu-py39-cu112-ubuntu20.04-sagemaker |
| TensorFlow 2.9.0 | inference | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.9.0-cpu-py39-ubuntu20.04-sagemaker |
| TensorFlow 2.9.0 | inference | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.9.0-gpu-py39-cu112-ubuntu20.04-sagemaker |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| NVIDIA Triton Inference Server 21.08 | inference | No | GPU | 3.8 (py38) | 007439368137.dkr.ecr.us-east-2.amazonaws.com/sagemaker-tritonserver:21.08-py3 |
| NVIDIA Triton Inference Server 21.08 | inference | No | CPU | 3.8 (py38) | 007439368137.dkr.ecr.us-east-2.amazonaws.com/sagemaker-tritonserver:21.08-py3-cpu |
| Framework | Job Type | Device Type | Python Version Options | Example URL |
|---|---|---|---|---|
| PyTorch 1.10.0 | training | HPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training-habana:1.10.0-hpu-py38-synapseai1.2.0-ubuntu20.04 |
| TensorFlow 2.7.0 | training | HPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training-habana:2.7.0-hpu-py38-synapseai1.2.0-ubuntu20.04 |
| Framework | AutoGluon Version | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| AutoGluon 0.4.2 | 0.4.2 | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-training:0.4.2-gpu-py38-cu112-ubuntu20.04 |
| AutoGluon 0.4.2 | 0.4.2 | training | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-training:0.4.2-cpu-py38-ubuntu20.04 |
| Framework | AutoGluon Version | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| AutoGluon 0.4.2 | 0.4.2 | inference | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-inference:0.4.2-gpu-py38-cu112-ubuntu20.04 |
| AutoGluon 0.4.2 | 0.4.2 | inference | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-inference:0.4.2-cpu-py38-ubuntu20.04 |
| Framework | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|
| PyTorch 1.10.2 with HuggingFace transformers | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04 |
| TensorFlow 2.6.3 with HuggingFace transformers | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-training:2.6.3-transformers4.17.0-gpu-py38-cu112-ubuntu20.04 |
| Framework | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|
| PyTorch 1.10.2 with HuggingFace transformers | inference | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-cpu-py38-ubuntu20.04 |
| PyTorch 1.10.2 with HuggingFace transformers | inference | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04 |
| TensorFlow 2.6.3 with HuggingFace transformers | inference | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-inference:2.6.3-transformers4.17.0-cpu-py38-ubuntu20.04 |
| TensorFlow 2.6.3 with HuggingFace transformers | inference | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-inference:2.6.3-transformers4.17.0-gpu-py38-cu112-ubuntu20.04 |
| Framework | Job Type | Python Version Options | Example URL |
|---|---|---|---|
| PyTorch 1.9.1 with Neuron Inference and HuggingFace transformers | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference-neuron:1.9.1-transformers4.12.3-neuron-py37-sdk1.17.1-ubuntu18.04 |
| Framework | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|
| TensorFlow 2.9.1 | training | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.9.1-gpu-py39-cu112-ubuntu20.04-sagemaker |
| PyTorch 1.10.2 with HuggingFace transformers and SageMaker Training Compiler | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-trcomp-training:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04 |
| TensorFlow 2.6.3 with HuggingFace transformers and SageMaker Training Compiler | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-trcomp-training:2.6.3-transformers4.17.0-gpu-py38-cu112-ubuntu20.04 |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| TensorFlow 2.3.0 with Elastic Inference | inference | No | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-eia:2.3.0-cpu-py37-ubuntu18.04 |
| TensorFlow 1.15.0 with Elastic Inference | inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-eia:1.15.0-cpu-py36-ubuntu18.04 |
| MXNet 1.7.0 with Elastic Inference | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference-eia:1.7.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.5.1 with Elastic Inference | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference-eia:1.5.1-cpu-py36-ubuntu16.04 |
| Framework | Job Type | Python Version Options | Example URL |
|---|---|---|---|
| PyTorch 1.10.2 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-neuron:1.10.2-neuron-py37-sdk1.19.0-ubuntu18.04 |
| TensorFlow 1.15.5 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-inference-neuron:1.15.5-neuron-py37-sdk1.19.0-ubuntu18.04 |
| Tensorflow 2.5.3 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-inference-neuron:2.5.3-neuron-py37-sdk1.19.0-ubuntu18.04 |
| MXNet 1.8.0 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/mxnet-inference-neuron:1.8.0-neuron-py37-sdk1.18.0-ubuntu18.04 |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| PyTorch 1.10.2 | training | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.10.2-cpu-py38-ubuntu20.04-e3 |
| PyTorch 1.10.2 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.10.2-gpu-py38-cu113-ubuntu20.04-e3 |
| PyTorch 1.10.2 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.10.2-cpu-py38-ubuntu20.04-e3 |
| PyTorch 1.10.2 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.10.2-gpu-py38-cu113-ubuntu20.04-e3 |
| TensorFlow 2.7.0 | training | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.7.0-cpu-py38-ubuntu20.04-e3 |
| TensorFlow 2.7.0 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.7.0-gpu-py38-cu112-ubuntu20.04-e3 |
| TensorFlow 2.7.0 | inference | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.7.0-cpu-py38-ubuntu20.04-e3 |
| TensorFlow 2.7.0 | inference | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.7.0-gpu-py38-cu112-ubuntu20.04-e3 |
| TensorFlow 2.8.0 | training | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.8.0-cpu-py39-ubuntu20.04-e3 |
| TensorFlow 2.8.0 | training | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.8.0-gpu-py39-cu112-ubuntu20.04-e3 |
| TensorFlow 2.8.0 | inference | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.8.0-cpu-py39-ubuntu20.04-e3 |
| TensorFlow 2.8.0 | inference | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.8.0-gpu-py39-cu112-ubuntu20.04-e3 |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| TensorFlow 2.8.0 | training | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.8.0-cpu-py39-ubuntu20.04-sagemaker |
| TensorFlow 2.8.0 | training | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.8.0-gpu-py39-cu112-ubuntu20.04-sagemaker |
| TensorFlow 2.8.0 | inference | Yes | CPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.8.0-cpu-py39-ubuntu20.04-sagemaker |
| TensorFlow 2.8.0 | inference | Yes | GPU | 3.9 (py39) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.8.0-gpu-py39-cu112-ubuntu20.04-sagemaker |
| TensorFlow 2.7.1 | training | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.7.1-cpu-py38-ubuntu20.04-sagemaker |
| TensorFlow 2.7.1 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.7.1-gpu-py38-cu112-ubuntu20.04-sagemaker |
| TensorFlow 2.7.0 | inference | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.7.0-cpu-py38-ubuntu20.04-sagemaker |
| TensorFlow 2.7.0 | inference | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.7.0-gpu-py38-cu112-ubuntu20.04-sagemaker |
| PyTorch 1.10.2 | training | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.10.2-cpu-py38-ubuntu20.04-sagemaker |
| PyTorch 1.10.2 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker |
| PyTorch 1.10.2 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.10.2-cpu-py38-ubuntu20.04-sagemaker |
| PyTorch 1.10.2 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| TensorFlow 2.6.2 | training | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.6.2-cpu-py38-ubuntu20.04 |
| TensorFlow 2.6.2 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.6.2-gpu-py38-cu112-ubuntu20.04 |
| TensorFlow 2.6.0 | inference | Yes | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.6.0-cpu-py38-ubuntu20.04 |
| TensorFlow 2.6.0 | inference | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.6.0-gpu-py38-cu112-ubuntu20.04 |
| MXNet 1.8.0 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.8.0-gpu-py37-cu110-ubuntu16.04 |
| MXNet 1.8.0 | training | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.8.0-cpu-py37-ubuntu16.04 |
| MXNet 1.8.0 | inference | No | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.8.0-gpu-py37-cu110-ubuntu16.04 |
| MXNet 1.8.0 | inference | No | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.8.0-cpu-py37-ubuntu16.04 |
| PyTorch 1.9.1 | training | Yes | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.9.1-gpu-py38-cu111-ubuntu20.04 |
| PyTorch 1.9.1 | training | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.9.1-cpu-py38-ubuntu20.04 |
| PyTorch 1.9.1 | inference | No | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.9.1-gpu-py38-cu111-ubuntu20.04 |
| PyTorch 1.9.1 | inference | No | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.9.1-cpu-py38-ubuntu20.04 |
| TensorFlow 2.5.0 | training | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.5.0-cpu-py37-ubuntu18.04 |
| TensorFlow 2.5.0 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.5.0-gpu-py37-cu112-ubuntu18.04 |
| TensorFlow 2.5.1 | inference | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.5.1-cpu-py37-ubuntu18.04 |
| TensorFlow 2.5.1 | inference | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.5.1-gpu-py37-cu112-ubuntu18.04 |
| TensorFlow 2.4.1 | training | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.4.1-cpu-py37-ubuntu18.04 |
| TensorFlow 2.4.1 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.4.1-gpu-py37-cu110-ubuntu18.04 |
| TensorFlow 2.4.1 | inference | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.4.1-cpu-py37-ubuntu18.04 |
| TensorFlow 2.4.1 | inference | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.4.1-gpu-py37-cu110-ubuntu18.04 |
| TensorFlow 1.15.5 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.15.5-gpu-py37-cu110-ubuntu18.04 |
| TensorFlow 1.15.5 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.15.5-gpu-py37-cu100-ubuntu18.04 |
| TensorFlow 1.15.5 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.15.5-gpu-py36-cu100-ubuntu18.04 |
| TensorFlow 1.15.5 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:1.15.5-gpu-py36-cu100-ubuntu18.04 |
| TensorFlow 1.15.5 | training | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.15.5-cpu-py37-ubuntu18.04 |
| TensorFlow 1.15.5 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.15.5-cpu-py36-ubuntu18.04 |
| TensorFlow 1.15.5 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:1.15.5-cpu-py36-ubuntu18.04 |
| PyTorch 1.8.1 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.8.1-gpu-py36-cu111-ubuntu18.04 |
| PyTorch 1.8.1 | training | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.8.1-cpu-py36-ubuntu18.04 |
| PyTorch 1.8.1 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.8.1-gpu-py36-cu111-ubuntu18.04 |
| PyTorch 1.8.1 | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.8.1-cpu-py36-ubuntu18.04 |
| PyTorch 1.7.1 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.7.1-gpu-py36-cu110-ubuntu18.04 |
| PyTorch 1.7.1 | training | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.7.1-cpu-py36-ubuntu18.04 |
| PyTorch 1.7.1 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.7.1-gpu-py36-cu110-ubuntu18.04 |
| PyTorch 1.7.1 | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.7.1-cpu-py36-ubuntu18.04 |
| TensorFlow 2.3.2 | training | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.3.2-cpu-py37-ubuntu18.04 |
| TensorFlow 2.3.2 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.3.2-gpu-py37-cu110-ubuntu18.04 |
| TensorFlow 2.3.2 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.3.2-gpu-py37-cu102-ubuntu18.04 |
| TensorFlow 2.3.2 | inference | No | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.3.2-cpu-py37-ubuntu18.04 |
| TensorFlow 2.3.2 | inference | No | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.3.2-gpu-py37-cu102-ubuntu18.04 |
| PyTorch 1.6.0 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.6.0-gpu-py36-cu110-ubuntu18.04 |
| PyTorch 1.6.0 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.6.0-gpu-py36-cu110-ubuntu16.04 |
| PyTorch 1.6.0 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.6.0-gpu-py36-cu101-ubuntu16.04 |
| PyTorch 1.6.0 | training | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.6.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.6.0 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.6.0-gpu-py36-cu101-ubuntu16.04 |
| PyTorch 1.6.0 | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.6.0-cpu-py36-ubuntu16.04 |
| MXNet 1.7.0 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.7.0-gpu-py36-cu101-ubuntu16.04 |
| MXNet 1.7.0 | training | Yes | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.7.0-cpu-py36-ubuntu16.04 |
| MXNet 1.7.0 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.7.0-gpu-py36-cu101-ubuntu16.04 |
| MXNet 1.7.0 | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.7.0-cpu-py36-ubuntu16.04 |
| TensorFlow 2.2.2 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.2.2-gpu-py37-cu102-ubuntu18.04 |
| TensorFlow 2.2.2 | training | Yes | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.2.2-gpu-py37-cu101-ubuntu18.04 |
| TensorFlow 2.2.2 | training | Yes | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.2.2-cpu-py37-ubuntu18.04 |
| TensorFlow 2.2.2 | inference | No | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.2.2-gpu-py37-cu102-ubuntu18.04 |
| TensorFlow 2.2.2 | inference | No | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference:2.2.2-cpu-py37-ubuntu18.04 |
| MXNet 1.6.0 | training | Yes | GPU | 2.7 (py27) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.6.0-gpu-py27-cu101-ubuntu16.04 |
| MXNet 1.6.0 | training, inference | Training: Yes, Inference: No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.6.0-gpu-py36-cu101-ubuntu16.04 |
| MXNet 1.6.0 | training, inference | Training: Yes, Inference: No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.6.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.5.1 | training | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.5.1-cpu-py36-ubuntu16.04 |
| PyTorch 1.5.1 | training | Yes | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.5.1-gpu-py36-cu101-ubuntu16.04 |
| PyTorch 1.5.1 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.5.1-gpu-py36-cu101-ubuntu16.04 |
| PyTorch 1.5.1 | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.5.1-cpu-py36-ubuntu16.04 |
| TensorFlow 2.1.3 | training, inference | Training: Yes, Inference: No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.1.3-cpu-py36-ubuntu18.04 |
| TensorFlow 2.1.3 | training, inference | Training: Yes, Inference: No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.1.3-gpu-py36-cu101-ubuntu18.04 |
| PyTorch 1.5.0 | training, inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.5.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.5.0 | training, inference | Training: Yes, Inference: No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.5.0-gpu-py36-cu101-ubuntu16.04 |
| MXNet 1.4.1 with Elastic Inference | inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference-eia:1.4.1-cpu-py36-ubuntu16.04 |
| PyTorch 1.4.0 | training | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.4.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.4.0 | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.4.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.4.0 | training | Yes | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.4.0-gpu-py36-cu101-ubuntu16.04 |
| PyTorch 1.4.0 | inference | No | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference:1.4.0-gpu-py36-cu101-ubuntu16.04 |
| TensorFlow 2.0.4 | training, inference | Training:Yes, Inference: No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.0.4-cpu-py36-ubuntu18.04 |
| TensorFlow 2.0.4 | training, inference | Training:Yes, Inference: No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:2.0.4-gpu-py36-cu100-ubuntu18.04 |
| TensorFlow 1.14.0 | training, inference | Training:Yes, Inference: No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.14.0-cpu-py36-ubuntu16.04 |
| TensorFlow 1.14.0 | training, inference | Training:Yes, Inference: No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training:1.14.0-gpu-py36-cu100-ubuntu16.04 |
| MXNet 1.4.1 | training, inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.4.1-cpu-py36-ubuntu16.04 |
| MXNet 1.4.1 | training, inference | No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-training:1.4.1-gpu-py36-cu100-ubuntu16.04 |
| PyTorch 1.3.1 | training, inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.3.1-cpu-py36-ubuntu16.04 |
| PyTorch 1.3.1 | training, inference | Training:Yes, Inference: No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.3.1-gpu-py36-cu101-ubuntu16.04 |
| PyTorch 1.2.0 | training, inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.2.0-cpu-py36-ubuntu16.04 |
| PyTorch 1.2.0 | training, inference | Training:Yes, Inference: No | GPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:1.2.0-gpu-py36-cu100-ubuntu16.04 |
| Framework | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|
| PyTorch 1.8.1 with HuggingFace transformers | training | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training:1.8.1-transformers4.10.2-gpu-py36-cu111-ubuntu18.04 |
| TensorFlow 2.4.3 with HuggingFace transformers | training | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-training:2.4.3-transformers4.10.2-gpu-py37-cu110-ubuntu18.04 |
| PyTorch 1.8.1 with HuggingFace transformers | inference | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.8.1-transformers4.10.2-cpu-py36-ubuntu18.04 |
| PyTorch 1.8.1 with HuggingFace transformers | inference | GPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.8.1-transformers4.10.2-gpu-py36-cu111-ubuntu18.04 |
| TensorFlow 2.4.3 with HuggingFace transformers | inference | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-inference:2.4.3-transformers4.10.2-cpu-py37-ubuntu18.04 |
| TensorFlow 2.4.3 with HuggingFace transformers | inference | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-inference:2.4.3-transformers4.10.2-gpu-py37-cu110-ubuntu18.04 |
| PyTorch 1.9.1 with HuggingFace transformers | inference | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.9.1-transformers4.12.3-cpu-py38-ubuntu20.04 |
| PyTorch 1.9.1 with HuggingFace transformers | inference | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.9.1-transformers4.12.3-gpu-py38-cu111-ubuntu20.04 |
| TensorFlow 2.5.1 with HuggingFace transformers | inference | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-inference:2.5.1-transformers4.12.3-cpu-py37-ubuntu18.04 |
| TensorFlow 2.5.1 with HuggingFace transformers | inference | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-inference:2.5.1-transformers4.12.3-gpu-py37-cu112-ubuntu18.04 |
| PyTorch 1.9.1 with HuggingFace transformers | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-training:1.9.1-transformers4.12.3-gpu-py38-cu111-ubuntu20.04 |
| TensorFlow 2.5.1 with HuggingFace transformers | training | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-training:2.5.1-transformers4.12.3-gpu-py37-cu112-ubuntu18.04 |
| Framework | AutoGluon Version | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| AutoGluon 0.3.2 | 0.3.1 | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-training:0.3.2-gpu-py38-cu112-ubuntu18.04 |
| AutoGluon 0.3.2 | 0.3.1 | training | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-training:0.3.2-cpu-py38-ubuntu18.04 |
| AutoGluon 0.3.2 | 0.3.1 | inference | CPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-inference:0.3.2-cpu-py38-ubuntu20.04 |
| AutoGluon 0.2.1 | 0.2.1 | training | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-training:0.2.1-gpu-py37-cu102-ubuntu18.04 |
| AutoGluon 0.2.1 | 0.2.1 | training | CPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/autogluon-training:0.2.1-cpu-py37-ubuntu18.04 |
| Framework | Job Type | Horovod Options | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|---|
| TensorFlow 2.0.0 with Elastic Inference | inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-eia:2.0.0-cpu-py36-ubuntu18.04 |
| MXNet 1.5.1 with Elastic Inference | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference-eia:1.5.1-cpu-py36-ubuntu16.04 |
| PyTorch 1.3.1 with Elastic Inference | inference | No | CPU | 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference-eia:1.3.1-cpu-py36-ubuntu16.04 |
| TensorFlow 1.14.0 with Elastic Inference | inference | No | CPU | 2.7 (py27), 3.6 (py36) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-eia:1.14.0-cpu-py36-ubuntu16.04 |
| Framework | Job Type | Python Version Options | Example URL |
|---|---|---|---|
| PyTorch 1.10.1 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-inference-neuron:1.10.1-neuron-py37-sdk1.17.1-ubuntu18.04 |
| TensorFlow 1.15.5 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-neuron:1.15.5-neuron-py37-sdk1.17.1-ubuntu18.04 |
| Tensorflow 2.5.2 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-inference-neuron:2.5.2-neuron-py37-sdk1.17.1-ubuntu18.04 |
| MXNet 1.8.0 with Neuron Inference | inference | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference-neuron:1.8.0-neuron-py37-sdk1.17.1-ubuntu18.04 |
| Framework | Job Type | Device Type | Python Version Options | Example URL |
|---|---|---|---|---|
| PyTorch 1.7.1 | training | HPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training-habana:1.7.1-hpu-py37-synapseai0.15.4-ubuntu18.04 |
| TensorFlow 2.5.0 | training | HPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/tensorflow-training-habana:2.5.0-hpu-py37-synapseai0.15.4-ubuntu18.04 |
| Framework | Job Type | CPU/GPU | Python Version Options | Example URL |
|---|---|---|---|---|
| PyTorch 1.9.0 with HuggingFace transformers and SageMaker Training Compiler | training | GPU | 3.8 (py38) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-trcomp-training:1.9.0-transformers4.11.0-gpu-py38-cu111-ubuntu20.04 |
| TensorFlow 2.5.1 with HuggingFace transformers and SageMaker Training Compiler | training | GPU | 3.7 (py37) | 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-tensorflow-trcomp-training:2.5.1-transformers4.11.0-gpu-py37-cu112-ubuntu18.04 |