new release for sagemaker torch version fix

aws-samples · Oct 28, 2024 · b7290a8 · b7290a8
1 parent 95ef84e
commit b7290a8
Show file tree

Hide file tree

Showing 5 changed files with 15 additions and 3 deletions.
diff --git a/README.md b/README.md
@@ -86,6 +86,9 @@ Llama3 is now available on SageMaker (read [blog post](https://aws.amazon.com/bl
 
 ## New in this release
 
+## 2.0.16
+1. Update to torch 2.4 for compatibility with SageMaker Notebooks.
+
 ## 2.0.15
 1. Support for [Ollama](https://github.com/ollama/ollama), see more details [here](https://aws-samples.github.io/foundation-model-benchmarking-tool/benchmarking_on_ec2.html#benchmarking-models-on-ollama).
 1. Fix bugs with token counting.
@@ -95,9 +98,7 @@ Llama3 is now available on SageMaker (read [blog post](https://aws.amazon.com/bl
 1. `Llama3.1-70b` config files and more.
 1. Support for [`fmbench-orchestrator`](https://github.com/awslabs/fmbench-orchestrator).
 
-## 2.0.13
 
-1. Update `pricing.yml` additional config files.
 
 
 [Release history](./release_history.md)

diff --git a/docs/releases.md b/docs/releases.md
@@ -1,5 +1,8 @@
 # Releases
 
+## 2.0.16
+1. Update to torch 2.4 for compatibility with SageMaker Notebooks.
+
 ## 2.0.15
 1. Support for [Ollama](https://github.com/ollama/ollama), see more details [here](https://aws-samples.github.io/foundation-model-benchmarking-tool/benchmarking_on_ec2.html#benchmarking-models-on-ollama).
 1. Fix bugs with token counting.

diff --git a/pyproject.toml b/pyproject.toml
@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "fmbench"
-version = "2.0.15"
+version = "2.0.16"
 description ="Benchmark performance of **any Foundation Model (FM)** deployed on **any AWS Generative AI service**, be it **Amazon SageMaker**, **Amazon Bedrock**, **Amazon EKS**, or **Amazon EC2**. The FMs could be deployed on these platforms either directly through `FMbench`, or, if they are already deployed then also they could be benchmarked through the **Bring your own endpoint** mode supported by `FMBench`."
 authors = ["Amit Arora <[email protected]>", "Madhur Prashant <[email protected]>"]
 readme = "README.md"

diff --git a/release_history.md b/release_history.md
@@ -1,3 +1,9 @@
+
+## 2.0.13
+
+1. Update `pricing.yml` additional config files.
+
+
 ## 2.0.11
 
 1. `Llama3.2-1b` and `Llama3.2-3b` support on EC2 g5.

diff --git a/src/fmbench/configs/pricing.yml b/src/fmbench/configs/pricing.yml
@@ -2,6 +2,8 @@ pricing:
   instance_based:
     # Instance Based Pricing: SageMaker, EKS, Bedrock Provisioned Throughput, Bring your own endpoints that are priced hourly
     # SageMaker Hourly Instance Pricing
+    ml.c5.xlarge: 0.1700
+    ml.c5.4xlarge: 0.6800
     ml.m5.xlarge: 0.23
     ml.g5.xlarge: 1.4084
     ml.g5.4xlarge: 2.03