Skip to content

Commit

Permalink
update README memory requirements (#2342)
Browse files Browse the repository at this point in the history
  • Loading branch information
Sara Adkins committed Jun 20, 2024
1 parent 038d1e5 commit 634bc67
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/llama7b_sparse_quantized/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

This example uses SparseML and Compressed-Tensors to create a 2:4 sparse and quantized Llama2-7b model.
The model is calibrated and trained with the ultachat200k dataset.
At least 75GB of GPU memory is required to run this example.
At least 85GB of GPU memory is required to run this example.

Follow the steps below one by one in a code notebook, or run the full example script
as `python examples/llama7b_sparse_quantized/llama7b_sparse_w4a16.py`
Expand Down

0 comments on commit 634bc67

Please sign in to comment.