Skip to content

Commit

Permalink
Align info on NNCF and Optimum Intel
Browse files Browse the repository at this point in the history
  • Loading branch information
sgolebiewski-intel committed Nov 14, 2024
1 parent 5b49f02 commit 2b49732
Showing 1 changed file with 6 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -143,7 +143,12 @@ environment by running the following command:
pip install optimum[openvino]
If the model comes from `Hugging Face <https://huggingface.co/models>`__ and is supported
by Optimum, it may be easier to use the Optimum Intel API to perform weight compression.
by Optimum, it may be easier to use the **Optimum Intel API**, which employs NNCF weight
compression capabilities to optimize various large Transformer models.

The NNCF ``nncf.compress_weights()`` API, with most of its options, is exposed in the
``.from_pretrained()`` method of Optimum Intel classes. Optimum also has several datasets
for data-aware quantization available out-of-the-box.

.. tab-set::

Expand Down

0 comments on commit 2b49732

Please sign in to comment.