Add number of dimensions to embedding models (#247)

Unstructured-IO · Sep 20, 2024 · 82f8632 · 82f8632
1 parent 00db30f
commit 82f8632
Showing 1 changed file with 15 additions and 15 deletions.
diff --git a/platform/embedding.mdx b/platform/embedding.mdx
@@ -63,30 +63,30 @@ To generate embeddings, choose one of the following embedding providers in the *
 
 - **OpenAI**: Use [OpenAI](https://openai.com) to generate embeddings. Also choose the embedding model to use, from one of the following:
 
-  - **text-embedding-3-small**: [Learn more](https://platform.openai.com/docs/guides/embeddings).
-  - **text-embedding-3-large**: [Learm more](https://platform.openai.com/docs/guides/embeddings).
-  - **Ada 002 (Text)**: [Learn more](https://platform.openai.com/docs/guides/embeddings).
+  - **text-embedding-3-small** (1536 dimensions): [Learn more](https://platform.openai.com/docs/guides/embeddings).
+  - **text-embedding-3-large** (3072 dimensions): [Learm more](https://platform.openai.com/docs/guides/embeddings).
+  - **Ada 002 (Text)** (1536 dimensions): [Learn more](https://platform.openai.com/docs/guides/embeddings).
 
 - **Anthropic**: Use [Anthropic](https://www.anthropic.com) to generate embeddings. Also choose the embedding model to use, from one of the following:
 
-  - **voyage-2**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
-  - **voyage-large-2**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
-  - **voyage-code-2**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
-  - **voyage-lite-02-instruct**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
+  - **voyage-2** (1024 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
+  - **voyage-large-2** (1536 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
+  - **voyage-code-2** (1536 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
+  - **voyage-lite-02-instruct** (1024 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models).
 
 - **Hugging Face**: Use [Hugging Face](https://huggingface.co) to generate embeddings. Also choose the embedding model to use, from one of the following:
 
-  - **nvidia/NV-Embed-v1**: [Learn more](https://huggingface.co/nvidia/NV-Embed-v1).
-  - **voyage-large-2-instruct**: [Learn more](https://huggingface.co/voyageai/voyage-large-2-instruct).
-  - **stella_en_400M_v5**: [Learn more](https://huggingface.co/dunzhang/stella_en_400M_v5).
-  - **stella_en_1.5B_v5**: [Learn more](https://huggingface.co/dunzhang/stella_en_1.5B_v5).
-  - **Alibaba-NLP/gte-Qwen2-7B-instruct**: [Learn more](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct).
+  - **nvidia/NV-Embed-v1** (4096 dimensions): [Learn more](https://huggingface.co/nvidia/NV-Embed-v1).
+  - **voyage-large-2-instruct** (1024 dimensions): [Learn more](https://huggingface.co/voyageai/voyage-large-2-instruct).
+  - **stella_en_400M_v5** (1024 dimensions): [Learn more](https://huggingface.co/dunzhang/stella_en_400M_v5).
+  - **stella_en_1.5B_v5** (1024 dimensions): [Learn more](https://huggingface.co/dunzhang/stella_en_1.5B_v5).
+  - **Alibaba-NLP/gte-Qwen2-7B-instruct** (3584 dimensions): [Learn more](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct).
 
 - **OctoAI**: Use [OctoAI](https://octo.ai) to generate embeddings. Also choose the embedding model to use, from one of the following:
 
-  - **GTE Large**: [Learn more](https://octo.ai/blog/introducing-octoais-embedding-api-to-power-your-rag-needs/).
+  - **GTE Large** (1024 dimensions): [Learn more](https://octo.ai/blog/introducing-octoais-embedding-api-to-power-your-rag-needs/).
 
 - **Vertex AI**: Use [Vertex AI](https://cloud.google.com/vertex-ai) to generate embeddings. Also choose the embedding model to use, from one of the following:
 
-  - **textembedding-gecko@003**: [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions).
-  - **text-embedding-004**: [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions).
+  - **textembedding-gecko@003** (768 dimensions): [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions).
+  - **text-embedding-004** (768 dimensions): [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions).