From 82f86323044f7a27fe20901bad21049dba6ab089 Mon Sep 17 00:00:00 2001 From: Paul-Cornell Date: Fri, 20 Sep 2024 16:05:15 -0700 Subject: [PATCH] Add number of dimensions to embedding models (#247) --- platform/embedding.mdx | 30 +++++++++++++++--------------- 1 file changed, 15 insertions(+), 15 deletions(-) diff --git a/platform/embedding.mdx b/platform/embedding.mdx index 7681380d..18786bbc 100644 --- a/platform/embedding.mdx +++ b/platform/embedding.mdx @@ -63,30 +63,30 @@ To generate embeddings, choose one of the following embedding providers in the * - **OpenAI**: Use [OpenAI](https://openai.com) to generate embeddings. Also choose the embedding model to use, from one of the following: - - **text-embedding-3-small**: [Learn more](https://platform.openai.com/docs/guides/embeddings). - - **text-embedding-3-large**: [Learm more](https://platform.openai.com/docs/guides/embeddings). - - **Ada 002 (Text)**: [Learn more](https://platform.openai.com/docs/guides/embeddings). + - **text-embedding-3-small** (1536 dimensions): [Learn more](https://platform.openai.com/docs/guides/embeddings). + - **text-embedding-3-large** (3072 dimensions): [Learm more](https://platform.openai.com/docs/guides/embeddings). + - **Ada 002 (Text)** (1536 dimensions): [Learn more](https://platform.openai.com/docs/guides/embeddings). - **Anthropic**: Use [Anthropic](https://www.anthropic.com) to generate embeddings. Also choose the embedding model to use, from one of the following: - - **voyage-2**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). - - **voyage-large-2**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). - - **voyage-code-2**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). - - **voyage-lite-02-instruct**: [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). + - **voyage-2** (1024 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). + - **voyage-large-2** (1536 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). + - **voyage-code-2** (1536 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). + - **voyage-lite-02-instruct** (1024 dimensions): [Learn more](https://docs.anthropic.com/en/docs/build-with-claude/embeddings#available-voyage-models). - **Hugging Face**: Use [Hugging Face](https://huggingface.co) to generate embeddings. Also choose the embedding model to use, from one of the following: - - **nvidia/NV-Embed-v1**: [Learn more](https://huggingface.co/nvidia/NV-Embed-v1). - - **voyage-large-2-instruct**: [Learn more](https://huggingface.co/voyageai/voyage-large-2-instruct). - - **stella_en_400M_v5**: [Learn more](https://huggingface.co/dunzhang/stella_en_400M_v5). - - **stella_en_1.5B_v5**: [Learn more](https://huggingface.co/dunzhang/stella_en_1.5B_v5). - - **Alibaba-NLP/gte-Qwen2-7B-instruct**: [Learn more](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct). + - **nvidia/NV-Embed-v1** (4096 dimensions): [Learn more](https://huggingface.co/nvidia/NV-Embed-v1). + - **voyage-large-2-instruct** (1024 dimensions): [Learn more](https://huggingface.co/voyageai/voyage-large-2-instruct). + - **stella_en_400M_v5** (1024 dimensions): [Learn more](https://huggingface.co/dunzhang/stella_en_400M_v5). + - **stella_en_1.5B_v5** (1024 dimensions): [Learn more](https://huggingface.co/dunzhang/stella_en_1.5B_v5). + - **Alibaba-NLP/gte-Qwen2-7B-instruct** (3584 dimensions): [Learn more](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct). - **OctoAI**: Use [OctoAI](https://octo.ai) to generate embeddings. Also choose the embedding model to use, from one of the following: - - **GTE Large**: [Learn more](https://octo.ai/blog/introducing-octoais-embedding-api-to-power-your-rag-needs/). + - **GTE Large** (1024 dimensions): [Learn more](https://octo.ai/blog/introducing-octoais-embedding-api-to-power-your-rag-needs/). - **Vertex AI**: Use [Vertex AI](https://cloud.google.com/vertex-ai) to generate embeddings. Also choose the embedding model to use, from one of the following: - - **textembedding-gecko@003**: [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions). - - **text-embedding-004**: [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions). + - **textembedding-gecko@003** (768 dimensions): [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions). + - **text-embedding-004** (768 dimensions): [Learn more](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#embeddings_stable_model_versions).