Text embedding models | 🦜️🔗 Langchain

📄️ Aleph Alpha

There are two possible ways to use Aleph Alpha's semantic embeddings. If you have texts with a dissimilar structure (e.g. a Document and a Query) you would want to use asymmetric embeddings. Conversely, for texts with comparable structures, symmetric embeddings are the suggested approach.

📄️ AwaDB

AwaDB is an AI Native database for the search and storage of embedding vectors used by LLM Applications.

📄️ AzureOpenAI

Let's load the OpenAI Embedding class with environment variables set to indicate to use Azure endpoints.

📄️ Baidu Qianfan

Baidu AI Cloud Qianfan Platform is a one-stop large model development and service operation platform for enterprise developers. Qianfan not only provides including the model of Wenxin Yiyan (ERNIE-Bot) and the third-party open source models, but also provides various AI development tools and the whole set of development environment, which facilitates customers to use and develop large model applications easily.

📄️ Bedrock

Amazon Bedrock is a fully managed service that makes FMs from leading AI startups and Amazon available via an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case.

📄️ BGE on Hugging Face

BGE models on the HuggingFace are the best open-source embedding models.

📄️ Clarifai

Clarifai is an AI Platform that provides the full AI lifecycle ranging from data exploration, data labeling, model training, evaluation, and inference.

📄️ Cohere

Let's load the Cohere Embedding class.

📄️ DashScope

Let's load the DashScope Embedding class.

📄️ DeepInfra

DeepInfra is a serverless inference as a service that provides access to a variety of LLMs and embeddings models. This notebook goes over how to use LangChain with DeepInfra for text embeddings.

📄️ EDEN AI

Eden AI is revolutionizing the AI landscape by uniting the best AI providers, empowering users to unlock limitless possibilities and tap into the true potential of artificial intelligence. With an all-in-one comprehensive and hassle-free platform, it allows users to deploy AI features to production lightning fast, enabling effortless access to the full breadth of AI capabilities via a single API. (website//edenai.co/)

📄️ Elasticsearch

Walkthrough of how to generate embeddings using a hosted embedding model in Elasticsearch

📄️ Embaas

embaas is a fully managed NLP API service that offers features like embedding generation, document text extraction, document to embeddings and more. You can choose a variety of pre-trained models.

📄️ ERNIE Embedding-V1

ERNIE Embedding-V1 is a text representation model based on Baidu Wenxin's large-scale model technology,

📄️ Fake Embeddings

LangChain also provides a fake embedding class. You can use this to test your pipelines.

📄️ Google Vertex AI PaLM

Vertex AI PaLM API is a service on Google Cloud exposing the embedding models.

📄️ GPT4All

GPT4All is a free-to-use, locally running, privacy-aware chatbot. There is no GPU or internet required. It features popular models and its own models such as GPT4All Falcon, Wizard, etc.

📄️ Hugging Face

Let's load the Hugging Face Embedding class.

📄️ InstructEmbeddings

Let's load the HuggingFace instruct Embeddings class.

📄️ Jina

Let's load the Jina Embedding class.

📄️ Llama-cpp

This notebook goes over how to use Llama-cpp embeddings within LangChain

📄️ LocalAI

Let's load the LocalAI Embedding class. In order to use the LocalAI Embedding class, you need to have the LocalAI service hosted somewhere and configure the embedding models. See the documentation at https//localai.io/features/embeddings/index.html.

📄️ MiniMax

MiniMax offers an embeddings service.

📄️ ModelScope

ModelScope is big repository of the models and datasets.

📄️ MosaicML

MosaicML offers a managed inference service. You can either use a variety of open source models, or deploy your own.

📄️ NLP Cloud

NLP Cloud is an artificial intelligence platform that allows you to use the most advanced AI engines, and even train your own engines with your own data.

📄️ Ollama

Let's load the Ollama Embeddings class.

📄️ OpenAI

Let's load the OpenAI Embedding class.

📄️ SageMaker

Let's load the SageMaker Endpoints Embeddings class. The class can be used if you host, e.g. your own Hugging Face model on SageMaker.

📄️ Self Hosted

Let's load the SelfHostedEmbeddings, SelfHostedHuggingFaceEmbeddings, and SelfHostedHuggingFaceInstructEmbeddings classes.

📄️ Sentence Transformers

SentenceTransformers embeddings are called using the HuggingFaceEmbeddings integration. We have also added an alias for SentenceTransformerEmbeddings for users who are more familiar with directly using that package.

📄️ SpaCy

spaCy is an open-source software library for advanced natural language processing, written in the programming languages Python and Cython.

📄️ TensorflowHub

Let's load the TensorflowHub Embedding class.

📄️ Xorbits inference (Xinference)

This notebook goes over how to use Xinference embeddings within LangChain