Bedrock

Amazon Bedrock is a fully managed service that makes FMs from leading AI startups and Amazon available via an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case

%pip install boto3

from langchain.llms import Bedrock

llm = Bedrock(
    credentials_profile_name="bedrock-admin",
    model_id="amazon.titan-tg1-large"
)

API Reference:

• Bedrock

Using in a conversation chain

from langchain.chains import ConversationChain
from langchain.memory import ConversationBufferMemory

conversation = ConversationChain(
    llm=llm, verbose=True, memory=ConversationBufferMemory()
)

conversation.predict(input="Hi there!")

API Reference:

• ConversationChain
• ConversationBufferMemory

Conversation Chain With Streaming

from langchain.llms import Bedrock
from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler


llm = Bedrock(
    credentials_profile_name="bedrock-admin",
    model_id="amazon.titan-tg1-large",
    streaming=True,
    callbacks=[StreamingStdOutCallbackHandler()],
)

API Reference:

• Bedrock
• StreamingStdOutCallbackHandler

conversation = ConversationChain(
    llm=llm, verbose=True, memory=ConversationBufferMemory()
)

conversation.predict(input="Hi there!")