Amazon Bedrock¶
To start using an Amazon Bedrock model with Cognigy.AI features, follow these steps:
Add a Model¶
To add a model provided by Amazon Bedrock to Cognigy.AI, follow these steps:
- Open the Cognigy.AI interface.
- Go to Build > LLM.
- Click +New LLM.
- In the New LLM window, select a model from the Model Type list.
- Add a unique name and description for your model.
-
From the Provider list, select an LLM's provider:
6.1 From the Model list, select Custom Model and configure the following fields:
- Model Type — select the Chat type for models that support the Converse API. Note that the model will only work if your AWS admin gives you access to this model.
- Model Name — specify an ID of the model that you want to use as a custom. To find model IDs, refer to the Amazon Bedrock documentation.
6.2 Click Save.
6.3 Fill in the following fields:
- Connection name — create a unique name for your connection.
- Access Key ID — specify an Access Key ID. Log in to the AWS Management Console, go to the IAM dashboard, select Users, and choose the IAM user. Navigate to the Security credentials tab, and under Access keys, create a new access key if one hasn't been created. Copy the Access Key ID provided after creation.
- Secret Access Key — specify a Secret Access Key. After creating the access key, you'll be prompted to download a file containing the Access Key ID and the Secret Access Key. Alternatively, you can retrieve the Secret Access Key by navigating to the IAM dashboard, selecting the user, going to the Security credentials tab, and clicking Show next to the Access Key ID to reveal and copy the Secret Access Key.
6.4 Click Create.
6.5 Fill in the remaining field:
- Region — enter the AWS region where your model is located, for example,us-east-1
for the US East (N. Virginia) region. -
To apply changes, click Save.
- To check if the connection was set up, click Test.
When the model is added, you will see it in the list of models.
To apply this model for Cognigy.AI features, go to the settings by clicking Manage LLM Features.
Apply the Model¶
To apply a model, follow these steps:
- Open the Cognigy.AI interface.
- In the left-side menu, click Manage > Settings.
- Go to the section based on your use case for using a model:
- Generative AI Settings. In the Generative AI Settings section, activate Enable Generative AI Features. This setting is toggled on by default if you have previously set up the Generative AI credentials.
- Knowledge AI Settings. Use this section if you need to add a model for Knowledge AI. Select a model for the Knowledge Search and Answer Extraction features. Refer to the list of standard models and find the models that support these features.
- Navigate to the desired feature and select a model from the list. If there are no models available for the selected feature, the system will automatically select None.
- Click Save.