Google Gemini¶
To start using a Google Gemini model with Cognigy.AI features, follow these steps:
Add a Model¶
You can add a model using one of the following interfaces:
Add a Model via GUI¶
You can add a model provided by Google Gemini to Cognigy.AI in Build > LLM. To add the model, you will need the following parameters:
| Parameter | Description |
|---|---|
| JSON | To upload the JSON file with a key for your model, you need to obtain this key. If you have previously used a key for the Google Vertex AI connection, you can also use this key for Google Gemini. If you're setting up the connection for the first time, go to the Google Cloud console and find Vertex AI via the search bar. On the Vertex AI page, click the Enable All Recommended APIs button to activate an API connection, if it is not activated. Ensure that the Vertex AI API is enabled. In the left-side menu, go to the IAM & Admin > Service Accounts. Select Actions and click Manage Keys. On the Keys page, select Add Key and click Create new Key. In the appeared window, select the JSON key type and click Create. The file will be downloaded. |
| Location | Add a region for the model. For example, us-central1. |
| Parameter | Description |
|---|---|
| Model Type | Select the Chat type. |
| Model Name | Enter the name of the model that you want to use as a custom model. To find model names, refer to the Google Gemini documentation. Note that, within this connection, Cognigy supports only the gemini models. |
| JSON | To upload the JSON file with a key for your model, you need to obtain this key. If you have previously used a key for the Google Vertex AI connection, you can also use this key for Google Gemini. If you're setting up the connection for the first time, go to the Google Cloud console and find Vertex AI via the search bar. On the Vertex AI page, click the Enable All Recommended APIs button to activate an API connection, if it is not activated. Ensure that the Vertex AI API is enabled. In the left-side menu, go to the IAM & Admin > Service Accounts. Select Actions and click Manage Keys. On the Keys page, select Add Key and click Create new Key. In the appeared window, select the JSON key type and click Create. The file will be downloaded. |
| Location | Add a region for the model. For example, us-central1. |
Apply changes. Check if the connection was set up by clicking Test.
Add a Model via the API¶
You can add either a standard or custom model using the Cognigy.AI API POST /v2.0/largelanguagemodels request. Then, test your connection for the created model via the Cognigy.AI API POST /v2.0/largelanguagemodels/{largeLanguageModelId}/test.
Apply the Model¶
To apply a model, follow these steps:
- In the left-side menu of the Project, go to Manage > Settings.
- Go to the section based on your use case for using a model:
- Generative AI Settings. In the Generative AI Settings section, activate Enable Generative AI Features. This setting is toggled on by default if you have previously set up the Generative AI credentials.
- Knowledge AI Settings. Use this section if you need to add a model for Knowledge AI. Select a model for the Knowledge Search and Answer Extraction features. Refer to the list of standard models and find the models that support these features.
- Navigate to the desired feature and select a model from the list. If there are no models available for the selected feature, the system will automatically select None. Save changes.