Skip to content

Google

To start using a Google Vertex AI or Gemini model with Cognigy.AI features, follow these steps:

  1. Add a Model
  2. Apply the Model

Add a Model

To add a model provided by Google to Cognigy.AI, follow these steps:

  1. Open the Cognigy.AI interface.
  2. Go to Build > LLM.
  3. Click +New LLM.
  4. In the New LLM window, select a model from the Model Type list.
  5. Add a unique name and description for your model.

  6. From the Provider list, select an LLM's provider:

    6.1 From the Model list, select a model presented in the list or add a custom model that is not listed. If you select Custom Model, configure the following fields:
    - Model Type — select the Completion type.
    - Model Name — specify a name of the model that you want to use as a custom. To find model names, refer to the Google Vertex AI documentation. Note that, within this connection, Cognigy supports only the text-bison models.
    6.2 Click Save.
    6.3 Fill in the Connection name field by specifying a unique name for your connection.
    6.4 To upload the JSON file with a key for your model, you need to obtain this key. Go to the Google Cloud console and find Vertex AI via the search bar.
    6.5 On the Vertex AI page, click the Enable All Recommended APIs button to activate an API connection, if it is not activated. Ensure that the Vertex AI API is enabled.
    6.6 In the left-side menu, go to the IAM & Admin > Service Accounts.
    6.7 Select Actions and click Manage Keys.
    6.8 On the Keys page, select Add Key and click Create new Key.
    6.9 In the appeared window, select the JSON key type and click Create. The file will be downloaded.
    6.10 In Cognigy, in the New Connection window, click Upload JSON file and upload the file.
    6.11 Click Create.
    6.12 Fill in the remaining fields:
    - Location — add a region for the model. For example, us-central1.
    - API Endpoint — add a service endpoint for the model. For example, us-central1-aiplatform.googleapis.com. Note that the endpoint should be specified without https:// or http://.
    - Publisher — add an owner's name of the model. If not specified, Google will be used by default. This parameter is optional.

    6.1 From the Model list, select a model presented in the list or add a custom model that is not listed. If you select Custom Model, configure the following fields:
    - Model Type — select the Chat type.
    - Model Name — specify a name of the model that you want to use as a custom. To find model names, refer to the Google Gemini documentation. Note that, within this connection, Cognigy supports only the gemini models.
    6.2 Click Save.
    6.3 Fill in the Connection name field by specifying a unique name for your connection.
    6.4 To upload the JSON file with a key for your model, you need to obtain this key. If you have previously used a key for the Google Vertex AI connection, you can also use this key for Google Gemini; proceed to step 6.10 to add the key. If you're setting up the connection for the first time, go to the Google Cloud console and find Vertex AI via the search bar.
    6.5 On the Vertex AI page, click the Enable All Recommended APIs button to activate an API connection, if it is not activated. Ensure that the Vertex AI API is enabled.
    6.6 In the left-side menu, go to the IAM & Admin > Service Accounts.
    6.7 Select Actions and click Manage Keys.
    6.8 On the Keys page, select Add Key and click Create new Key.
    6.9 In the appeared window, select the JSON key type and click Create. The file will be downloaded.
    6.10 In Cognigy, in the New Connection window, click Upload JSON file and upload the file.
    6.11 Click Create.
    6.12 In the Location field, add a region for the model. For example, us-central1.

  7. To apply changes, click Save.

  8. To check if the connection was set up, click Test.

When the model is added, you will see it in the list of models.

To apply this model for Cognigy.AI features, go to the settings by clicking Manage LLM Features.

Apply the Model

To apply a model, follow these steps:

  1. Open the Cognigy.AI interface.
  2. In the left-side menu, click Manage > Settings.
  3. Go to the section based on your use case for using a model:
    • Generative AI Settings. In the Generative AI Settings section, activate Enable Generative AI Features. This setting is toggled on by default if you have previously set up the Generative AI credentials.
    • Knowledge AI Settings. Use this section if you need to add a model for Knowledge AI. Select a model for the Knowledge Search and Answer Extraction features. Refer to the list of standard models and find the models that support these features.
  4. Navigate to the desired feature and select a model from the list. If there are no models available for the selected feature, the system will automatically select None.
  5. Click Save.

More Information