Skip to content

Generative AI

Version badge

Note

You are subject to the terms of the Generative AI model providers to which you are connecting. Cognigy cannot take responsibility for your use of third-party services, systems, or materials.

Generative AI refers to a type of artificial intelligence that creates new, original content, such as images, video, audio, and text, using machine learning algorithms. It works by learning from existing data and producing new content based on that learning.

Cognigy.AI integrates with the Generative AI providers that allow text generation based on user input. That involves utilizing Large Language Models (LLMs) to analyze data and generate contextually relevant and personalized content.

In the Cognigy.AI interface, LLMs generate human-like and personalized content for a bot. It can be used for the following purposes:

To know more about the benefits of integrating Conversational AI with Generative AI platforms, watch this webinar:

Prerequisites

Before using this feature, you need to create an account in one of the Generative AI Providers:

  • OpenAI. You need to have a paid account or be a member of an organization that provides you access. Open your OpenAI user profile, copy the existing API Key, or create a new one and copy it.
  • Azure OpenAI. You need to have a paid account or be a member of an organization that provides you access. Ask your Azure Administrator to provide API Key, resource name, and deployment model name.
  • Anthropic Claude. You need to be a member of an organization that provides you access.
  • Google Vertex AI. You need to have a paid account or be a member of an organization that provides you access.

Set up Generative AI

To set up the connection between Cognigy.AI and the Generative AI Provider, do the following:

Add a Model

  1. Open the Cognigy.AI interface.
  2. Go to Build > LLM.
  3. Click +New LLM.
  4. In the New LLM window, select a model from the Model Type list.
  5. Add a unique name and description for your model and click Save.
  6. In the LLM Editor window, go to the Generative AI Connection field.
  7. On the right side of the field, click +.

  8. Depends on your model provider, do the following:

    8.1 Fill in the following fields:
    - Connection name — create a unique name for your connection.
    - apiKey — add an Azure API Key. This value can be found in the Keys & Endpoint section when examining your resource from the Azure portal. You can use either KEY1 or KEY2.
    - resourceName — add a resource name. This value can be found under Resource Management > Deployments in the Azure portal or alternatively under Management > Deployments in Azure OpenAI Studio.
    8.2 Click Create.
    8.3 Fill in the remaining fields:
    - deploymentName — add a model name.
    - apiVersion — add an API version. The API version to use for this operation in the YYYY-MM-DD format.

    8.1 Fill in the following fields:
    - Connection name — create a unique name for your connection.
    - apiKey — add an API Key from your OpenAI account. You can find this key in the User settings of your OpenAI account.
    8.2 Click Create.

    8.1 Fill in the following fields:
    - Connection name — create a unique name for your connection.
    - apiKey — add an API Key that you generated via Account Settings in Anthropic.
    8.2 Click Create.

    8.1 Fill in the Connection name field by specifying a unique name for your connection.
    8.2 To upload the JSON file with a key for your model, you need to obtain this key. Go to the Google Vertex AI console.
    8.3 Click the Enable All Recommended APIs button to activate an API connection, if it is not activated. Make sure that the Vertex AI API are enabled.
    8.4 In the left-side menu, go to the IAM & Admin > Service Accounts.
    8.5 Select Actions and click Manage Keys.
    8.6 On the Keys page, select Add Key and click Create new Key.
    8.7 In the appeared window, select the JSON key type and click Create. The file will be downloaded.
    8.8 In Cognigy, in the New Connection window, click Upload JSON file and upload the file.
    8.9 Click Create.
    8.10 Fill in the remaining fields:
    - Location — add a region for the model. For example, us-central1.
    - API Endpoint — add a service endpoint for the model. For example, us-central1-aiplatform.googleapis.com. Note that the endpoint should be specified without https:// or http://.
    - Publisher — add an owner's name of the model. If not specified, Google will be used by default. This parameter is optional.

  9. To apply changes, click Save.

  10. To check if the connection was set up, click Test.

When the model is added, you will see it in the list of models.

To apply this model for Cognigy features, go to the settings by clicking Manage LLM Features.

Apply the Model

To apply a model, follow these steps:

  1. Open the Cognigy.AI interface.
  2. In the left-side menu, click Manage > Settings.
  3. In the Generative AI Settings section, activate Enable Generative AI Features. This setting is toggled on by default if you have previously set up the Generative AI credentials.
  4. Navigate to the desired feature and choose a model from the list. If there are no models available for the selected feature, the system will automatically select None.
  5. Click Save.

You can check if the connection works by creating a new generative AI Flow.

Generate Lexicons

Note that the generation of Lexicons for primary NLU languages besides German and English is not fully supported.

To use Generative AI technology for creating a new Lexicon, do the following:

  1. In the left-side menu of the Cognigy.AI interface, click Build > Lexicons.
  2. Click + New Lexicon.
  3. In the New Lexicon window, specify the name covering the Lexicon's general main topic and add a relevant description. It helps generate a more accurate result. To ensure that the generated content meets the desired expectations, fill in both fields. Relying solely on the title without using the description field will not produce the intended results.
  4. Go to the Lexicon Entry Generation setting, and activate Generate Lexicon Entries.
  5. Select Lexicon language from the list.
  6. Set the number of entries (lexicon units).
  7. (Optional) Add the default Slot.
  8. (Optional) Activate Generate Synonyms. Synonyms help virtual agent understand and recognize different variations of the same concept. Up to five synonyms will be generated for each keyphrase.
  9. Click Create.

When Lexicon Editor with new keyphrases is opened, you can edit, delete, or add new ones manually.

Generate Flows

Note that the generation of Flows for primary NLU languages besides German and English is not fully supported.

To use Generative AI technology for creating a new Flow with pre-configured Nodes based on your scenario, do the following:

  1. In the left-side menu of the Cognigy.AI interface, click Build > Flows.
  2. Click + New Flow.
  3. In the New Flow window, go to the Flow Generation section and select one of the options:
    • None — the Generative AI will not be applied to this Flow. This setting is activated by default.
    • Name and Description — the Generative AI will use the Name and Description fields for generating Flow.
    • Name and Transcript — the Generative AI will use the Name and Transcript fields for generating Flow. For this setting, you need to create a scenario and put it in the Transcript field. Use the Transcript field template as an example for your scenario.
  4. Generate the Flow by clicking Create.

In the existing Flow, you can edit Nodes created based on your scenario. Generate new Intent sentences or responses for a chatbot.

Generate Intent sentences

Note that the generation of Intent sentences for primary NLU languages besides German and English is not fully supported.

To use Generative AI technology for creating Intent example sentences, do the following:

  1. Open the existing Flow.
  2. In the upper-right corner of the Flow Editor page, select NLU.
  3. On the Intent tab, click Create Intent.
  4. Specify a unique name for the Intent and add a relevant description. It helps generate a more accurate result. To ensure that the generated content meets the desired expectations, fill in both fields. Relying solely on the title without using the description field will not produce the intended results.
  5. Activate the Generate Example Sentences setting.
  6. Set the number of generative sentences.
  7. Generate new sentences by clicking Create.
  8. Click Build Model, to learn the existing sentence.

If you want to add more examples automatically, use the Generate Sentences button. New sentences will be marked in light blue. The system generates specific numbers of sentences. Save changes and build your model again.

You can also use Generative AI in the Node configuration.

Rephrase bot outputs

Generative AI is supported by the Say, Question, and Optional Question Nodes.

To use AI-enhanced bot output rephrasing, do the following:

  1. Open the existing Flow.
  2. Add one of the Nodes: Say, Question, or Optional Question.
  3. Go to the AI-enhanced output section.
  4. In the Rephrase Output setting, select one of the options:
    • None — the Generative AI will not be applied to this Node. This setting is activated by default.
    • Based on Custom Input — specify custom values for the Input. Use the Custom Inputs field that allows the bot developer to input information for contextualizing and rephrasing the output.
    • Based on previous user inputs — set the last x user Inputs considered.
  5. Set the score in the Temperature setting. The temperature range determines the extent of variation in Generative AI's response.
  6. Click Save Node.

Check in the interactive panel if your Flow works as expected.

Complete texts

You can use the following Nodes for completing tasks.

These Nodes support only text output in the AI channel.

LLM Prompt

The LLM Prompt Node feature enables the creation of relevant content using Generative AI. To use this feature, simply provide a text prompt that guides the AI in continuing the generated text.

GPT Conversation

Warning

This Node is part of Cognigy's large-language-model research efforts and is intended solely as a preview feature. The GPT Conversation Node is not intended for production use.

The GPT Conversation Node feature enables the creation of relevant content using Generative AI based on your scenario. By default, this node has already pre-filled fields with a scenario.

FAQ

Q1: Can I use my OpenAI free account for the Generative AI feature in Cognigy.AI?

A1: A paid account is required to get an API Key, which is necessary for using Generative AI. A free account does not provide this key.

Q2: Why doesn't Generative AI work with AudioCodes Nodes?

A2: Generative AI output supports only text messages in the AI channel.

More information