OpenAI: GPT-3, ChatGPT and GPT-4
OpenAI offers GPT-3, ChatGPT and GPT-4. The GPT-series uses state-of-the-art NLP technology to generate responses in your chatbot, by providing answers that fit the context of the conversation.
The GPT-3 integration is deprecated in favour of this new OpenAI integration which contains GPT-3, ChatGPT and GPT-4, and potential future APIs offered by OpenAI.
This documentation page covers:
What is GPT
GPT is a series of advanced Natural Language Processing systems developed by OpenAI that allow you to execute several text-based tasks.
The OpenAI integration allows you to generate responses in your chatbot. As a bot builder or conversation designer, all you need to do is select the GPT-3, ChatGPT or GPT-4 model and tell it the right query that defines the kind of answer that you would like, and it will make it up for you!
To be able to use GPT models on Chatlayer, you will need to set up the OpenAI integration, then use this integration inside blocks.
Using the OpenAI integration means that your data is sent to OpenAI services which are based in the United States. Make sure you understand the OpenAI terms of service and implications. Use OpenAI in production bots with caution, Chatlayer is not held responsible for generated content.
[Video] GPT in customer-facing conversations
Here is a video we made about how and why you could bring value to your bot if you use GPT.
How to set up your OpenAI integration
Before being able to use GPT inside blocks, you need to connect an OpenAI account to the OpenAI integration on Chatlayer. For this, you might require an OpenAI API key.
Chatlayer provides customers with its own OpenAI API key to use GPT with a limit of 100 messages per bot. This means that from the 101st message, GPT will stop generating and send errors. If you wish to be able to use an unlimited amount of GPT-generated messages, you will need to create your own API key on the OpenAI's website.
To connect your chatbot with GPT:
On your Chatlayer home page, go to
Integrations
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252F4fyjQIFU7hjHQl83Qadu%252FScreenshot%25202023-02-08%2520at%252016.51.22.png%3Falt%3Dmedia%26token%3Dc4621aca-d93f-43a1-b4a5-abe81121b227&width=768&dpr=4&quality=100&sign=5f10d3ba&sv=1)
Search for "OpenAI" in the search bar
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FnP4WnbfZZ5GCkCQ3kZ7b%252FScreenshot%25202023-05-26%2520at%252013.30.11.png%3Falt%3Dmedia%26token%3Dfcb7a22c-78bc-49f7-ba79-78abe7fefb89&width=768&dpr=4&quality=100&sign=feb65bfe&sv=1)
Click on the integration to open it
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FrElCd4cq8wugAoRbZdo1%252FScreenshot%25202023-05-26%2520at%252013.32.36.png%3Falt%3Dmedia%26token%3D48383c55-5fd4-4837-b029-dd99a95a45b0&width=768&dpr=4&quality=100&sign=2ea0f6c3&sv=1)
Click on
+ Add Account
to start connecting your OpenAI account with the OpenAI integrationThis will open a pop-up in which you will need to enter a Chatlayer Access token:
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FX5g65BQ6JYys2Tjsmlp6%252FScreenshot%25202023-05-26%2520at%252013.33.29.png%3Falt%3Dmedia%26token%3Db8ee9c44-2b29-4574-a4af-cfa1d63ae52c&width=768&dpr=4&quality=100&sign=9cf734c5&sv=1)
Paste your access token in the
Access token
field
If you do not have a Chatlayer access token, you can generate one here.
Under
Display name
, write an identifier that can be later used to select this specific access token when using the OpenAI integration inside a bot. In this example, we have used the identifier Chatlayer Token OpenAI Example.Optionally, you can provide an
OpenAI API key
.
To try the OpenAI integration, Chatlayer offers 100 messages per bot. If this suits you, you can leave the OpenAI key field empty. Yet if you would like to go unlimited in the your number of GPT-generated messages, you will need to get your own API key on the OpenAI's website.
Click on
Submit
when you're doneThe OpenAI account should now be visible under the
Connected Accounts
tab. Note that the word "Auth" was automatically added in front of the "Display Name".
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FSJ2LDhfCOgTiC0118RoD%252FScreenshot%25202023-05-26%2520at%252013.44.10.png%3Falt%3Dmedia%26token%3Dc9025c4b-e02b-4d6d-9d1e-c370ec89f3c5&width=768&dpr=4&quality=100&sign=2ee1710b&sv=1)
You've set up your GPT account and would like to jump straight to bot building? We've got you covered with our GPT-3 template bot. Give it a go!
Your OpenAI integration is set up! Now it's time to use it inside the conversation.
How to use OpenAI GPT models inside a bot
You will need to do two things so that your customers can interact with GPT-3, ChatGPT or GPT-4:
Generate a GPT response through an Action block
Display a GPT response within another block
Generate a GPT response
To generate a GPT-3, ChatGPT or GPT-4 response:
Create an Action block and open it
Search for the OpenAI integration in the search bar and select it
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FYRqngDLjobhSm7LRuemz%252FScreenshot%25202023-05-26%2520at%252013.57.39.png%3Falt%3Dmedia%26token%3D5831400f-8d64-47b7-a926-3f0d61c91e79&width=768&dpr=4&quality=100&sign=5d37c67b&sv=1)
Under
OpenAI account
, select your OpenAI account that you connected to Chatlayer earlier. In our case, it is called "Auth Chatlayer Token OpenAI Example".
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FrLO8oICZXyp7sDytNjFJ%252FScreenshot%25202023-05-26%2520at%252013.57.59.png%3Falt%3Dmedia%26token%3D3a41bc74-a503-4cde-aabb-f5653d021b34&width=768&dpr=4&quality=100&sign=5b304ea7&sv=1)
Select the action to execute, called "GPT response". This means the action will send the conversation to OpenAI and retrieve a response.
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252F0cSBVIwZCTCWuNVqwWhy%252FScreenshot%25202023-05-26%2520at%252013.58.42.png%3Falt%3Dmedia%26token%3D1b1551f2-21e5-4e8e-971e-928e56650971&width=768&dpr=4&quality=100&sign=ab69b1cc&sv=1)
Now, give to OpenAI the required information to be able to generate an answer. These are called the
Action fields
:Fill the
Bot description
, which is a small depiction of what your bot is about. For instance, a restaurant bot.Fill the
Bot prompt
, which is a description of the response that you would like GPT to generate. Example: generate a personalized message to apologize for an inconvenience.Select the Model Type, which is either GPT-3, ChatGPT or GPT-4. Note that GPT-4 is only available in Chatlayer US due to European GDPR regulations.
Be mindful: the longer you make your bot description or bot prompt, the longer it will take to get a response from OpenAI.
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FNwJbQvGIqpvsytzaojuY%252FScreenshot%25202023-05-26%2520at%252013.59.05.png%3Falt%3Dmedia%26token%3Dc6a60131-fb94-4b2e-b5a5-7c44f3a6f392&width=768&dpr=4&quality=100&sign=af40a466&sv=1)
Click on
Create
to save your GPT integrated Action block
You have made an Action block that uses GPT to generate a response based on your chatbot description! Now, let's see how we can display that generated response within the conversation.
Display a GPT response
The generated answer from GPT is available on the session data after executing the above Action block. This response is saved under the {apps.openai.gpt.text}
variable.
To display the GPT response in the conversation:
Create a Bot message block
Add a text field and fill it with the
{apps.openai.gpt.text}
variable
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FfyFpsg72yaerR9rCVIK9%252FScreenshot%25202023-05-26%2520at%252014.11.14.png%3Falt%3Dmedia%26token%3D409d728c-df70-4f2b-93b9-4b9c81d21532&width=768&dpr=4&quality=100&sign=682eb73d&sv=1)
You know now how to set up an Action blocks that generates a GPT response, and how to display this response within a block.
In the next sections, we will take a use-case to exemplify how you can use GPT for your bot.
[Use-case] GPT for fallback messages
One way to use the OpenAI integration is as a fallback message for when your bot didn't understand the user question.
If you do not have a bot yet, you can use one of our pre-built template bots.
Once you've created a bot, go into your General
flow, and open the Not Understood
block. From there, we will modify the Not Understood
block so that it uses the OpenAI integration:
Delete the text message inside the
Not Understood
block by clicking on the bin iconIn the
Go To
field, create a new Action block that you will call "Generate GPT response", then save your changesOpen the
Generate GPT response
block that you have just created and configure this Action block so that it integrates GPTIn the Go To field, create a Bot message block and call it "Display GPT response" , then save your changes
Open the
Display GPT response
block and add the{apps.openai.gpt.text}
variable inside the text field
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FxyWMOgG4Wxl1Nc6kdqJz%252FScreenshot%25202023-05-26%2520at%252014.16.00.png%3Falt%3Dmedia%26token%3De9196fa5-194b-4661-b805-0e842366d383&width=768&dpr=4&quality=100&sign=54a45583&sv=1)
If you talk to your bot now and ask something the bot doesn't know, the "Not Understood" block state should be triggered. Next, OpenAI will be called and the response will be displayed to you.
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FWcWNBAlaBwe7U45qwLlV%252FScreenshot%25202023-02-15%2520at%252012.43.51.png%3Falt%3Dmedia%26token%3D9d4c37c4-eb69-46b7-ac21-585ac372f918&width=768&dpr=4&quality=100&sign=deb4d15c&sv=1)
[Use-case] GPT for contextualized responses
GPT is able to read the whole conversation between your customer and the bot, which means that it can generate text based on the context of the conversation.
As for an example of contextualized GPT responses:
Create an intent that will trigger a GPT response. In this example, we created an
intent_not_delivered
intent.Create an Action block that generates a GPT answer and connect it to a block that displays it, as explained in the tutorial above. In our example, we have queried the following text to GPT-3:
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FSmgKCLLZhEELC4ZIMLby%252FScreenshot%25202023-02-16%2520at%252015.32.33.png%3Falt%3Dmedia%26token%3Dfb6df175-63e7-4856-8584-bc961b1d1b2a&width=768&dpr=4&quality=100&sign=b08b7ebc&sv=1)
Do the same for any other block that you would like to have personalized. In our example, we have created a chitchat.tell_a_joke intent that triggers a GPT-generated response of a joke that takes into account the context above:
Example of action fields for a personalized joke made by GPT-3 and based on the context of the conversation Your can now have more contextualized interactions with your customers!
![](https://docs.chatlayer.ai/~gitbook/image?url=https%3A%2F%2F2786867680-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F-LLTwFwbOqJj4dDhg8Ju%252Fuploads%252FIOCUtj3t5grfMlssYYtq%252FScreenshot%25202023-02-16%2520at%252015.45.07.png%3Falt%3Dmedia%26token%3Dfb58d12e-fa79-4c70-bf22-1194a501f5ef&width=768&dpr=4&quality=100&sign=ce616867&sv=1)
Limitations of GPT models
GPT-3, ChatGPT and GPT-4 are generative AI models built by OpenAI, which is located in the US. Because it is generative, we do not control what GPT creates. Depending on the input it receives, the answer can either be very good, contain wrong info or even be offensive. Therefore, we do not recommend GPT be used in production (i.e. a customer facing bot) without thorough testing and understanding the risks.
We do not recommend the OpenAI integration to be used in production (i.e. a customer facing bot). Still, if you want to use it in production anyway you should use your own OpenAI API key. Please also check the OpenAI terms of service to understand the implications of using OpenAI services.
Feedback?
We are eager to receive your feedback if you found a valuable and safe production use case. Please contact us here. 🙏
Last updated