ChatGPT as a gamechanger for the Azure chatbot

It is clear, that ChatGPT has  become a game-changer for over 92% of Fortune 500 companies, helping with everything from coding to creative writing. It's not just a productivity tool; it's a full-blown phenomenon with over 100 million weekly users!

Recently, OpenAI made headlines with the launch of GPT-4 Turbo, a beefed-up version of its language model, and a multimodal API. There's even a GPT store where you can create and sell your custom GPT versions. 

CCW is a multicloud IT consulting company. We will in this blog discuss Azure Bot Service and how to make it a gamechanging chatbot leveraging ChatGPT.

Microsoft Azure Bot is offering very sophisticated AI driven Bot service , also so called Azure Bot Framework service. It is a complete bot ecosystem with development visual tool called Bot Framework composer, testin tool Bot Framework Emulator and full stack including webchat component, monitoring, Bot service. The AI engine is Azure Cognitive Language Understanding (CLU) from Language service.

Using AI Language  Cognitive Language Understanding  (CLU) we identitfy user input into intent which can come from webchat, email facebook messenger, whatsapp of from voicebot. Each user input comming to Azure Bot is analyzed and result is sent to Bot with probability for each trained intent.

For input „I want to buy a new phone“ we get result :

 "recognizerResult": {
        "text": "Chcem nový telefón",
        "alteredText": "Chcem nový telefón",
        "intents": {
          "Phone": {
            "score": 0.99976474
          },
          "Pausal": {
            "score": 0.000080695034
          },
          "Podpora": {
            "score": 0.00006895622
          },
          "None": {
            "score": 0.000056440345
          },
          "Help": {
            "score": 0.000015013351
          },
          "Cancel": {
            "score": 0.000014187361
          }
        },
        "entities": {}
      }, 

Sometimes we get unknown intent, it means user gives input for which we do not have trained our AI model. In this case the gamechanger is ChatGPT which can be trained upon company documents and data and help customers solve their problems, answer questions etc.

For unknow intent or for problems of the customer we can use ChatGPT to give him sophisticated support, answers. Let us demonstrate how can we integrate ChatGPT into unknown dialog withing Azure Bot Framework composer.

In the Azure there is avalaible OpenAI service. From the Overview page we need to copy the Endpoint and API Key 1 or Key 2.

Let us know enrich in the Azure Bot Composer the Unknown dialog , when none of the trained intent is identified. We want to give customer support with ChatGPT.

The ChatGPT is integrated in the flow with HTTP request. The solution consist of sendint POST HTTP REST request with json body 

{  "prompt": "${user.openaiquery}",   "max_tokens": 50 } 

 The response is parsed

${turn.results.content.choices[0].text} 

and shown to the user. 

The OpenAI allows integrate company data and train deployment with specific scope.

So trained model can give us very sophisticated intelligent answers.

We can conclude this blog that change your game, start taking advantage of AI, ChatGPT and cloud with strong partner as CCW is !