Testing Conversational AI

schedule Jun 15th 11:00 - 11:45 AM place Jupiter people 34 Interested

Chatbots are one of the most widely adopted AI/ML implementations in the business sector. A chatbot is an intelligent machine used to imitate human conversation through text and voice commands. Today bots are widely used as a personal assistant, customer service, HR, sales and marketing to name a few. In short, bots are everywhere and we rely on them to a certain extent, this makes it extremely important to assure the quality of the chatbots and test them thoroughly. They are built using NLU/NLP-Services (Natural language understanding and processing) and are subjected to constant training and improvement which has direct impact on tests. Voice based bots like Siri and Alexa depend on speech recognition technologies. As the chatbots user do not have any barriers and due to the unpredictable user’s behavior it becomes utmost difficult to verify the correctness on the output. In this talk, we will discuss how the chatbots are different as compared to the other applications and the challenges they bring onto the table while verifying their behavior, and focus on the testing strategies and automation testing of the bots.

 
 

Outline/Structure of the Talk

  • How ChatBots are different from the other Application?
  • What are the challenges in testing the ChatBots?
  • How do you test the ChatBots?
  • Testing Strategies for ChatBots
  • Tools for ChatBot Testing

Learning Outcome

  • Understand the technologies used to build Chatbots and how they make it different than other application for testing
  • Begin with ChatBot testing
  • Test Strategy for chatbots
  • Tools for testing Chatbots

Target Audience

QA, Dev, QA Managers, Product Managers/Owner

schedule Submitted 1 year ago

Public Feedback

comment Suggest improvements to the Speaker
  • Wim Selles
    By Wim Selles  ~  1 year ago
    reply Reply

    Hi Shama,

    While your proposal is intriguing, I am wondering what the link with Appium will be. Can you please elaborate on this?

    • Shama Ugale
      By Shama Ugale  ~  1 year ago
      reply Reply

      As you pointed out it doesn’t directly relate to appium but it talks about testing strategy for chatbots and conversational UI’s. I also see Appium started supporting conversations with siri in iOS already. I will also be covering test strategy and tools for testing apps that includes voice based interactions like Siri and Alexa.

      • Wim Selles
        By Wim Selles  ~  1 year ago
        reply Reply

        Hi Shama,

        Thanks for your reply, can you also share some slides / video's about the subject?

        Thanks

        Wim

        • Shama Ugale
          By Shama Ugale  ~  1 year ago
          reply Reply

          Its work in progress. Will share the initial draft by Monday EOD.

           

          Thanks,

          Shama Ugale

          • Wim Selles
            By Wim Selles  ~  1 year ago
            reply Reply

            Hi Shama,

            Do you already have a draft?

            • Shama Ugale
              By Shama Ugale  ~  11 months ago
              reply Reply

              Hi Wim,

               

              I have updated the draft version under the slides section.

               

              Thanks,

              Shama Ugale

              • Wim Selles
                By Wim Selles  ~  11 months ago
                reply Reply

                Thank you very much.