Chatbots are one of the most widely adopted AI/ML implementations in the business sector. A chatbot is an intelligent machine used to imitate human conversation through text and voice commands. Today bots are widely used as a personal assistant, customer service, HR, sales and marketing to name a few. In short, bots are everywhere and we rely on them to a certain extent, this makes it extremely important to assure the quality of the chatbots and test them thoroughly. They are built using NLU/NLP-Services (Natural language understanding and processing) and are subjected to constant training and improvement which has direct impact on tests. Voice based bots like Siri and Alexa depend on speech recognition technologies. As the chatbots user do not have any barriers and due to the unpredictable user’s behavior it becomes utmost difficult to verify the correctness on the output. In this talk, we will discuss how the chatbots are different as compared to the other applications and the challenges they bring onto the table while verifying their behavior, and focus on the testing strategies and automation testing of the bots.

 
1 favorite thumb_down thumb_up 7 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  • How ChatBots are different from the other Application?
  • What are the challenges in testing the ChatBots?
  • How do you test the ChatBots?
  • Testing Strategies for ChatBots
  • Tools for ChatBot Testing

Learning Outcome

  • Understand the technologies used to build Chatbots and how they make it different than other application for testing
  • Begin with ChatBot testing
  • Test Strategy for chatbots
  • Tools for testing Chatbots

Target Audience

QA, Dev, QA Managers, Product Managers/Owner

schedule Submitted 2 weeks ago

Comments Subscribe to Comments

comment Comment on this Submission
  • Wim Selles
    By Wim Selles  ~  2 weeks ago
    reply Reply

    Hi Shama,

    While your proposal is intriguing, I am wondering what the link with Appium will be. Can you please elaborate on this?

    • Shama Ugale
      By Shama Ugale  ~  1 week ago
      reply Reply

      As you pointed out it doesn’t directly relate to appium but it talks about testing strategy for chatbots and conversational UI’s. I also see Appium started supporting conversations with siri in iOS already. I will also be covering test strategy and tools for testing apps that includes voice based interactions like Siri and Alexa.

      • Wim Selles
        By Wim Selles  ~  1 week ago
        reply Reply

        Hi Shama,

        Thanks for your reply, can you also share some slides / video's about the subject?

        Thanks

        Wim

        • Shama Ugale
          By Shama Ugale  ~  1 week ago
          reply Reply

          Its work in progress. Will share the initial draft by Monday EOD.

           

          Thanks,

          Shama Ugale

          • Wim Selles
            By Wim Selles  ~  1 week ago
            reply Reply

            Hi Shama,

            Do you already have a draft?

            • Shama Ugale
              By Shama Ugale  ~  3 days ago
              reply Reply

              Hi Wim,

               

              I have updated the draft version under the slides section.

               

              Thanks,

              Shama Ugale

              • Wim Selles
                By Wim Selles  ~  2 days ago
                reply Reply

                Thank you very much.