Shama will be presenting the following session
filter_list help_outline
  • Shama Ugale
    keyboard_arrow_down

    Shama Ugale - Testing Conversational AI

    Shama Ugale
    Shama Ugale
    Sr. QA Consultant
    ThoughtWorks
    schedule 2 years ago
    Sold Out!
    45 Mins
    Talk
    Beginner

    Chatbots are one of the most widely adopted AI/ML implementations in the business sector. A chatbot is an intelligent machine used to imitate human conversation through text and voice commands. Today bots are widely used as a personal assistant, customer service, HR, sales and marketing to name a few. In short, bots are everywhere and we rely on them to a certain extent, this makes it extremely important to assure the quality of the chatbots and test them thoroughly. They are built using NLU/NLP-Services (Natural language understanding and processing) and are subjected to constant training and improvement which has direct impact on tests. Voice based bots like Siri and Alexa depend on speech recognition technologies. As the chatbots user do not have any barriers and due to the unpredictable user’s behavior it becomes utmost difficult to verify the correctness on the output. In this talk, we will discuss how the chatbots are different as compared to the other applications and the challenges they bring onto the table while verifying their behavior, and focus on the testing strategies and automation testing of the bots.

1. What got you started/interested in Testing?

I started my career in 2009 where the recession had hit the industry and cost cutting was everywhere. I joined a 4 member company and started to work on multiple projects from gathering requirements to development, testing and release. Eventually I got into a testing project where i got to learn about the domain, business and also started for the very first time on automation with Selenium(writing code). I enjoyed the project and eventually realized i get to explore everything as a QA, right from business to technical to interacting with end users. I loved it and chose to continue as a QA.

2. What has been your best moment/highlight working with Appium?

As an consulting assignment I had a to build a solution to cater to both UI and Mobile apps from the same framework. Appium is what best suited while i had to just extend the selenium implementation to and add an abstract layer to be able to leverage the same code.

3. What do you think is the biggest challenge faced by Mobile Testers today?
  • Hardware simulations
  • Covering the various screen size and Device/OS combination
4. What is your advice to testers, who are new to automation?

Be curious about everything around you..!!

Never leave the Testing mindset

There is no single tool or solution to every problem. Explore and learn!!

5. Tell us about the session/s you will be presenting at the conference and why did you choose those topics?

I will be talking on "Testing the Conversational AI Systems". Wanted to share my experience of testing the Conversational AI and help the community to begin with this area which has been not considered to be tested for some reason

6. What are some of the key takeaways from your session/s?
  • Understand what how and why of Conversational AI
  • Test case design
  • Test Automation
  • Monitoring
7. Which are your favourite sessions at Appium Conf? (Sessions that you are looking forward to attend)

Angie Jones - Your Tests Lack Vision: Adding Eyes to Your Automation Framework
Sai Krishna / Srinivasan Sekar - Life Cycle of an Appium command
Sravan Kumar - Bootcamp to understand Appium android internals
Anand Bagmar - Testing & Release strategy for Native Android & iOS Apps
Daniel Graham - Unlocking New Testing Capabilities with Espresso Driver
Pradeep Soundararajan - Building Tools to Free up Exploratory Testers
Srinivasan Sekar / Sai Krishna - Native mobile commands in Appium
Jonah Stiennon - All Desired Capabilities

8. Any personal message/remarks you want to share with the Testing community in India?

Think beyond the requirement documents !!

help