Including voice command related tests to your automation Suite of Selenium/Appium test

schedule Jun 29th 03:00 PM - 03:45 PM place Lalit 1 people 106 Interested

Almost every app (Web/Mobile/Desktop) is now being powered with voice search, voice typing or any other voice related action. Some great example are Alexa, Google Voice search. We also often have some voice related feature in our web/mobile app. But we usually manually test these scenario.

Now its time when we start adding these test as our automation sprint Definition of Done. During this talk, I will be going through some sample codes and frameworks and would be demonstrating how you can integrate these tests along with your existing Selenium/Appium test scripts.

I would also be discussing way forward to integrate Artificial Intelligence to your automation frameworks.

 
9 favorite thumb_down thumb_up 13 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/Structure of the Talk

1. Introduction to Text to speech conversion concept

2. Sample code example which generate voice commands

3. Integration of voice command library with Selenium and Appium

4. How to forward voice commands to connected devices

5. Localization testing across different languages

6. Demo

7. Pros and Cons

Learning Outcome

1. Will be able to include voice automation in his/her test suite

2. Best practices around voice automation

Target Audience

Automation enthusiast, Mobile / Web automation engineer, Developers, QA Managers

Prerequisite

A little knowledge about automation methodology

schedule Submitted 11 months ago

Public Feedback

comment Suggest improvements to the Speaker
  • By  ~  1 month ago
    reply Reply

    Hi Gaurav. Thanks for sharing the details. Can you please share the video with detail steps for automating any web application using Voice Command. It will be really useful.  Thanks in advance.

    • Gaurav Tiwari
      By Gaurav Tiwari  ~  1 month ago
      reply Reply

      Hey , 

      Unfortunately I don't have a video, but I have a git repo which has a working code for same. https://github.com/g-tiwari/GoogleVoiceTest

      You can clone this repo, It is a sample code for automated Google voice search. I hope this is useful.

      • By  ~  1 month ago
        reply Reply

        Hi Gaurav,

        Yes, i have taken the the code but not able to run it successfully. I am using Eclipse Neon, JDK 1.8 and Maven 3.5

         

        • Gaurav Tiwari
          By Gaurav Tiwari  ~  1 month ago
          reply Reply

          Hey,

          Please post your queries, bug or any other issue on the shared git repo itself along with logs. 

          I track issues in git repo itself.

          -Gaurav

          • By  ~  1 month ago
            reply Reply

            sure

  • Vidya Sagar Pogiri
    By Vidya Sagar Pogiri  ~  6 months ago
    reply Reply

    the tech talk was really nice and very impressive. Thank you for bringing to the table. I've cloned your repo and tried to do some stuff but I'm blocked in accessing VoiceAutomationClient:jar , please help me.

  • ManojKumar
    By ManojKumar  ~  11 months ago
    reply Reply

    Hi Gaurav,

    Will you be showing demo? Are you going to share the code, open-source it? 
    The tools that you use are open-source to adopt it?

    • Gaurav Tiwari
      By Gaurav Tiwari  ~  11 months ago
      reply Reply

      Hey Manoj,

      Yes ! I would be showing demo. and Yes I am using open-source tools and this would be open source

      • Pooja Gautam
        By Pooja Gautam  ~  7 months ago
        reply Reply

        Hi Gaurav,

        Do you have recording of this talk with you?

        Thank you so much for sharing this with us. I'm new to voice automation testing. My current project includes testing voice commands through alexa and google home. Our aim is to automate this testing.

        I was unable to find any pointers anywhere on web. Your github link for sample project gave me some hope.

        Can you please throw some light on the com.se2automate.voice dependency that you have used. Have you designed it? or is it available on web?

        It would be a great help if you could share these details.

        Thanks!

        • Gaurav Tiwari
          By Gaurav Tiwari  ~  7 months ago
          reply Reply

          Hey Pooja,

          Video would be available on YouTube very soon. Yes! I have created this library.

          I am currently working on documentation for this library.

          Please connect on LinkedIn

          I would be happy to help!

          Thanks

          Gaurav Tiwari

  • Abhinav
    By Abhinav  ~  11 months ago
    reply Reply

    Nice!! Looking forward for proposal doc. 

  • Anand Bagmar
    By Anand Bagmar  ~  11 months ago
    reply Reply

    Hi Gaurav,

    Good proposal. Looking forward to knowing more about it.

    Have you done this talk before? Do you have any sample slides / a video snippet of doing a talk before? Can you share that with the program team?

    • Varun Bhatia
      By Varun Bhatia  ~  11 months ago
      reply Reply

      Redefining automation as AI. Seems interesting!! Looking forward to it.


    • Liked Anton Angelov
      keyboard_arrow_down

      Anton Angelov - Infinite Improbability Testing- Execute All Tests in Parallel

      Anton Angelov
      Anton Angelov
      CTO
      Automate The Planet
      schedule 1 year ago
      Sold Out!
      45 Mins
      Talk
      Intermediate

      100000 tests executed under half an hour - sounds like a myth? Well, we made it, and I'm going to tell you a story how we got there. Through surveys, we discovered that many companies desire to utilize the benefits from parallel tests execution to optimize their software development process. However, they struggle with the process. Lack of available tooling, documentation, tests data arrangement/deletion, handling E2E tests specifics like browsers, emulators, etc. We were one of this companies. Because of that, we created an open-source tool for the job. Throughout the presentation, you will find statistics where, depending on the type of the tests, the tests execution can speed up from 4- 40 times which makes the run of the 100000 tests possible for 27 minutes.

      It will be shown how to utilize the tool, its various features and where/when it is appropriate to use it. Also, you will find example solutions to most of the common challenges in executing tests in parallel. We believe that in the near future the parallel tests execution will be a necessity, much like unit tests or continuous integration now. This will be one of the pillars for the companies to improve their competitiveness and effectiveness.

    • Liked NaliniKanth M
      keyboard_arrow_down

      NaliniKanth M / Srinivasan Sekar - New hope in Selenium Docker

      45 Mins
      Demonstration
      Advanced

      Idea behind this talk is to describe how to create a short lived containers for each test and scale to large Selenium Cluster using Selenoid. What is standard Selenium architecture and why it is not suitable for big clusters, Also states issues in maintaining a large Docker Selenium Grid / Selenium Clusters. In this session we will also be talking about the challenges we faced in using official selenium docker images and how we scaled up regression execution time from 3:3 (3 hours to 3 mins). Followed by a demo of how Selenoid server solves the problem with docker. How it works, how to use inside big Selenium cluster, where else it could be used.

    • Liked Raj Thapa
      keyboard_arrow_down

      Raj Thapa - 100% automated, customized and continuously integrated performance test with result analysis and reporting

      Raj Thapa
      Raj Thapa
      Software Engineer
      Verscend Technologies
      schedule 11 months ago
      Sold Out!
      45 Mins
      Talk
      Intermediate

      While performance tests are common among web applications to test their speed, scalability and reliability, a systematic approach to conduct dynamic, automated and customizable automated tests along with fully automated results reporting and display can be regarded as a major challenge.

      In this session, discussions on an approach to conduct about the aforementioned with zero manual intervention will be carried out. The result being a fully automated test strategy that can easily be outlined to Product owners and higher-level management.

      The discussion will be focused on the overall process that initiates with the execution of performance tests using Continuous Integration Server whose results are extracted, logged and used for performance analysis, monitoring and baselining.

      The results are reported in a custom dashboard comprising of features that compare every build with historical data, compare deviations and provide a concrete idea of standard performances regarding the response time of the server over a period. A separate aggregated high-level report is also sent automatically as an email to respective stakeholders.

    • Liked NaliniKanth M
      keyboard_arrow_down

      NaliniKanth M / Prasad Mudedla - Continuous Security with Selenium tests

      45 Mins
      Demonstration
      Intermediate

      We have come to a place where we run our selenium tests on pipelines every day.
      Now are these tests confined to test only the functionality of the application?
      No, we can use this tests to do much more. Let's test security with those same tests.

      Turn your selenium tests in to Security tests, get security testing in to your CI pipelines just by tweaking a bit of the selenium integration suite. Find and report security issues that exists which can be caught way before paying off for it.
      In this Demo we will introduce a framework that will help your selenium tests turn into security tests and run on pipelines.
      With ZAP API + selenium and CI pipelines, find security issues on the application see a red or green security pipeline. Not just that fetch the reports and take necessary actions on every build.
      The talk covers different ways that ZAP tests the web application for security(automated with selenium tests). We will see what all of them can be integrated with selenium and can make most out the suite.
      As an add we will see how your API can be tested for security using ZAP API :)

      Tools used:
      1. Selenium Web driver framework.
      2. ZAP framework integrated with selenium framework.
      3. GO (for CI/CD)
      4. Maven for building and fetching reports.

    • Liked Shashank Chaturvedi
      keyboard_arrow_down

      Shashank Chaturvedi - Data Analytics in QA using PowerBI

      45 Mins
      Demonstration
      Intermediate

      In CI/CD world, we execute thousands of test cases, multiple times in a day. These tests generate tons of data, which can be extremely useful to generate insight on identifying recurring patterns of failures, hotspots, infra issues etc.

      In this talk, I'll share how we can reduce the results analyzing time, but also how we can extract meaningful information from all the historic test runs and provide in-depth insights using PowerBI Visualization and Analytics.

      Few Examples Below:

      Delta Analysis

      Error Analysis

    • Liked Dharmender Kumar
      keyboard_arrow_down

      Dharmender Kumar - Develop Securely with Zaplenium

      Dharmender Kumar
      Dharmender Kumar
      Architect
      JDA
      schedule 11 months ago
      Sold Out!
      45 Mins
      Talk
      Intermediate

      Zaplenium simply means ZAP + Selenium and named after the integration of both to ensure application security while it's being developed. ZAP provide client API's that help to capture URL's by spidering and scanning over the pages those are interacted in user flows. With ZAPlenium the tests can be targeted to certain areas of application where selenium helps in navigating to those areas and target ZAP to spider over those and scan them. Also, Zaplenium will help defining the assertions those can come handy while we integrate this in CI/CD pipelines.

      Participants will be able to define security sanity suite to their build pipelines. With code change the security can be tapped for any High, Medium and Low risks. Session will make use of open source technologies i.e. OWASP ZAP and Selenium to define tests with assertion.

      Security Tool: OWASP ZAP

      Functional Tool: Selenium Web driver

    • Liked Manjyot Singh
      keyboard_arrow_down

      Manjyot Singh - QAOPS - QA Testing in a DevOps World

      Manjyot Singh
      Manjyot Singh
      Lead QA Consultant
      Thought works
      schedule 11 months ago
      Sold Out!
      45 Mins
      Demonstration
      Intermediate

      QAOps is Continuous Testing Strategies when
      frequent software delivery matters.

      It is no surprise that automation and orchestration
      make life very easy, be it a small organization or
      a large-scale industry that houses hundreds of
      servers. IT automation is essentially the ability to
      orchestrate and integrate tools,
      people, and processes through a certain workflow. I will be using Ansible and Docker to showcase the same and writing ansible tests on top of that.

      Ansible - Ansible is an IT automation tool which can configure systems, deploy software, and orchestrate more advanced IT tasks such as continuous deployments. Ansible is actually designed to be a “fail-fast” and ordered system, therefore it makes it easy to embed testing directly in Ansible playbooks.

      Docker - A docker container is a lightweight, stand-alone, executable package of a piece of software that includes everything needed to run it: code, runtime, system tools, system libraries, settings. Containers isolate software from its surroundings, for example differences between development and staging environments and help reduce conflicts between teams running different software on the same infrastructure.