Creating stable and parallelized Windows environment using Azure DevTest Labs

Previously, I created Selenium Grid on Kubernetes environment for web test automation.

Because Docker image is distributed(docker-selenium), it became easy to create/scale Chrome / Firefox test automation environment.

However, there are still users who use Microsoft Edge or Internet Explorer, and we need to let them use our service/website comfortably.

It is clear then that we have to either run manual tests automated tests on these browsers before the release.

However, creating Windows 10 / Microsoft Edge browser test automation environment is still difficult because of its license.

Therefore, we decided UI Testing strategy for multi-browser(prioritize the execution frequency and the number of test cases)

In addition, in order to realize faster and more stable QA feedback of Windows10 / Microsoft Edge, I created parallelized Windows 10 / Microsoft Edge test environment using Azure DevTest Labs.

In this talk, I will talk how to create this environment.

 
 

Outline/Structure of the Talk

  • ​​Our test automation for web application and problems(3min)
  • UI Testing strategy for multi-browser(2min)
  • ​​How to create Selenium environment for Microsoft Edge(3min)
  • Challenges in test environment for Microsoft Edge(2min)
  • What is Azure DevTest Labs, and basic usage(8min)
  • Advanced usages of Azure DevTest Labs(Custom image, shared IP address, Scheduled shutdown)(3min)
  • Advantages of using Azure DevTest Labs, and challenges・limitations.(2min)
  • Other solutions and comparison to them(such as Sauce Labs, AWS)(2min)
  • (Bonus) How to create Appium environment for Windows desktop applications(5min)
  • Demos(7min)
  • Q&A(5min)

Learning Outcome

For faster and more stable QA feedback, it is necessary to prioritize the execution frequency and the number of test cases to be executed by each browser.

Although it’s hard to create test automation environment compared to Chrome / Firefox, we could create stable and parallelized Windows 10 / Microsoft Edge test automation environment on cloud using Azure DevTest Labs.

Target Audience

QA Engineers / QA Automation engineers who need / interests test automation on Windows Platform(Edge/IE/WindowsApp)

Prerequisites for Attendees

Basic knowledge of Selenium and Multi-browser testing.

schedule Submitted 8 months ago

Public Feedback

comment Suggest improvements to the Speaker
  • Deepti Tomar
    By Deepti Tomar  ~  6 months ago
    reply Reply

    Thanks for your proposal!
    Could you please update the Outline/Structure section of your proposal with a time-wise breakup of how you plan to use 45 mins for the topics you've highlighted?

    And, to help the program committee understand your presentation style, can you provide a link to your past recording or record a small 1-2 mins trailer of your talk and share the link to the same? 

    Thanks!

    • Nemoto Tadashi
      By Nemoto Tadashi  ~  6 months ago
      reply Reply

      Thank you for comment and sorry for rate reply because of holiday.

      I updated Outline/Structure of my proposal with a time-wise breakup .

      I speaked last year at this event, but I cannot find my recording, so let me check if there is my recording.

      https://aadays.pl/

      https://speakerdeck.com/tadashi0713/creating-parallelized-android-uitest-appium-environment-using-azure-docker-and-android-emulator

      • Anand Bagmar
        By Anand Bagmar  ~  6 months ago
        reply Reply

        Hi Nemoto, If you are unable to find your past speaking video, no worries. Maybe you can record a small 1-2 min video of you summarizing this proposal and send to the program team?

        Regards,

        Anand

        • Nemoto Tadashi
          By Nemoto Tadashi  ~  6 months ago
          reply Reply

          Dear Anand Bagmar,

          Thank you for feedback, I've just uploaded my video!

      • Deepti Tomar
        By Deepti Tomar  ~  6 months ago
        reply Reply

        Hello Nemoto,

        Thanks for the update! We suggest you to consider time for Q&A as well along with the topics in the proposed outline/structure within 45 min.

        As suggested by Anand, we look forward to receiving the trailer video of 1-2 min from you in case if the past recordings are not available.

        Thanks!

        • Nemoto Tadashi
          By Nemoto Tadashi  ~  6 months ago
          reply Reply

          Dear Deepti Tomar,

          Thank you for feedback, I both updated outline including Q&A and uploaded video.

           

  • Robin Gupta
    By Robin Gupta  ~  6 months ago
    reply Reply

    Can we add the following components into the demonstration:
    1. Alternative solutions (Example : Amazon AWS etc..)
    2. Challenges and limitations of the platform

    • Nemoto Tadashi
      By Nemoto Tadashi  ~  6 months ago
      reply Reply

      Thank you for comment.

      About 1, I planned to compare with SaaS solution such as SauceLabs or BrowserStack, but I will investigate other solution that other IaaS services provides(because it's Windows platform, I'm not sure Amazon or Google provide such solution).

       

      About 2, sure I will add this.

      • Nemoto Tadashi
        By Nemoto Tadashi  ~  6 months ago
        reply Reply

        I updated the proposal

        • Robin Gupta
          By Robin Gupta  ~  6 months ago
          reply Reply

          Thanks a bunch.