Mobile Web Test Automation: to the Desktop!

How does it usually look when people do Mobile Web Test Automation? They write a couple of tests, run them on some desktop browser and only after that try to run on emulators/simulators and the final step is adapting and fixing the tests for browsers on real devices.

By happy chance we developed our tests for Mobile Web on real devices. But some time ago we decided to run on Desktop as well.

Why? What benefits did we get? How do we have both Appium and Selenium tests in one repository? And what challenges did we face? About this and many other things I will tell in my talk.

 
30 favorite thumb_down thumb_up 2 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  • Short overview of our test automation framework and infrastructure
    • What we had (CI, agents, tools)
    • What we lacked (speed, reliability)
  •  How we run Appium tests on Desktop Chrome with Ruby bindings
    • Patches which we made for Appium and Selenium that made it possible,
    • Changes and workaround in our framework that made it possible,
    • Javascript hacks
  • Tips & tricks (Caveats and bugs)
  • New tool we created for running cucumber tests in parallel
  • Future plans

Learning Outcome

Sharing experiences/approaches/tools and ideas which anyone with similar problems can use

Target Audience

Software engineers who have experience with Selenium and/or Appium

schedule Submitted 1 year ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • ManojKumar
    By ManojKumar  ~  1 year ago
    reply Reply

    Any links to the slides or repo showcasing your contributions ?
    I beleive its this ? https://github.com/bayandin/parallel_cucumber

    • Alexander Bayandin
      By Alexander Bayandin  ~  1 year ago
      reply Reply

      Hello Manoj,

      I'm still working on the presentation and wouldn't want to share a half finished version right now, hope you understand it.

      Yes, you found the right repo for "New tool we created for running cucumber tests in parallel" from the outline :) Actually, for my proposed talk there is no extra repos are required, mostly I'm going to show which challenges did we get and how we have solved them. Appium and Selenium libraries (for Ruby) for now is ready to be used at the same time.

      If you want me to describe any particular part just leave a comment.

      Thanks!

       


  • Liked Bret Pettichord
    keyboard_arrow_down

    Bret Pettichord - Checking as a Service

    Bret Pettichord
    Bret Pettichord
    Software Architect
    HomeAway
    schedule 1 year ago
    Sold Out!
    45 mins
    Keynote
    Beginner

    This talk suggests a reframe in how we understand the business value of automated testing. One shift is to see automation as "checking" rather than "testing". Another is the shift from software delivery to service delivery, including fully embracing DevOps. The resulting approach could be called Checking as a Service or CheckOps, and forces us to rethink traditional automation priorities. In this talk, Bret will explain how change in approach has affected teams he's worked with and how you can use it to improve your ability to deliver valued services.

  • Liked Simon Stewart
    keyboard_arrow_down

    Simon Stewart - Fix a Bug, Become a Committer

    Simon Stewart
    Simon Stewart
    WebDriver Creator
    Facebook
    schedule 1 year ago
    Sold Out!
    480 mins
    Workshop
    Beginner

    Have you ever wondered how Selenium works under the covers? Do you get frustrated with locators not locating, pages not loading, or browsers behaving inconsistently from one run to the next? Selenium is an attempt to unify thousands of disparate elements across a wide spectrum of challenges into a single, common interface that works seamlessly with all the major browsers - and yet only a handful of volunteers work to maintain this gigantic effort. If you would like to enhance your own Selenium experience while contributing back to the software that has defined so many of our careers, come to this workshop. In it we'll dissect the different elements of Selenium, dive into its internals, learn how it was built and how to make changes to it, and even write a unit test you can contribute on the same day!

  • Liked Irfan Ahmad
    keyboard_arrow_down

    Irfan Ahmad - Testing as a Container : Using Docker with selenium and friends to ship fast

    Irfan Ahmad
    Irfan Ahmad
    QA Engineering Lead
    Upgrad
    schedule 1 year ago
    Sold Out!
    45 mins
    Demonstration
    Intermediate

    We see two upcoming trends in the world of software delivery.

    1.Docker is becoming a standard for managing infrastructure using containers.

    2.Testing code and its infrastructure starts to grow at scale with more complexity, dependencies and technology diversity.

    A container is an entire portable runtime environment: an application, plus all its dependencies, libraries and other binaries, and configuration files needed to run it, bundled into one package. By containerizing the application platform and its dependencies ,all differences in OS distributions and underlying infrastructure are abstracted away which makes it easy to share and execute anywhere.

    At this talk we will learn how to leverage the container technology to solve the challenges of growing testing infrastructure and continuous delivery with key focus on below items.

    • Basics of the containers technology and specifically it’s application on the test automation. 
    • How Docker can reduce the time of test execution, ease the setup of clean test environments and drastically reduce the differences between the development, acceptance and production environments leading to the higher quality of the released software.
    • Examples to containerize entire testing stack together consisting of major automation tools (selenium, appium, phantomjs), performance tools (jmeter,gatling) with cucumber. 
    • Integrating and managing testing container with other application containers to achieve easily manageable continuous delivery pipeline.
    • Best practices and patterns for docker success.

     

     

  • Liked Roy Nuriel
    keyboard_arrow_down

    Roy Nuriel / Sreevatsa S - From Pyramids to hourglass - New approach and best practices for digital apps testing

    45 mins
    Talk
    Executive

    One of the first things that you learn when you enter the quality assurance space is the famous triangle braked down to Unit test at the lower, on top of it Acceptance Tests based on API (in some places this layer is integration tests but the idea is the same) and at the top of the Pyramid we have the User Interface (UI) Tests. This Pyramid, in the last two decades was the main principle on how to approach testing activities (mainly automation).

    In the last couple of year we are all taking part in the digital transformation that is taking place all over. Mobile Native applications as well as web applications take part in almost any activity that we are doing during the day, business are building their strategy on this channel and shifting resources and budgets to deliver applications maintained and expend their market share.

    So what changed?

    The users are no longer static, they are interacting with those apps while they are on the train on their way to the office, while waiting for a flight at the airport or drinking coffee while waiting for their next meeting – those “interactions” are done most of the time while they are on the go working with mobile device. In addition the application take advantage of the sensors that those devices provide in order to provide better user experience. The environment where our end users use our application has significant impact on the functionality and performance of our application which at the end of the day we call quality.

    During the last year we developed a new approach for digital application testing – The “Hourglass” – This new approach expend the known Pyramid and update it to the digital era – The client side is richer and contains many components that impact the quality of application. It redefine the definition of coverage. At the top of the pyramid we add 2 additional triangles (the gives the hourglass shape) – The first one is devices – what devices should we test, how we should approach the changes that happens in the devise market. The second is the environment, the places that our end users will use and interact with the application. We leverage the automation investment and get the real digital coverage which will help to reach high quality applications.   

     

  • Liked Ori Bendet
    keyboard_arrow_down

    Ori Bendet - Tales from the Dark Side: The Growth, Implementation and Influence of Selenium inside Hewlett Packard Enterprise

    45 mins
    Talk
    Intermediate

    I know what you’re thinking: the creators of WinRunner, QTP/UFT are now embracing Selenium?

    Ten years after Selenium came into existence as an open source alternative to Mercury Interactive, the perception and relationship between QTP and Selenium has morphed from competition to collaboration with complementary test automation frameworks.

    Join Ori Bendet, HPE Inbound Product Manager for Functional Testing to discuss how HPE’s R&D uses Selenium and other open source tools. Understand the new roles and responsibilities of dev/test @HPE and how they fit into current team structure. Discover their lessons learned about how Selenium and open source has contributed to the success and maturity of HPE's own quality assurance and testing tools across the entire portfolio.

  • Liked Adam Carmi
    keyboard_arrow_down

    Adam Carmi - Advanced Automated Visual Testing With Selenium

    Adam Carmi
    Adam Carmi
    Co-Founder and VP R&D
    Applitools
    schedule 1 year ago
    Sold Out!
    45 mins
    Talk
    Beginner

    Automated visual testing is a major emerging trend in the dev / test community. In this talk you will learn what visual testing is and why it should be automated. We will take a deep dive into some of the technological challenges involved with visual test automation and show how modern tools address them. We will review available Selenium-based open-source and commercial visual testing tools, demo cutting edge technologies that enable running cross browser and cross device visual tests at large scale, and show how visual test automation fits in the development / deployment lifecycle.

    If you don’t know what visual testing is, if you think that Sikuli is a visual test automation tool, if you are already automating your visual tests and want to learn more on what else is out there, if you are on your way to implement Continuous Deployment or just interested in seeing how cool image processing algorithms can be, this talk is for you!

  • Dan Cuellar
    Dan Cuellar
    Head of Software Testing
    FOODit
    schedule 1 year ago
    Sold Out!
    45 mins
    Talk
    Advanced

    Over the last few years, Appium has become the choice automation tool for mobile application UI testing. Most people are familiar with the basics of Appium, but did you know that you Appium can identify elements using image recognition? Did you know you it's also possible to automate Windows phone and Desktop apps with Appium? Have you ever seen Appium run the same test on multiple operating systems, or seen an Appium test run using several devices at once?

    The talk will cover advanced Appium topics such as these along with best practices to ensure you get the most out of Appium.

  • Liked Luke Inman-Semerau
    keyboard_arrow_down

    Luke Inman-Semerau - Grid Workshop

    Luke Inman-Semerau
    Luke Inman-Semerau
    Lead Member Technical Staff
    Salesforce
    schedule 1 year ago
    Sold Out!
    480 mins
    Workshop
    Advanced

    Selenium Grid can be a bit daunting to get up and running. Starting it is quite easy, but using it effectively requires pulling in third party tools. In this workshop we’ll cover how you would realistically run your grid, using modern tooling to run a grid with docker containers or in a cloud service like AWS or theoretically your own VM provisioning environment.

     

  • Liked Sarvesh Shrivastava
    keyboard_arrow_down

    Sarvesh Shrivastava - Functional and Security Testing - An amalgamated automation approach

    45 mins
    Demonstration
    Intermediate

    With increasing cyber threats & online attacks, an unavoidable situation for continuous security testing has emerged. Making sure all vulnerabilities are unleashed regularly is highly significant.

    The paper hence proposes a solution where automated security testing could be achieved in conjunction with functional testing carried out using selenium API.

    It introduces a framework that caters to automated security testing along with functional which could provide an integrated testing elucidation.

    The paper, takes in these two premises to offer a solution where functional automation testers can now take on security testing. I propose a framework where automated security testing could be achieved in conjunction with functional testing using existing selenium API scripts.

    The framework covers the top vulnerabilities and provides intuitive results that help a non-security tester interpret and act on the output. At the very core of this framework is the open source tool, OWASP ZAP, which is easy to use and integrates well with Selenium automation frameworks.

    I bring in hands on project experience having implemented this framework for clients, who have been able to get the value of functional and security testing using the same set of scripts – it is this experience I would like to share with the SeleniumConf2016 audience, to help groom functional testers into security testing, with minimal cost and time, also enabling security testing to be performed every time functional automation is taken up.

  • Liked Christina Thalayasingam
    keyboard_arrow_down

    Christina Thalayasingam - Distributed Testing and Test Reporting

    45 mins
    Demonstration
    Advanced

    As we are moving into the agile world, continuous integration has a major role to play.

    So how do we cater for a complete test on every sprint or every release? We can use Selenium for Test Automation. When we use a continuous integration approach it would be helpful to use Selenium Grid. It allows you to run your tests on different machines against different browsers in parallel. Essentially, Selenium-Grid supports distributed test execution. 

    This helps you to run your automated tests on various different machines, operating systems and browsers at the same time. This saves time and would help  to run your testing in a nightly build.

    Extent Reports will go hand in hand with Selenium Grid as it will help you retrieve all test results including Test Evidences into a comprehendible report.

    This talk would have a quick guide on how to use Selenium. With details on how to create html reports (with latest plug-in) which would give understanding test execution results for both technical and non technical people. The highlight of the talk would be on Selenium Grid which permits to run Selenium test cases on various operating systems and browsers from a specific hub. This would cover quick demonstrations on main browsers used in the industry such as Firefox, Chrome and Internet explorer. This would help for continuous integration.

  • Liked Rajdeep
    keyboard_arrow_down

    Rajdeep - Enrich Your Automation With Visual Assertions

    Rajdeep
    Rajdeep
    Senior Consultant QA
    ThoughtWorks
    schedule 1 year ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    This talk is about a ruby gem I wrote for adding visual assertion with selenium as driver.

    While we continuously implement new functionalities in our app, automated functional tests acts as safety net and gives us confidence. Still, there is something missing. Many times we get feedback like:
    "Sign-In button has shifted and user have to scroll down to see it"
    "We wanted to change background color of screen-X, it got changed for Screen-Y screen as well"
    "Why has fonts of this link become so tiny?”
    I am working on customer facing enterprise level Mobile apps of one of the biggest airline in the world. For us user experience is as important as functionality.
    Our regression suit did not have capability to catch such issues. Moreover, we started building another airline app from the same codebase with only change in user interface of this new app. This means, change done for one app, affects another. Hence, it became really critical to enhance our automation with visual assertions.
    To accomplish this, I worte my own gem called 'nakal'.http://rubygems.org/gems/nakal

    This is going to be a Talk + Demonstration

  • Liked Vikram V Ingleshwar
    keyboard_arrow_down

    Vikram V Ingleshwar - How to be a assistant cook from waiter - my experiences with software testing and automation

    Vikram V Ingleshwar
    Vikram V Ingleshwar
    SDET
    Microsoft GmbH
    schedule 1 year ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    In this talk I would like to share good practices of BDD , Cucumber Tool and its usage with Selenium with Serenity framework , Appium and API Testing.

    I will be sharing how I had implemented BDD culture in team , which was following Agile ( fast waterfall ) , how it has helped business.

    There are many who know Selenium and are experts in it. But with BDD and Cucumber , it can be used much more efficiently.

     

    The main benefits of this methodology will be reducing bugs , re-work , tech debt , bad customer reviews , cost and increases overall productiveness and happiness across orgnisation

     

    With all these , QA can be assistant cook along with main cook ( who is developer and/or product ) and elevate from traditional waiter role , where some code is thrown at him to deliver to somebody who pays for it.

  • Liked Dharmesh Vaya
    keyboard_arrow_down

    Dharmesh Vaya - Practical tutorial in Test Framework development

    480 mins
    Workshop
    Intermediate

    Advanced users in Selenium are given the challenging task of developing a framework from scratch. However, its best to understand the core requirements of how the framework is going to be utilized in order to develop the framework with minimal efforts. This tutorial teaches development of core-building blocks that can be implemented for any Selenium based framework with maximum flexibility and minimum efforts.

  • Liked Sweta Shahi
    keyboard_arrow_down

    Sweta Shahi - Visual Regression Testing - How Selenium can help?

    Sweta Shahi
    Sweta Shahi
    Group Lead
    Srijan Technologies
    schedule 1 year ago
    Sold Out!
    20 mins
    Demonstration
    Beginner

    In today's software world, web applications need to go though constant change to maintain highest standards of quality of service. With continuous changes, one of the biggest challenges in the testing fraternity is to reduce the effort in regression testing. Often UI testing is cited as an area where automated tools have a limitation.

    In this session, will try to cover how using a simple program and using tools like ImageMagick, we can automate visual regression of the site in no time. Also, this means after every change (front-end or feature) if causes any unexpected behavior can be brought to notice immediately. A set of benchmark images of the stable version will be compared against those from the build's latest version and help reduce the extra effort testers spend in testing the UI on different browsers.