We all know that Appium can do (almost) everything what you tell it to do, but in the end we always ask it to do the same thing. We ask Appium to automate our happy and or our error flow. The result can give us the confirmation that the user can still buy a product, or verify if his bank account still has a positive balance.

But what if we need to know more than that - what if we also need to verify the layout of our app? The answer would be easy, as there are plenty of open-source or paid solutions that can help you with that. However, almost all of these solutions focus on web/hybrid apps, not on native iOS and or Android apps.

I faced this challenge when I was automating a React Native app for my customer. There was no image comparison tool that could do what I wanted it to do, so I rolled up my sleeves and started building my own. In this talk we’ll be walking down the path I’ve been taking and I’ll explain:

  • Why I used ResembleJS as my core visual comparison solution
  • The things I’ve learned about Appium in the process (pro tips!)
  • The differences between iOS and Android and how I managed to solve this in one cross-platform solution
  • The pros and cons of my solution
 
4 favorite thumb_down thumb_up 5 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/Structure of the Case Study

After explaining the reason why I created this module I’ll be handling the following topics:

  • Why I used ResembleJS as my core visual comparison solution
  • The things I’ve learned about Appium in the process (pro tips!)
  • The differences between iOS and Android and how I managed to solve this in one cross-platform solution
  • The pro’s and con’s of my solution

Learning Outcome

Participants will understand how:

  • How to take advantage of some less well-known features for more Appium awesomeness
  • What you need to take into account when you are creating a cross-platform solution
  • What things you need to know about Appium in combination with iOS and Android
  • How to create a visual comparison tool for native apps

Target Audience

Anyone who is interested in how to build your own cross-platform visual testing module for native apps for testing with Appium. Or anyone who just wants to know more about Appium.

Prerequisite

some experience with Appium, iOS and Android will be useful

schedule Submitted 1 month ago

Public Feedback

comment Suggest improvements to the Speaker
  • Srinivasan Sekar
    By Srinivasan Sekar  ~  1 month ago
    reply Reply

    Hi Wim Selles,

    Thanks a lot for your submission. I hope you are aware that appium is integrated with open cv (though this needs to be installed as a prerequisite) and can perform quite a lot of stuff that is possible with what open cv is already capable of. Would like to understand how does your solution fits in here with ResembleJS? How is your solution different from this and the reasons will help us analyze better?

    - Srini

    • Wim Selles
      By Wim Selles  ~  1 month ago
      reply Reply

      Hi Srinivasan,

       

      Thanks for asking, this will also be one of the first things I wanted to answer during my talk. The reason for not using for example Open CV is that I always try to make a module as "small" as possible with no extra language or other environmental dependencies then npm-packages.

      This solution is a pure NodeJS solution meaning users can already use this package when they have installed NodeJS locally or have a NodeJS docker image (in their pipeline).

      I hope this answers your question

      • Srinivasan Sekar
        By Srinivasan Sekar  ~  1 month ago
        reply Reply

        Hmm, appium also uses nodeJS module of Open CV package from npm. The difference I personally see as you said is yes resembleJS is lighter compared to Open CV but Open CV is feature rich as well. Also, both need to be installed separately by our users.

        • Wim Selles
          By Wim Selles  ~  1 month ago
          reply Reply

          It's good that you mention it and also question it, but I still think my solution/implementation is different.

          I created an npm package that can be used as a plugin into WebdriverIO. It has no other environmental dependencies other then NodeJS.
          During my talk I want to explain which things I learned about taking screenshots that can be used for comparing images, what you need to know about for example  elements which contain dynamic content, how you can compare them and in the end, how you can do this on your own.


  • Justin Ison
    Justin Ison
    Sr. Software Engineer
    Microsoft
    schedule 2 months ago
    Sold Out!
    45 Mins
    Demonstration
    Beginner

    In today’s agile world the time to market is becoming increasingly shorter. There is a constant desire to release ASAP to keep ahead of the competition and to please users with updated/new features. Because of this, we have less time to fully do manual and exploratory testing of our apps. Especially, when you consider all the combinations of OS's, Locales, Accessibility, Orientations & Resolutions apps support. Running anywhere from 1 to 100's of Appium crawler bots (covering all of those combinations) at once we can discover more issues quickly and efficiently without having to write a line of code.

    UI Automation also has its limitations as it only tests for expected results. Crawler bots test the unexpected, by collecting metadata such as logs, app strings, screenshots, memory and reporting back it’s finding for review so we can test all these combinations quickly and more efficiently. In this talk, I will go over the current challenges we face in today's development world, why we need more tools to help us keep pace, and cover how you can build your own Appium crawler.

    I've open sourced this tool and is available here for everyone to use: https://github.com/isonic1/Appium-Native-Crawler

  • Liked Srinivasan Sekar
    keyboard_arrow_down

    Srinivasan Sekar / Sai Krishna - Native mobile commands in Appium

    45 Mins
    Tutorial
    Intermediate

    Apple and Google’s test automation framework does not natively support W3C standards for few web driver spec implementations directly for e.g TouchActions interface in XCTest, etc. Although test automation frameworks support a rich set of those functions specific to platforms, Appium does provide ways to directly invoke these functions e.g gestures, biometric handling, etc.

    Many special behaviors and workarounds are made available and achieved only through executing platform-specific native commands of Appium. For instance, there are 100+ issues been reported on date picker or handling picker wheel in the appium organization but it can be achieved quite easily by executing native mobile commands.

    There are so many that testers might not get chance to go through each one of these and get acquainted with all of those. Native mobile commands help to handle much complex use cases like biometric handling, talking to Siri, performance profiling, etc quite easily.

  • 45 Mins
    Case Study
    Intermediate

    Experimentation and quick feedback is the key to success of any product, while of course ensuring a good quality product with new and better features is being shipped out at a decent / regular frequency to the users.

    In this session, we will discuss how to enable experimentation, get quick feedback and reduce risk for the product by using a case study of a media / entertainment domain product, used by millions of users across 10+ countries - i.e. - we will discuss Testing Strategy and the Release process an Android & iOS Native app - that will help enable CI & CD.

    To understand these techniques, we will quickly recap the challenges and quirks of testing Native Apps and how that is different than Web / Mobile Web Apps.

    The majority of the discussion will focus on different techniques / practices related to Testing & Releases that can be established to achieve our goals, some of which are listed below:

    • Functional Automation approach - identify and automate user scenarios, across supported regions
    • Testing approach - what to test, when to test, how to test!
    • Manual Sanity before release - and why it was important!
    • Staged roll-outs via Google’s Play Store and Apple’s App Store
    • Extensive monitoring of the release as users come on board, and comparing the key metrics (ex: consumer engagement) with prior releases
    • Understanding Consumer Sentiments (Google’s Play Store / Apple’s App Store review comments, Social Media scans, Issues reported to / by Support, etc.)

  • Liked Dawid Pacia
    keyboard_arrow_down

    Dawid Pacia - Mobile & IoT integration testing - "Mission Impossible" or "A last hope"?

    Dawid Pacia
    Dawid Pacia
    Test Automation Manager
    Brainly
    schedule 2 months ago
    Sold Out!
    45 Mins
    Case Study
    Intermediate

    It is predicted that till 2025 there will be over 75 billion devices spewing 180 zettabytes of data and generating up to 6 trillion dollars. That enormous increase force companies to introduce a continuous approach to deliver the product as fast as possible and be able to compete on the market.


    The main question is how to test application for end user among so much hardware equipment and ecosystems combining HW, FW, mobile devices and complex backend architecture? Considering all factors and possible obstacles is it for companies a real “A New Hope” for companies or just simply “Mission Impossible”?


    I will take the participants on a journey to the IoT world. It will be a talk about the challenges that any tester will face at some point. I will present the dangers, risks and snares but also good practices and practical approach to mobile E2E test automation for the IoT solutions in CI approach.


    Technical examples will be presented using Python languages and supported by physical devices (mobile phones and IoT equipment).

  • Liked Anton Angelov
    keyboard_arrow_down

    Anton Angelov - How to Test the Test Automation Framework?

    Anton Angelov
    Anton Angelov
    CTO
    Automate The Planet
    schedule 1 month ago
    Sold Out!
    45 Mins
    Demonstration
    Intermediate

    Nowadays, more and more companies are building test automation frameworks based on WebDriver and Appium for testing their web and mobile projects. A big part of why there are so many flaky tests is that we don't treat our tests as production code. Moreover, we don't treat our framework as a product. In the talk, you will see examples of how you can automate the testing of your test automation framework and be sure that it is highly reliable. You can get lots of ideas for various types of tests such as learning tests verifying that 3rd party dependencies are not breaking the code, compatibility tests checking that the UI components are working for each mobile control on each OS, cross-platform verifications for testing whether everything is working on multiple OS. Sample test environments for storing different distributions of the framework packages will be presented.

  • Liked Christian Bromann
    keyboard_arrow_down

    Christian Bromann - Appium for Couch Potatoes: An HbbTV Driver

    Christian Bromann
    Christian Bromann
    Software Engineer
    Sauce Labs
    schedule 2 weeks ago
    Sold Out!
    45 Mins
    Talk
    Beginner

    Almost 13 years ago we started with Selenium to automate websites. With Appium we generalised that concept on mobile and just recently entered the Windows and Mac space by adding a Windows and Mac OS driver to the Appium family. Let’s continue our StarDriver quest and enter a (not quite) new sphere: the television. Within the last years, a new standard called Hybrid Broadcast Broadband TV (HbbTV) evolved with which the latest generation of Smart TVs has been equipped. This standard allows broadcasters to build web apps for their broadcast channels to provide additional context information to the TV stream or videos on demand.

    The number of HbbTV apps being developed is increasing more and more as the standard gets rolled out to the whole world. By now almost all TV manufacturers support the standard and due to the high number of TVs in the market the fragmentation is extreme. Different TVs run different proprietary rendering engines with a different level of JavaScript support. Until today the only way to test an HbbTV app is by taking the remote control and manually walking through the app, this has to change.

    This talk will introduce a new driver to Appium that allows the running of automated tests based on the Webdriver protocol for HbbTV apps on Smart TVs. It will explain not only how the driver works but also how in general other drivers do their job in the Selenium and Appium world. We will look into the challenges that automating an app for a TV device brings and will talk about how anyone can build a driver for anything.

  • Liked Jonah Stiennon
    keyboard_arrow_down

    Jonah Stiennon - All Desired Capabilities

    Jonah Stiennon
    Jonah Stiennon
    Partner
    Cloud Grey
    schedule 1 month ago
    Sold Out!
    90 Mins
    Tutorial
    Intermediate

    Appium has so many desired capabilities! How many exactly? Let's count!

    Join Appium contributor Jonah Stiennon as he iterates through every desired capability supported by Appium.

    Many special behaviors and specific workarounds are made available only through desired capabilities. Often the key to selecting an element reliably, launching an app, or avoiding a timeout, is picking the right set of desired capabilities. There's so many that testers don't get the chance to sit down and become acquainted with them all.

    There's too many to easily memorize and documentation can be sparse. Jonah will introduce novel ways to classify, visualize, and organize all of the desired capabilities, making it easier to find ones which can be useful.

  • Liked Sravan Kumar
    keyboard_arrow_down

    Sravan Kumar - Bootcamp to understand Appium android internals

    45 Mins
    Tutorial
    Intermediate

    Appium is a world's most popular open source mobile test automation framework developed using WebDriver protocol and I am fortunate enough to get a chance to contribute to appium-uiautomator2-server and appium-uiautomator2-driver modules.

    The goal of the session is to help the Appium community to have a better understanding of Appium and how it works.

    In this session, I will be discussing Appium architecture specifically towards its Android modules(UiAutomator2 and Espresso) and how the communication happens between Appium modules.

  • Liked Bruno Alassia
    keyboard_arrow_down

    Bruno Alassia - Go beyond the software, automate hardware scenarios on Android Emulators

    Bruno Alassia
    Bruno Alassia
    Sr. Software Engineer
    SauceLabs
    schedule 2 months ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    Explore the limits Appium can help you achieve to control the Android Emulator behavior. Automate network emulation, receive fake SMS and phone calls, change the battery states and levels and a lot more, all using real-life test cases. What happens to my app if I lost connection? How does my UI react to an incoming phone call? And more.

  • Liked Sai Krishna
    keyboard_arrow_down

    Sai Krishna / Srinivasan Sekar - Life Cycle of an Appium command

    45 Mins
    Talk
    Beginner

    Every command you write using Appium Client Library will be converted to JSON Wire Protocol over HTTP which in turn will be passed to the drivers(AndroidDriver, IOSDriver). The respective driver doesn’t just send or execute the command directly on the device. Appium has a Lifecycle of modules which sends the command to the devices.

    Abstract:

    The goal of the session is to help the Appium community to have a better understanding of Appium and how it works internally.

    Will discuss on following aspects:

    • What happens under the hood when the session is created, mainly how appium connect to the corresponding device, installing the app, launching the app and the different steps involved in the process.

    • Command life cycle - How client request converted into an HTTP request, how received request passes through appium drivers(ios-driver & AndroidDriver) and the respective driver don’t just send or execute the command directly on the device. Appium has a Lifecycle of modules which sends the command to the devices.

    • How the final response passed to the client through different layers.
  • Liked Kazuaki Matsuo
    keyboard_arrow_down

    Kazuaki Matsuo - Uncovering breaking changes behind UI on mobile applications

    45 Mins
    Case Study
    Intermediate

    It is essential to track user logs correctly to improve and develop your own web/mobile services continuously. For instance, how users flow on your applications to evaluate if they work expectedly or not.

    Meanwhile, mobile application trends have been changed quickly such as architectural things or UI related one. Developers continue to add, refactor or rewrite their applications frequently. They also need to release them frequently, 2-week release for instance. Their business also changes quickly. A number of developers working for one application also has been increasing.

    As a result, it is quite difficult to catch up with everything. Developers know a part of them. They add, rewrite or refactor codebase they do not know well with exploratory it. Functionalities related to UI are easy to understand. But, it is difficult to uncover what happens in the backend such as what kind of logs the app sends to servers.

    In Android case, if one application sends a log to a server on a fragment's onCreate. But the fragment can use in another view. If a developer does not know what the log means, he/she might re-use the fragment in another view if he/she think they can re-use it. It can break activity logs collecting on the server side. How to maintain logs is also an interesting topic though.

    In general, we notice the breaking after releasing the app since we can easy to observe the number statistically. But, it means we can not use the data to evaluate our business correctly until we fix it and re-release it.

    In this talk, I would like to show an example of how I had been implemented to uncover the above thing following some scenarios based on my experience. It might be an example what we already can automate in the mobile world.

    This topic is similar to monitor CPU/Memory/network thing. This story is based on my experience I had been worked for a couple of years.

  • Liked Tomer Cohen
    keyboard_arrow_down

    Tomer Cohen - Low-level android automation with adb

    45 Mins
    Talk
    Beginner

    When we speak about Android automation, the first thing that comes to mind is Appium, however, what if Appium doesn't serve all your Android automation needs, at least not in the most efficient way?

    When I was asked to create a test automation framework for our android service (no GUI), I needed to choose the right tool for the mission. After several weeks of researching many options (both commercial and open source). I realized that ADB is my best call because of the following reasons:
    • ADB provides a faster to run solution for controlling an android device
    • ADB is in a lower level of Android OS therefore it's more flexible
    • ADB is going through less code components (like appium client, appium server etc..) and as a result is more reliable

    In this tutorial I will share my journey towards deciding to use Android Debug Bridge when it comes to non-gui android application and how I have implemented my choice.
    After this tutorial, you will have a better understanding of what is ADB, how it works, and how you can start and apply automation for the Low-Level layer of Android OS with ADB and Python.

  • Liked Anton Angelov
    keyboard_arrow_down

    Anton Angelov - The 5th Generation of Test Automation Frameworks

    Anton Angelov
    Anton Angelov
    CTO
    Automate The Planet
    schedule 1 month ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    The need for test automation nowadays is undeniable. For choosing the right solution for our context, we need to know what are our options and fully understand them. We will talk about the five generations of test automation frameworks, what they include, who uses/used them and how they are related to the evolution of the QA profession.

    The full-stack test automation frameworks are the 5th generation of tools. You will hear why they are different, what they include and why this is important. Understanding the evolution of the automation tooling entirely will help you define better the requirements for your test solution or give you ideas on what to improve in your existing one. As a bonus, you will see demonstrations of sample features of such a framework and get inspired how to build them yourself.

  • Liked Anand Bagmar
    keyboard_arrow_down

    Anand Bagmar - Build your own MAD-LAB - for Mobile Test Automation for CD

    45 Mins
    Case Study
    Intermediate

    In this age of a variety of cloud-based-services for virtual Mobile Test Labs, building a real-(mobile)-device lab for Test Automation is NOT a common thing – it is difficult, high maintenance, expensive! Yet, I had to do it!

    Attend this talk to understand the Why, What and How I built my own MAD-LAB (Mobile Automation Devices LAB). The discussion will include –

    • Understanding the context,
    • Why no cloud-based solution worked for me,
    • The automation strategy for Android / iOS / Web platform,
    • The tech-stack (cucumber-jvm / Appium), and,
    • The core implementation to build your own MAD-LAB! (already open-sourced)
    • How this results in Continuous Delivery (CD)
  • Liked Oleksiy Chubey
    keyboard_arrow_down

    Oleksiy Chubey - Painless Appium iOS/Android Parallelization

    45 Mins
    Case Study
    Intermediate

    In this talk, we will have a look at problems and solutions for Appium test parallelization in Java, we will learn why parallelization is needed. We will have a guide back on what problems were solved, what solutions were considered and learned from to come to our solution for multi-device management and parallelization. We will see what solution we built on our own by providing device information for usage in Appium tests through a public API and by automating setup of devices. In addition to our solution, we will walk through other parallelization solutions in Java. We will look at Selenium Grid, Optimus and Appium Test Distribution, identifying their strong points and the reasons for making another option available.

  • Liked Eran Kinsbruner
    keyboard_arrow_down

    Eran Kinsbruner / Uzi Eilon - Future-Proofing Testers in the Age of AI, ML, and Bots

    45 Mins
    Talk
    Advanced

    We're all hearing the buzzwords of AI, machine learning, chatbots, and next-generation testing. Does this mean that the days of traditional testing as we know and practice it are over? Eran Kinsbruner doesn't think so. Join him to learn about the clear transformation happening toward smarter testing techniques and tools. These approaches will drive better pipeline efficiency and release velocity with high quality, and Eran thinks this means good things for the testing practice and practitioners. You'll discover the key trends that are happening around AI, machine learning, and bots in the web and mobile landscapes, and get the ability to identify some early adopters who are taking the lead in these domains. Learn some key requirements and skills that are required for a test engineer to shift toward the future of automation, as well as the changes testers will need to undergo in order to become future leaders in this space.

  • Liked Aisyah Dzulqaidah
    keyboard_arrow_down

    Aisyah Dzulqaidah - Cloud Based Mobile Application Testing with Appium

    Aisyah Dzulqaidah
    Aisyah Dzulqaidah
    TEST ENGINEER
    BBM
    schedule 1 month ago
    Sold Out!
    20 Mins
    Demonstration
    Beginner

    Testing our mobile application using real device or local emulator is not scalable and need high maintenance. As the test is bigger , we need to make our test is parallel to make it faster and efficient. We also need to test it agains many variety of device and OS version. Running testing using device cloud is the solution, so in this session I will show you how to setup and run parallel automation testing using Android device emulator. In this case, I wil show the demonstration using Genymotion Cloud, Appium, and Robot Framework.

  • Liked Prachujya Saikia
    keyboard_arrow_down

    Prachujya Saikia / Shabir Shariff - Connecting APIs to help automate IoT Endpoints

    45 Mins
    Demonstration
    Beginner

    Promising a convenient life by enabling machine-to-machine and machine-to-human communication, IoT (Internet of things) technologies are fast gaining ground. In the not-too-distant future, we might see refrigerators automatically ordering items that need replenishing and cars steering us around on their own. This means designers, developers and QA engineers will have more opportunities than ever before to significantly impact the lives of millions.

    There will never be enough QA engineers for testing IoT offerings, because there will be numerous layers and devices to test for functionality, interoperability, security, and more. Although a certain high level of manual testing will be required for , having more to test means that they will need to prioritize and automate whatever you can. This would increase the demand for better automation testing, leading to a rise in the number of sophisticated testing models in the connected world.

    APIs connecting our connected world should be automated as much as possible because without a fully functioning API, there will simply not be connected to the Internet anymore. Creating API tests manually, based on a written description, can be time-consuming and inaccurate.

    An API, typically based on JavaScript Object Notation (JSON), is often layered on top of the transport protocol. This transport layer helps interact with the device. Automation Engineers can use these protocols and APIs to automate IoT devices. The Automation framework must be able to support these protocols and APIs in order to be effective.

    An IoT gateway helps connect smart IoT endpoints with sensors over cloud. With the help of the rest APIs of the IoT endpoints we have developed a test environment where all APIs are integrated with our automation framework.

    In this talk, we will demonstrate how to integrate established connection between IoT endpoints and cloud server with automation environment to help teams to bring APIs into automation of IoT devices which helps in detecting reliability, functionality of IoT endpoints.

  • Liked Fitri Juliana Manurung
    keyboard_arrow_down

    Fitri Juliana Manurung - UI testing on Mobile

    Fitri Juliana Manurung
    Fitri Juliana Manurung
    Test Engineer
    BBM
    schedule 1 month ago
    Sold Out!
    20 Mins
    Talk
    Beginner

    This session will talk about how testing not only verified the features work as expected but also ensure the user interface produces the right output. UI testing is more closely associated with the device or emulator than with the platform language. This enables to record a UI flow on one device and then replay the test to other devices.

    Based on my own experience, UI testing with the manual test is so frustrated when we have a new build every day especially if we have a lot of test cases need to be verified before the product goes to market. With the power of image processing, Automated UI testing is possible to created which is really helpful to reduce the testing time.

    I would like to share how the team in BBM implemented the automation to automate the UI testing. comparing some of the existing libraries that supported robot framework and try to create the extended library to fulfil the needs.

  • Liked Venkatesh Singh
    keyboard_arrow_down

    Venkatesh Singh - Automating Functional Test Scenarios which require multi user login

    20 Mins
    Experience Report
    Intermediate

    While we work on Functional test Automation, as Automation engineers we get lot of functional tests which require multi user login concurrently.

    I would like to discuss on effectively Automating such scenarios.