filter_list help_outline
  • Ragavan Ambighananthan
    keyboard_arrow_down

    Ragavan Ambighananthan - Why cross browser and device platforms are ripe for disruption?

    45 Mins
    Talk
    Advanced

    Goal:

    To scale desktop/mobile web/app test automation in a cost-effective way that would meet the demands of good software development design patterns like Shift Left, at the same time, be cost effective.
     

    Problem Statement:

    Current cross browser/device platforms are not built to handle the real scalability that software development design patterns require, in a cost-efficient way.
     

    Expensive parallel connection limit:

    Most or all cross browser platforms, offers their services based on the number of parallel connections.
     

    Shift Left and Scalability:

    Problem with current approach followed by these platforms is that it is not aligned to software development best practices like Shift Left.
    With Shift Left, automation suite would run for every commit in a branch of a project, the number of tests running at any point in time is significantly high. Again with this being repeated by many teams, within their own CICD pipeline, across an organisation,, the demand for parallel connections increases exponentially. The cost to support this using current cross browser and cross device approach is astronomical.
     

    Restricted Real Device Usage:

    Most cross browser and cross device platforms' primary support are around real device and not emulators or simulators. With real devices, there is restriction on the number of concurrent tests you can run, based on device types and tiers, even though you may have higher parallel connections purchased. This is due to limited number of real devices a platform has and having to share it with 1000s of customers on demand.
     

    Data Center vs Cloud:

    Fourth reason is, most these platforms rely on data centres, instead of Cloud. Hence their ability to dynamically scale desktop/mobile automaton infrastructure is very limited.
     

    Desktop is still king of conversion:

    Fifth, as much as we would like to think that mobile web is matured, conversation rate in mobile is the lowest compared to Desktop/Tablet as per Akamai. It could be due to many reasons, including performance, usability, etc. This also means that, since the conversation is more in desktop,  importance of testing on desktop browsers is still by far more.
     

    In App Browser Testing:

    Sixth, In App Browser is a new trend, where you might have tested your mobile web on different browsers, but it will probably mostly viewed in an In App Browser like Facebook In App Browser (When you open a site in Facebook, it opens it within Facebook's realm instead of on a browser). Even though In App browser uses Chrome or Safari, many users are complaining, that their site is broken when viewed via In App. Companies like Facebook / LinkedIn would like to keep you within their realm so they can track you, hence your mobile web site's experience should also be tested in these In App Browsers. 2018/2019 Facebook In App Browser usage, showed 42% increase as per Akamai.
     
    This means, you have to test your mobile site in In App Browsers as well.
     

    Emerging Country Specific Browser:

    Revenue generation percentage for international eCommerce companies is traditionally very high (more than 50%) from U.S, but this is changing where it is normal for a company's ~50-60%% revenue to come from non-US markets. This is also another reason to look at local browser usage habits.
    Chromium based Cốc Cốc browser is used by 25 million people in Vietnam.
    UC Browser and QQ Browser are number 2 and 3 in China and UC Browser is number 2 in India.
    Yandex is number 3 popular browser in Russian Federation. Just these 4 countries alone has around 2.5 billion people.
     
    These are many of the problems with the current Cross Browser / Device Platforms.
    a) Expensive parallel connections, b) Limited scalability thats not suitable for good SDLC design patterns c) Real device restriction d) Data centre limitation  e) New use cases, increasing scope and frequency of testing  f) New region specific browsers
     

    New Opportunities - Evolution of Technologies

    Now let us look at what has changed in terms of technology that could take us away from the above problems.
     
    a) AWS mac1.metal (Mac Mini computers) - AWS, for the first time, providing scalable Mac minis. Even though auto scaling is not supported yet, this can be used as a scalable solution to build OS X Safari, iOS Simulator at scale, for automation.
    b) Many companies providing "Mac Mini Cloud" including Apple XCode Cloud (beta) for device testing.
    c) With AWS bare metal instances, you can scale Android Emulators to any limit.
    d) With legacy IE discontinuing in June 2022, one less browser to worry about.
    e) Proprietary solutions like MacStadium Okra which allows to run OS X as a container in K8s is bound to change the game.
     

    Solution:

    Going by Mobile Test Pyramid, bottom most layer uses desktop browser to emulate mobile devices' break points, to test the responsiveness of the pages, example would be Chrome Emulator. Scalable solution to this can be implemented using cloud providers like AWS / K8s combined. Second layer of the Mobile Test Pyramid uses Android Emulator/iOS Simulator, again with AWS/GCP/Azure and other OS X cloud providers, iOS Simulator/OS X Safari/Android Emulator can be implemented at scale. Most of the use cases of mobile web can be tested on emulators/simulators and can be implemented at scale using cloud providers, mobile apps may have some exceptions. For mobile web testing, there is no need to test bluetooth, gps, battery drain, calling, etc The top layer of the pyramid, real devices can be used from cross browser platforms to do sanity cases, thus keeping the cost down.
  • Diego Molina
    keyboard_arrow_down

    Diego Molina - Selenium Grid 4 and Appium together in harmony

    Diego Molina
    Diego Molina
    Sr. Software Engineer
    Sauce Labs
    schedule 1 week ago
    Sold Out!
    45 Mins
    Demonstration
    Intermediate

    Selenium 4 brings a brand new Grid, full of features and great things! Grid 4 has a new flexible architecture, allowing you to run it in a fully distributed mode, in the traditional Hub/Node mode, or in the simple Standalone more. It has built in observability and GraphQL endpoints, and even a good looking UI!

    But wait... If Grid 4 is so great, why can't I use Appium with it? I want to scale up my tests!

    The wait is over! This presentation will demonstrate how Appium can be used with Selenium Grid 4. More in detail, it will:

    • Give an overview of how Grid 4 works
    • Show how to configure Grid 4 to make it work with Appium
    • Share tips to migrate from Grid 3 to Grid 4

    Join this presentation, we will take Grid 4 for a ride and you will learn how to use it to scale up your mobile testing!

     

     

     

     

  • 45 Mins
    Demonstration
    Intermediate

    Have you heard of “flaky tests”?

    There are a lot of articles, blog posts, podcasts, conference talks about what are “Flaky tests” and how to avoid them.

    Some of the ideas proposed are:

    • Automatically rerun failed tests a couple of times, and hope they pass
    • Automatically retry certain operations in the test (ex: retry click / checking for visibility of elements, etc.) and hope the test can proceed

    Unfortunately, I do not agree with the above ideas, and I would term these as anti-patterns for fixing flaky / intermittent tests.

    We need to understand the reasons for flaky / intermittent tests. Some of these reasons could be because of issues like: 

    • timing issues (i.e. page loading taking time)
    • network issues
    • browser-timing issues (different for different browsers / devices)
    • data related (dynamic, changing, validity, etc.)
    • poor locator strategy (ex: weird & hard-wired xpaths / locators)
    • environment issue
    • actual issue in the product-under-test

    In this session, with the help of demos, we will look at the following techniques you can use to reduce / eliminate the flakiness of your test execution:

    • Reduce number of UI tests
    • Use Visual Assertions instead of Functional Assertions
    • Remove external dependencies via Intelligent Virtualization

    Demo will be done using the following and sample code will be shared with the participants

  • Anand Bagmar
    keyboard_arrow_down

    Anand Bagmar - Next Generation Functional & Visual Testing powered by AI

    90 Mins
    Workshop
    Beginner

    The Test Automation Pyramid is not a new concept.

    TestPyramid-IncludesUX%2526NFRs.jpeg

    The top of the pyramid is our UI / end-2-end functional tests - which simulate end-user behavior and interactions with the product-under test.

    While Automation helps validate functionality of your product, aspects of UX validations can only be seen and captured by the human eye and is hence mostly a manual activity. This is an area where AI & ML can truly help.

    With everyone wanting to be Agile, make quick releases, the look & feel / UX validation, which is typically a a manual, slow, and error-prone activity, quickly becomes a huge bottleneck.

    In addition, with any UX related issues propping up cause huge brand-value and revenue loss, may lead to social-trolling and worse - dilute your user-base.

    In this hands-on workshop, using numerous examples, we will explore:

    In this workshop, using numerous examples, we will explore:

    • Why Automated Visual Validation is essential to be part of your Test Strategy
    • How Visual AI increases the coverage of your functional testing, while reducing the code, and increasing stability of your automated tests
    • Potential solutions / options for Automated Visual Testing, with pros & cons of each
    • How an AI-powered tool, Applitools Eyes, can solve this problem.
  • Eran Kinsbruner
    keyboard_arrow_down

    Eran Kinsbruner - Testing Mobile Apps with Flutter and Appium - The Tradeoffs

    Eran Kinsbruner
    Eran Kinsbruner
    Global Evangelist
    Perfecto
    schedule 4 weeks ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    Google is moving quite fast with the Flutter technology and more and more organizations are switching their apps from native implementation to Flutter. Understanding what Flutter is, what are the challenges and limitation of the technology as well as the benefits is key for a good test engineer in that space.

    In this session, Eran Kinsbruner, Senior Director and Author from Perfecto at Perforce will provide insights into Flutter technology, flutter testing framework and the differences between Flutter with Dart and Appium Flutter driver.

  • Wim Selles
    keyboard_arrow_down

    Wim Selles - Swiping your way through Appium

    Wim Selles
    Wim Selles
    Sr. Solutions Architect
    Sauce Labs
    schedule 1 month ago
    Sold Out!
    45 Mins
    Demonstration
    Beginner

    Mobile applications are becoming more and more important in our daily lives. From ordering clothes to grocery shopping, the services available via an app are increasing rapidly and users expect a seamless experience. This means that the automation focus is shifting more towards mobile devices. 

    But did you know that there is a huge difference between interacting with a desktop browser and a mobile app? And that difference is just a few tiny hand motions! Because with desktop browser automation we mainly focus on using our mouse, but on devices, we use our fingers to execute all different kinds of gestures, like swipe, scroll, pinch/zoom, and many more. Did you also know that automating mobile gestures is one of the most overlooked features in mobile automation?The most common reason for this could be that we don’t know how to do it, or because it might just be too difficult. 

    During this presentation, we will focus on how to mimic mobile gestures with Appium for Android and iOS. With a sample app we will explore and understand different gestures including how to scroll, swipe, and pinch/zoom and then create cross-platform and cross-device gestures. By the end of this presentation, you’ll learn how to improve the user experience of your mobile applications by adding gestures to your automation scripts.

  • Sudharsan Selvaraj
    keyboard_arrow_down

    Sudharsan Selvaraj - Doing wonders with webdriver

    Sudharsan Selvaraj
    Sudharsan Selvaraj
    SDET
    Jumio
    schedule 4 days ago
    Sold Out!
    45 Mins
    Demonstration
    Intermediate

    Webdriver is primarily used for automating applications for testing purposes, it’s actually intended for browser/mobile automation more generally. It's up to users to come up with creative applications of the automation framework.


    As mentioned, most of the users use webdriver just for testing purposes and fail to utilize the full potential the tool has to offer. As a result, all innovations and supporting libraries are purely focused on just testing aspects.

    The primary motive of this session is to express my thoughts on how innovation can be applied along with webdriver to create wonders in the automation world.

  • Masayuki Wakizaka
    keyboard_arrow_down

    Masayuki Wakizaka - How Appium automates hybrid mobile apps and edge issues I've encountered

    Masayuki Wakizaka
    Masayuki Wakizaka
    Engineer
    TRIDENT Inc
    schedule 3 weeks ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    Frameworks for hybrid mobile apps, such as React Native, Cordova etc, have attracted more attentions. One of the reasons is that those frameworks enable us to develop both iOS and Android apps with web technology. This is important, as not only it breaks technology barriers in terms of native apps, but also it enables us to share one codebase across platforms.

    However, when it comes to E2E testing on hybrid mobile apps, it can be challenging. Most of the cases the problem comes from context we test. As long as we test hybrid mobile apps as a native app, locators can be complicated and  it is difficult to share one test case across platforms. In order to address the problem here, we need to switch context. i.e. we should test them as web 
    apps as they developed with web technology.

    In this session, firstly I'll explain hybrid mobile apps and how to test them with Appium. Then, I'll illustrate how Appium automate hybrid mobile apps. Finally, as a developer of test automation service, I'll show some edge issues related to automating mobile apps and their solution/workaround.

  • Chandan Mishra
    keyboard_arrow_down

    Chandan Mishra - How I Reduced Appium Tests Execution Time By 50%

    Chandan Mishra
    Chandan Mishra
    Lead SDET
    Finaccel
    schedule 1 month ago
    Sold Out!
    45 Mins
    Case Study
    Beginner

    In this session, I will share the mistakes which We made in the initial phase while creating automated tests using Appium, the reasons behind those mistakes, and the solutions which helped us to reduce Appium tests execution time.

    This session is inspired by an activity which we did last year in Financial to improve mobile tests execution time, details can also be found here- Blog Link

  • Shannon Lee
    keyboard_arrow_down

    Shannon Lee - How AI can Assist Script-Based Automation

    Shannon Lee
    Shannon Lee
    Dev Evangelist
    Kobiton
    schedule 4 days ago
    Sold Out!
    45 Mins
    Demonstration
    Beginner

    Mobile application automation is a formidable approach to decreasing testing time and cost while increasing confidence in testing coverage. However, mobile application automation is complicated given the lack of open source tools, device fragmentation, complicated native application development, and loss of time-to-develop compared to web-based automation. However, we are fortunate to bridge the years of mobile application automation from its current infancy to further maturity via AI & machine learning assistance; thus, creating codeless (scriptless automation). AI assistance can put forth even further value to mobile application automation by also offering a solution to assist script-based automation in finding and generating correct technical identifiers. This helps alleviate the major pain point of flaky & unreliable test scripts, so that testers may focus more time on the important things, like the never-ending checklist of testing, and less time on maintaining & tweaking unreliable scripts, all while keeping the traditional, programmatic approach to automation.

  • Puneet Kala
    keyboard_arrow_down

    Puneet Kala - Visual Testing for Mobile Apps using Codeceptjs-Resemblehelper

    Puneet Kala
    Puneet Kala
    QA Automation Engineer
    Consultant
    schedule 2 weeks ago
    Sold Out!
    20 Mins
    Demonstration
    Beginner

    Visual testing is becoming more and more useful and common in the QA world, we have many tools which allow us the ability to perform visual regression testing, Resemble.js is also another such library that can be used for image analysis and comparison, we prepared a helper around resemble.js which works with CodeceptJS and Appium for mobile visual regression testing. 

    Users have the ability to perform visual regression for specific elements, for specific sections in the view or the entire view of the application, the helper is highly customizable and completely open-source, and free to use. 

    The codeceptjs-resemblehelper is available https://github.com/codeceptjs/codeceptjs-resemblehelper and usage and installation instructions for the helper can be found on the readme, some examples and details usage can also be found on the codeceptjs website: https://codecept.io/visual/#visual-testing 

  • Pavel Strunkin
    keyboard_arrow_down

    Pavel Strunkin - Visual testing with Visual Regression Tracker

    Pavel Strunkin
    Pavel Strunkin
    QA
    Playtika
    schedule 2 weeks ago
    Sold Out!
    20 Mins
    Talk
    Beginner

    Keeping control over how your app looks like in a hight variety of devices and screen resolution is a hard quest.
    Gonna introduce to you open source, self-hosted solution for visual testing, and managing results of visual testing that I'm personally using and developing.
    https://github.com/Visual-Regression-Tracker/Visual-Regression-Tracker

  • Wim Selles
    keyboard_arrow_down

    Wim Selles - Workshop Automating Hybrid Applications with Appium

    Wim Selles
    Wim Selles
    Sr. Solutions Architect
    Sauce Labs
    schedule 1 month ago
    Sold Out!
    90 Mins
    Workshop
    Beginner

    When developing mobile applications, organizations have different apps to choose from; mobile web, native, or hybrid. While web apps are just websites accessed via the internet on mobile browsers like Chrome or Safari, native applications are developed for specific platforms, such as Android or iOS. Hybrid apps are different because they possess elements from both native apps and web apps..

    When automating web applications, Selenium commands are used. Nine out of ten times the same automation script can be used for mobile web applications as our desktop web applications. With native apps however, we need to look deeper into the differences between Android and iOS apps before we can use Appium commands. 

    But how should you automate hybrid apps? Can or do you need to choose one of the two automation strategies or is there also a hybrid approach for automating hybrid apps?

    That’s what we are going to look at during this workshop. We will be looking into

    • how to detect a hybrid application for Android and iOS, 

    • how to automate a webview

    • how to switch between webviews

    • how to use the full potential of automating hybrid apps

    During this workshop, we will be using a demo Hybrid app. You can use this app post the workshop to explore more opportunities and practice your new skillset.By the end of this workshop, you will have written your (first) hybrid cross-platform automation script for Android and iOS hybrid mobile applications.

  • Anna Bauza
    keyboard_arrow_down

    Anna Bauza - Challenges in testing social networks.

    20 Mins
    Talk
    Advanced

    Many modern mobile applications are facing the same challenges when it comes to automated continuous integration UI tests. Tests are often running in parallel, logging in the same user. It makes tests unstable and unpredictable because one test can conflict with another. There are also event-based test cases where certain things expect to appear when other users interact. Social network applications are full of that scenarios. For example, it expects to see an unread messages badge when other users are sending messages. Social networks are often very crowded. It is important to test UI in case of very intense communication between server and client. For example, receiving thousands of messages at a special event. It is a very common solution to register with an associated account like Facebook or Google, however, it is challenging to write automated tests, because it requires creating new associated accounts.  We will show how we have addressed those challenges at The World's Online Festival. We believe other organizations can find our solutions useful.

  • Anton Angelov
    keyboard_arrow_down

    Anton Angelov - Assessment System for Evaluating Test Automation Solutions

    Anton Angelov
    Anton Angelov
    CTO
    Automate The Planet
    schedule 1 month ago
    Sold Out!
    20 Mins
    Experience Report
    Intermediate

    What is the primary task of many software engineers in test nowadays? It is to develop or find the right test automation solution for achieving fast, reliable, easy to understand and maintain tests that can be integrated into CI/CD pipelines. Anton Angelov will share some approaches that he regularly uses with clients during consulting to achieve these goals and discuss many common mistakes. One of the many errors is that the engineers are not doing proper research and setting the right requirements upfront, which leads to losing time developing their own solutions and maintaining lots of problematic tests later. Learn some fundamental assessment criteria for automation testing designs, why they are essential - study by lots of examples how to apply them in practice.

    We will discuss acquiring the proper requirements for the searched solution and how to conduct the research the right way. Afterward, the presented assessment framework can help you to find the right test automation solution.

  • Anton Angelov
    keyboard_arrow_down

    Anton Angelov - Cutting Edge Technologies in Automated Testing

    Anton Angelov
    Anton Angelov
    CTO
    Automate The Planet
    schedule 1 month ago
    Sold Out!
    20 Mins
    Demonstration
    Intermediate

    We will discuss many of the most modern solutions for visualizing test results and executing tests in Docker containers. Also, we will review many framework integrations with cloud cognitive services which use machine learning ML and artificial intelligence AI. Finally, we will review how to use them for testing hard otherwise functionalities such as PDFs or videos. The demos will include testing of voice, optical character recognition OCR, and others.

  • Atmaram Naik
    keyboard_arrow_down

    Atmaram Naik - Appium Flutter Driver - A Use Case Demo

    45 Mins
    Demonstration
    Intermediate

    Flutter community already has great package flutter_driver, yet in some scenarios using flutter_driver could be limiting, there comes flutter_appiun_driver with all power of appium along with support for flutter. I will demonstrate a simple use case with modified counter app (the modification is to accommodate use case). The session will be mostly centred around demonstration of use-case, code, when to use it with the help of a small, compact and full-fledged automation suit. 

    Github Repo Link

  • Sai Krishna
    keyboard_arrow_down

    Sai Krishna / Srinivasan Sekar - Build your own Appium plugin

    45 Mins
    Case Study
    Beginner

    What if you had to support a custom locator in your project and with Appium 1.0 it was not possible which would led us to maintain a fork and make our required changes, which in turns in a overkill  as we had to always keep up with upstream. 

    With Appium 2.0 architecture we can create plugins for our special needs. At this talk, we are going to talk about Appium 2.0 architecture, how to create custom plugins and what other breaking changes we brought in Appium 2.0. 

     

     

  • Daniel Paulus
    keyboard_arrow_down

    Daniel Paulus - Using open source to easily record audio, video and run Appium for iOS on Linux

    45 Mins
    Talk
    Beginner

    Setting up Mac OS X for remote use or as a CI pipeline is never a great experience. Usually we all love using Linux for these purposes, sadly iOS devices don't work on Linux.. or do they? Wouldn't it be cool to just execute Appium servers for iOS devices on Linux machines in Docker containers?  Turns out you can absolutely do that and this talk explains how.

    I have created two open source tools for doing cool things with Appium for iOS. https://github.com/danielpaulus/quicktime_video_hack lets you record devices' audio output, or audio and video on Mac and Linux. Using gstreamer under the hood, it is possible to live transcode and stream the output as well. 

    Secondly, with https://github.com/danielpaulus/go-ios you can use Appium iOS on Linux.  

  • Justin Ison
    keyboard_arrow_down

    Justin Ison - It's the 20's! So why are we still testing like it's yesterday?

    Justin Ison
    Justin Ison
    Sr. Software Engineer
    Applitools
    schedule 1 week ago
    Sold Out!
    20 Mins
    Demonstration
    Beginner

    Mobile test automation has come a long way in the past several years. Both Apple and Google have matured their respective frameworks. We have set industry standards in mobile development now that didn't exist just a few years ago. So why are we still testing the same way we always have? Such as executing our tests suites on many devices, OS's, and resolutions our app supports.

    What if I told you that you didn't need to do this anymore but instead run once on one device/simulator and get all the coverage across different devices your app supports? Well, I have good news for you! The Ultra-Fast Grid for Native Mobile Apps! This next-generation automation grid will significantly speed up your test coverage, reduce execution time, reduce the code you need to write and maintain, and also visually validate your application using Applitools advanced AI algorithms. 

    In this talk, I'll go over where we've come from and the pain points in traditional UI automation. And how this next-generation automation grid works with Appium and the ease of implementing this solution into your test framework.

     

     

help