Combining human intelligence with seleium technology - Getting best of both the worlds, crowd/out sourced human testing and selenium technology.

What if you can get best of both outsourced/crowd sourced and most advanced selenium technology? There has been lots of improvement in the world of testing from rather independent directions. While selenium community has been doing extremely well at improving the automation technology, there are hundreds of thousands of testers doing testing through crowd sourced testing or outsourced testing.

What if we can seamlessly combine both selenium technology with the crowd sourced testing. While selenium recorders are good at repeating the mundane tasks, they are terrible at ignoring harmless ui changes, crowd sourced testers can compensate the dumbness of recorders, pdiff can indeed detect the changes what even humans can miss. If we combine these three while advancing selenium technology, ui testing can be taken to the next stage.

If we can advance selenium recorders and make it a handy tool for testers, we can improve the efficiency and decrease the costs to significant extent.

 
19 favorite thumb_down thumb_up 6 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

1) What are the limitations of using either selenium based recorder or selenium based automation tests alone.

2) How do we combine selenium recorder with crowd sourced testing to achieve results better than a combination of manual testers and best ui automation team

3) How can we integrate with browser stack or pdiff

Learning Outcome

People will learn that integrating selenium technology with crowd sourced testing can improve the results with same  money and effort. People would also learn how to do it and what are the current ways of doing it. 

Target Audience

Developers or testers

schedule Submitted 3 years ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • Santhosh Kumar Vangapelli
    By Santhosh Kumar Vangapelli  ~  3 years ago
    reply Reply

    Can we edit the proposal? I want to improve it by adding more details to process section.

    • Naresh Jain
      By Naresh Jain  ~  3 years ago
      reply Reply

      Yes you can.

  • Santhosh Kumar
    By Santhosh Kumar  ~  3 years ago
    reply Reply

    Yes I will make it 30 minuteds and try to cover the important things in 30 minutes. Does my chance of being able to present depend on how long my presentation is?

    • Marcus Merrell
      By Marcus Merrell  ~  3 years ago
      reply Reply

      No, all of the talks will be the same length. I think the previous comment was to encourage you to approach your preparation differently. Thanks for the submission!

      MM

  • Pravin Parodwad
    By Pravin Parodwad  ~  3 years ago
    reply Reply

    This is a great forum for Test Engineers.

    Thanks.

  • Dave Haeffner
    By Dave Haeffner  ~  3 years ago
    reply Reply

    20 minutes feels a bit rushed for what you're trying to accomplish. Especially if you need to educate the audience on these various approaches, their pros and cons, and provide examples. I think this would work better as a 45 minute talk if you're thorough.

    I would also like to see more detail put into the process section, to help illustrate your thought process on how you're going to convey this information to the audience.

    Also, you mentioned a couple of vendors in your abstract. The committee is sensitive to vendor pitches in talks that are meant to be informational. Assuming you're not actually pitching a specific vendor, and instead, giving a talk that speaks to creating a value chain through the use of multiple vendors -- you're on the right track. The more detail you can provide in your submission, the better your odds.

     

    Cheers,

    Dave H


  • Anand Bagmar
    Anand Bagmar
    Director - Quality
    Vuclip Inc.
    schedule 3 years ago
    Sold Out!
    45 mins
    Experience Report
    Advanced

    Page-Object pattern is very commonly used when implementing Automation frameworks. However, as the scale of the framework grows, there is a limitation on how much reusability really happens. It inherently becomes very difficult to separate the test intent from the business domain.

    I want to talk about this problem, and the solution I have been using - Business Layer - Page - Object pattern, which has helped me keep my code DRY.

  • Liked dima kovalenko
    keyboard_arrow_down

    dima kovalenko - Scaling and managing Selenium Grid

    45 mins
    Talk
    Intermediate

    Managing the Selenium Grid can be very difficult, especially as you scale it up.  This session will demonstrate how we were able to scale the Selenium Grid with multiple operating systems, in multiple data centers across many continents. With the use of Selenium Grid Extras, and open source project, we were able to get much better control of individual nodes, manage WebDriver versions and much more. 

  • Liked Naresh Jain
    keyboard_arrow_down

    Naresh Jain - Selenium DeTox for Achieving the Right Testing Pyramid

    Naresh Jain
    Naresh Jain
    Founder
    ConfEngine.com
    schedule 3 years ago
    Sold Out!
    45 mins
    Case Study
    Intermediate

    Our project was a classic example of Selenium gone wild! As our team embraced the test automation journey, we went crazy and implemented tons of Selenium tests, one for every permutation possible. Soon we realized our feedback cycles were delayed. Our builds were taking hours instead of minutes. And we had a set of complex, fragile tests, which resulted in a lot of false-negative scenarios and finger pointing.

    At this point, our team had realized that this is not the path forward. We decided to seriously look at our Selenium tests. We pretty much moved 80% of our Se tests to lower-layers (non-GUI based) tests. And now we have the right testing pyramid on our project.

    Join us, as we explain our journey (strategy, techniques, tools, mindset-change and approaches we took) through this transition.

  • Liked Tarun Lalwani
    keyboard_arrow_down

    Tarun Lalwani - Case Study - QTP/UFT to Selenium Migration - 80% reduced execution time

    45 mins
    Case Study
    Beginner

    QTP/UFT has been one of the leading Test Automation tool in the market. QTP supports a wide variety of technologies and with the recent article from Telerik - "5 hidden costs of Selenium". Is it really worth migrating to Selenium? If you think No, then think again. We recently migrated a client from QTP to Selenium, and the results was a 80% savings in execution time using one single machine. This case study will share the challenges we faced initially and how we managed a framework with high re-usability and execution

  • Liked Syed Khaja Habeebuddin
    keyboard_arrow_down

    Syed Khaja Habeebuddin - There is more treasure in Selenium nodes than in all the pirate's loot on Treasure Island.

    30 mins
    Talk
    Intermediate

    There is so much valuable data that Selenium Nodes writes into log file(s) when tests get executed on them. So much of this data is not mined for actionable intelligence.

    In this session, we will show you how operating system level metrics can be combined with data from Selenium nodes to result in rich actionable intelligence that will tremendously aid in the analysis of test failures, react to test execution flakiness, and to improve your automated test resiliency.

  • Liked Vinay Voruganti
    keyboard_arrow_down

    Vinay Voruganti - There are three things that matter in cross-browser test automation- locator, locator, locator – But how do you find the right one?

    30 mins
    Talk
    Intermediate

    Many a time the same locator in your automated script does not work well at all in all browsers/versions and operating systems or works but with flaky results in some browsers/versions. And then numerous hours are spent using a trial and error approach to either continue the hunt for a different locator that works across the board or build “if-browser/version-use-this-locator” kind of logic in your test scripts. 

    In this session, we will show you an approach that will help you eliminate so much pain and cost from your cross browser test automation. 

  • Liked Artem
    keyboard_arrow_down

    Artem - Allure framework - crystal clear reports for your selenium tests [in any language]

    Artem
    Artem
    Test Team Lead
    Yandex
    schedule 3 years ago
    Sold Out!
    30 mins
    Talk
    Beginner

    It's pretty cool to have selenium test results clear to everyone on the team. There are lots of frameworks in every language that aim to simplify test writing. But only few can provide sharp presentation of test execution output. Yandex team is working on Allure (https://github.com/allure-framework/allure-core/wiki) - an open-source framework designed to create crystal clear reports. Because of module structure it integrates easily with almost any testing tool, no matter which language you use. In my talk i will describe the basic principles and show how to integrate Allure reporting in your existing projects.

  • Liked Jim Evans
    keyboard_arrow_down

    Jim Evans - Embrace and Extend: How the Selenium Project Convinced the World's Largest Closed-Source Company to Participate

    Jim Evans
    Jim Evans
    Contributor
    Selenium Project
    schedule 3 years ago
    Sold Out!
    60 mins
    Talk
    Beginner

    Microsoft. Just the name of the company alone can send some open-source software activists into fits of apoplexy. From the days when executives of the company compared open-source software to "a virus", the company has been seen as incredibly hostile to open-source software. It is surprising how much has changed over the years.

    This is the story of how the Selenium project has managed its relationship with the software company, from the initial, tentative, often contentious and borderline hostile reaching out, to today's open engagement. The story is told through the prism of the Internet Explorer Driver project, with slight digressions to the .NET bindings and other Microsoft technology stacks. The journey is funny, sometimes frustrating, but always entertaining, and there may be a surprise announcement or two.

  • Liked Prashant Badgujar
    keyboard_arrow_down

    Prashant Badgujar - Leveraging selenium webdriver for ExtJS web application automation

    30 mins
    Talk
    Intermediate

    ExtJS is a web development framework used for developing next generation web based UIs. In ExtJs the object Id's are dynamic in nature, the object id's are not static everytime the object is rendered in UI. The challenge is to automate UI functionality when the objects are dynamic. Extjs does not recommend assigning static html-ids to objects for web application development.

    Would like to share our experience how selenium webdriver with java has been leveraged in retrieving those dynamic Id's at run-time and perform operations on those objects. A way for test automation on an web application which is developed using ExtJS framework which generates the dynamic html-ids.

  • Liked Shankar Garg
    keyboard_arrow_down

    Shankar Garg - Lets Learn Mobile Automation - Appium

    240 mins
    Workshop
    Intermediate

    This Mobile Testing workshop provides comprehensive and in-depth training on Mobile Test Automation tool - Appium. The Course starts with What is Appium, What are Appium Concepts, What are pre requisite for Android and iOS, Appium UI - Settings and then how to Create and Run your Test Cases.

    The course covers concepts as well as practical examples, case studies and exercises to better understand the world of Mobile Automation Tool – Appium for Android and iOS both.

    During this workshop you will build a solid foundation for Mobile Test Automation using Appium.

  • Liked Bhushan
    keyboard_arrow_down

    Bhushan - Empower Selenium to automate non-HTML UI components

    30 mins
    Demonstration
    Intermediate

    How do you user Selenium to test non-HTML UI components? By integrating Sikuli with Selenium we were able to solve this problem. In this demo, we would like to share our experience in increasing the automation scope to include non-HTML UI components with the help of Sikuli.

    Typically learning new tools to increase automation coverage is a challenge for Selenium users. Especially if those screens or components are not in the scope of Selenium locators (e.g. Non-HTML UI, Native Windows, Desktop Apps, SVG components etc.) Integration with Sikuli makes Selenium automation comprehensive. Sikuli complements Selenium capabilities, and integrates with Selenium seamlessly.

    We have empowered Selenium to identify non-HTML UI by extending Selenium locators (by.xpath, by.CSS) to identify the components with "by.image."

  • Liked Raghavendra Dingiribhattaru
    keyboard_arrow_down

    Raghavendra Dingiribhattaru - Achieving “Live” Traceability of Regression Tests to Functional Requirements, Change Requests and Issues without “Programming”

    30 mins
    Talk
    Intermediate

    One of the biggest challenges in the process of software regression test automation is to handle traceability. The main purpose of traceability is to establish bi-directional trace between functional requirements, change requests (enhancements or improvements), bug fixes, and regression tests. Manual maintaining of the traceability matrices can be real nightmare and time consuming.

    In this session, I will show you how Selenium-based automation framework can be integrated with Atlassian JIRA to achieve ‘live’ traceability of regression tests to requirements.

  • Liked L V Srinivasa Darapureddy
    keyboard_arrow_down

    L V Srinivasa Darapureddy - Analytics Driven Testing (ADT) w/ Selenium – Do we really need one more buzzword?

    30 mins
    Talk
    Intermediate

    We heard enough about Data-driven Testing, Business-driven development, and Test-driven development… The new buzzword in town is going to be ADT. So many tools and frameworks for regression test and cross-browser test automation give you pass/fail type results. However, for you to improve your web application’s software quality over time you need rich Analytics and Actionable Intelligence from your test automation framework or tool.

     In this session, we will show you how rich a number of reports generated within an automation framework or tool can help you compare your software’s performance in tests carried out across different browsers, software versions and at different points in time. 

    For example, you can drill down to a specific step where your test failed and look back to previous test runs to see when was the first time this step failed and if it failed when the same test was run against other browsers or previous versions of your software.

  • Liked Ashish Joshi
    keyboard_arrow_down

    Ashish Joshi - Stuck with Windows Dialog? Do it using Selenium Standalone Server and Java code, (Automation of Windows dialog (File Download, File Upload) )

    20 mins
    Lightning Talk
    Intermediate

    How do you automate windows dialogs using Selenium?

    Following 3 ways are commonly used to deal with Windows Dialogs: (Download, Upload Dialogs) 

    1) Autoit : Need to have autoit framework installed (Additional tool installation require)
    2) Robot Class in java: Not reliable
    3) Java code using HttpRequest (Does not always work, requires href attribute)

    Instead of above options, I found that we can simply use Selenium Server Standalone jar to work with Dialogs using simple java code.

    For any other Advanced and complex scenarios,

    we can use .Net framework to handle the dialogs or any windows based application.I have developed a Code (using .net framework) using which we can do Automation of Windows Components e.g. calulator, Notepad.

  • Liked Kamlesh Khatwad
    keyboard_arrow_down

    Kamlesh Khatwad - Get business analysts/experts to DIRECTLY author & automate tests - Selenium-based SIMPLE, SCRIPTLESS, COST-EFFECTIVE Test Automation platform - for diverse portfolio of enterprise applications

    Kamlesh Khatwad
    Kamlesh Khatwad
    Manager - Testing
    SunGard
    schedule 3 years ago
    Sold Out!
    45 mins
    Case Study
    Intermediate

    • Sharing our experience of rapidly transitioning automated testing of multiple technology-diverse enterprise applications to a Selenium-based solution framework (we call it SAFAL!!), thus enabling higher release velocity & lowered costs.
    • By enabling business analysts / domain experts to intuitively specify test scenarios/cases in an easy-to-use interface, powered by a powerful Selenium-based test automation architecture - we have moved to a higher velocity delivery at lower $ costs across a large portfolio of software applications.
    • Enabled a small group of technical/Selenium experts to support growing number of application testing in a scalable manner. Simplified test automation eliminate requirement of high-end skill set resources and enable all set of users (QA, Dev., BA, Product support, PS ) to take benefit of test automation and contribute in improving product quality by building automation script.
    • No need to spend significant efforts to build test automation framework at individual product level as Automation solution provides an in-built generic framework.

    Get a quick demo & understanding of SAFAL – that enables business analysts to rapidly generate automated tests.

    The benefits it has reaped are huge – but so were the challenges we had to overcome to get a globally diverse organization transitioned to such an approach!!

    Key Characteristics of SAFAL

     

    Characteristics

    Description

    EASY & SIMPLE

    Simplified Test Automation

    (3 Steps Test Automation -> 1. Test Data 2.Object Identification 3. Test flow.)

    Spreadsheet to define BOTH test scenarios and business processes.

    MAINTENANCE

    Easy & Minimal efforts require for script maintenance for on going releases.

    REUSABILITY

    Script can be reused across environments(Dev, QA, UAT, Per-Production, Client )

    PORTABILITY

    Functional flow and Test data is abstracted.
    Script can be easily port from one environment to other environment

    SKILL SET

    No need for technical skills to create and/or read automated test scenarios or business processes (abstraction).

    Users (BA, Functional Tester, and Developer) can create automated keyword scripts using MS excel or the Script Editor once familiar with the keyword repository.

    CUSTOMIZATION IN TOOL

    Its in-house solution so any new request for enhancement can be implemented quicker.

    REUSABILITY OF REPOSITROY

    Enrich keyword repository consist of 400+ keywords various technologies and exclusive 100 keywords for HTML5 controls/framework .

    TESTED & PROVEN

    Built a comprehensive regression pack for multiple products(8-10) in AM Segment.

    FASTER

    Multi-thread versions of SAFAL enable us to run multiple scripts concurrently, which play a vital role in reducing regression duration.

    SCRIPTLESS

    No tool expertise and proprietary scripting language skill set resource require. Member in product group could create automation script easily.

    Key Features of SAFAL

    Features

    Features

    Features

    Automation Scripting- Excel

    Language support for keyword creation- JAVA

    Integration with Defect Tracking tool (JIRA)

    Customized Result

     Template based approch

    Capture screen shot for Failure steps

    Database Testing

    Hybrid Framework

    Report Output type(PDF/EXCEL/HTML)

    Concurrent execution

    Web service Testing

    Script Editor

    Interface for Auto-Email

    Single solution

    (UI, Web Service & Database)

    Integration with BMT

    (Jenkins and Hudson)

    Scheduler

    Report Comparison

    (Excel, PDF, TEXT, CSV)

    Technology Plug-ins

    (Mainframe/Swing/WPF/Flex/

    NexaWeb/Web Service)

    Object Map

    Cross Browser Certification

    (IE, Chrome, Firefox)

    Integration with Test Management Tool

    (Test Link)

    Debug

    HTML 5.0 Support

    Version control

  • 45 mins
    Talk
    Intermediate

    Gone are the days where digital channels were few, predominantly web with one or two browsers. The scenario is different today, not only do we have multiple channels like web and mobile (iOS & Android), we also have different browsers and localization settings. In this scenario, the traditional testing models are rendered inefficient and at times even ineffective.

    Having worked with Global brands and delivered Omni-Channel Digital Testing for them over the years, we have developed a framework that makes this testing efficient and assures effectiveness.
    Valtech’s Digital Testing Framework uses PageObject-Design pattern for more maintainability, localization, environment compatibility (Selenium+Appium APIs), easy execution, user-friendly reporting and integration with CI and seamlessly aligns with Agile Methodology.

    If would like to know more, do attend our demo at the Selenium Conference 2014.

     

  • Liked Shankar Garg
    keyboard_arrow_down

    Shankar Garg - Best of Three Worlds: BDD(Cucumber-JVM),Selenium(Page-Obects) and Mobile Automation(Appium)

    30 mins
    Demonstration
    Intermediate

    Appium's use for Mobile Automation has been growing rapidly in recent times and everyone who has used Appium has certainly fallen in love with it. Appium has made Mobile Test Automation so easy for both android and iOS platforms. I believe most people who have used Appium will agree with me till this point.

    But as the testing teams adopt Appium in Real life projects and they start implementing Appium for hundreds of tests that's when teams start to feel the heat. Appium in itself is sufficient to Automate the Mobile Apps but how to integrate Appium in the Test Framework, is the questions most testing teams realize late.

    We all know benefits and power of Cucumber, Page objects and Appium individually. To create a Robust and powerful Test Framework we thought of combining all three, thus the resulting framework can cater to the needs of different participants in SDLC.

    So the Objective of this session is to demonstrate how we can use Best of all three words and can create an Awesome Test Framework using Cucumber-JVM, Selenium Page Objects and Appium. 

     

  • Liked Vijay Kumar K
    keyboard_arrow_down

    Vijay Kumar K - I18N /L10N testing using Selenium

    20 mins
    Talk
    Beginner

    Internationalization(I18N), Localization(L10N) testing helps to ensure the application is instinctive, explicable and correct for the people who are accessing from different geographical locations and from various languages.

    We are prenting the session on How selenium helps in Portal content verification, live language translation during chat and mobile language translation.

  • Liked Kartihkeyan
    keyboard_arrow_down

    Kartihkeyan - Alien Driven Testing with Arquillian Graphene

    Kartihkeyan
    Kartihkeyan
    MTS
    Owler
    schedule 3 years ago
    Sold Out!
    45 mins
    Demonstration
    Intermediate

     Arquillian LogoAutomating a massive application with tons of user stories obviously needs more time and resource as we need to concentrate much on maintainability. Still it’s being a big challenge for QA engineers. This session will discuss how Arquillian Graphene (a dialect of Selenium WebDriver) really helpful for developers to lower the effort needed to build a reliable, robust and maintainable functional test suites in an Alien way!

  • Liked Amit Rawat
    keyboard_arrow_down

    Amit Rawat - Testing of Responsive Web Applications using Appium and WebDriver API

    60 mins
    Tutorial
    Intermediate

    All the modern web applications uses HTML5 and RWD (Responsive Web Design) to have an optimal viewing experience across a wide range of devices (from mobile phones to desktop computer monitors). Automating these applications and running the scripts on different devices is a bigger challenge.

    How Appium and Selenium WebDriver API can be used to automate these applications and can also address all the challenges like:

    1. Running the Webdriver scripts on iOS Safari and Android Chrome with minimal changes to the scripts.

    2. Working with the Responsive web elements and validating their size and layout on different devices and viewports.

    3. Automating complex gestures like Swipe, Tap, Pull to refresh etc.

    4. Working with HTML5 based geo-locations and simulating the Mobile network bandwidth and latency using Browsermob