Introducing Selenium Reporting Framework - SRF

The main feature of SRF is reporting Selenium Test Results. Selenium Testers are mainly focussed on reporting tools and SRF is going to be the Next generation Report tool for Selenium. I introduce SRF, Selenium Reporting Framework which stands up on all the available frameworks in market [yet to be released]. Will be updating the with report screeenshots sooner here. 

Attached here is the initial SRF rough draft [20%]. Stay Tuned!! 

 
32 favorite thumb_down thumb_up 2 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  • Overview
  • Selenuim Reporting Framework Features & Techniques
  • demo
  • Conclusion

Learning Outcome

To implement SRF, Selenium Reporting Framework as a standard tool for selenium report generation.

Target Audience

QA

schedule Submitted 3 years ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • Prashanth Sams
    By Prashanth Sams  ~  3 years ago
    reply Reply

    Hi Dave,

    I've done some initial steps on selenium reports; I call it as SRF, Selenium Report Framework. Since, I am from QA background, I brought up my own ideas to implement a good report especially for selenium. Currently the work done is 10 - 20%  

    I will be adding Bar Chart with this [If possible I will add more charts and will make the user to pick the desired chart]; Currently, I'm working to get the methods that fail and pass. I would like to contribute this work to selenium as an opensource. [It would be really helpful if any Selenium/Google developers to take my effort, contribute and excel the work]

     The main objective of the Framework is to give better reports with detailed summary.  Please let me know your thoughts. Looking forward!!

    (PS: I read your articles too)

     

    Thank you!!!   :)

  • Dave Haeffner
    By Dave Haeffner  ~  3 years ago
    reply Reply

    Test reporting is one of the most valuable pieces of the testing puzzle and something that has yet to be solved in a universal way. Is that what you're proposing with SRF? If so, that sounds fantastic!

    Will this library be open source?

    And what do you mean by "stands up on all the available frameworks in market"? Are you referring to proprietary frameworks? Open source frameworks? Or the supported language bindings?

    If closed and/or open frameworks, which ones?


  • Anand Bagmar
    Anand Bagmar
    Director - Quality
    Vuclip Inc.
    schedule 3 years ago
    Sold Out!
    45 mins
    Experience Report
    Advanced

    Page-Object pattern is very commonly used when implementing Automation frameworks. However, as the scale of the framework grows, there is a limitation on how much reusability really happens. It inherently becomes very difficult to separate the test intent from the business domain.

    I want to talk about this problem, and the solution I have been using - Business Layer - Page - Object pattern, which has helped me keep my code DRY.

  • Liked dima kovalenko
    keyboard_arrow_down

    dima kovalenko - Scaling and managing Selenium Grid

    45 mins
    Talk
    Intermediate

    Managing the Selenium Grid can be very difficult, especially as you scale it up.  This session will demonstrate how we were able to scale the Selenium Grid with multiple operating systems, in multiple data centers across many continents. With the use of Selenium Grid Extras, and open source project, we were able to get much better control of individual nodes, manage WebDriver versions and much more. 

  • Liked Naresh Jain
    keyboard_arrow_down

    Naresh Jain - Selenium DeTox for Achieving the Right Testing Pyramid

    Naresh Jain
    Naresh Jain
    Founder
    ConfEngine.com
    schedule 3 years ago
    Sold Out!
    45 mins
    Case Study
    Intermediate

    Our project was a classic example of Selenium gone wild! As our team embraced the test automation journey, we went crazy and implemented tons of Selenium tests, one for every permutation possible. Soon we realized our feedback cycles were delayed. Our builds were taking hours instead of minutes. And we had a set of complex, fragile tests, which resulted in a lot of false-negative scenarios and finger pointing.

    At this point, our team had realized that this is not the path forward. We decided to seriously look at our Selenium tests. We pretty much moved 80% of our Se tests to lower-layers (non-GUI based) tests. And now we have the right testing pyramid on our project.

    Join us, as we explain our journey (strategy, techniques, tools, mindset-change and approaches we took) through this transition.

  • Liked Tarun Lalwani
    keyboard_arrow_down

    Tarun Lalwani - Case Study - QTP/UFT to Selenium Migration - 80% reduced execution time

    45 mins
    Case Study
    Beginner

    QTP/UFT has been one of the leading Test Automation tool in the market. QTP supports a wide variety of technologies and with the recent article from Telerik - "5 hidden costs of Selenium". Is it really worth migrating to Selenium? If you think No, then think again. We recently migrated a client from QTP to Selenium, and the results was a 80% savings in execution time using one single machine. This case study will share the challenges we faced initially and how we managed a framework with high re-usability and execution

  • Liked Syed Khaja Habeebuddin
    keyboard_arrow_down

    Syed Khaja Habeebuddin - There is more treasure in Selenium nodes than in all the pirate's loot on Treasure Island.

    30 mins
    Talk
    Intermediate

    There is so much valuable data that Selenium Nodes writes into log file(s) when tests get executed on them. So much of this data is not mined for actionable intelligence.

    In this session, we will show you how operating system level metrics can be combined with data from Selenium nodes to result in rich actionable intelligence that will tremendously aid in the analysis of test failures, react to test execution flakiness, and to improve your automated test resiliency.

  • Liked Artem
    keyboard_arrow_down

    Artem - Allure framework - crystal clear reports for your selenium tests [in any language]

    Artem
    Artem
    Test Team Lead
    Yandex
    schedule 3 years ago
    Sold Out!
    30 mins
    Talk
    Beginner

    It's pretty cool to have selenium test results clear to everyone on the team. There are lots of frameworks in every language that aim to simplify test writing. But only few can provide sharp presentation of test execution output. Yandex team is working on Allure (https://github.com/allure-framework/allure-core/wiki) - an open-source framework designed to create crystal clear reports. Because of module structure it integrates easily with almost any testing tool, no matter which language you use. In my talk i will describe the basic principles and show how to integrate Allure reporting in your existing projects.

  • Liked Naresha K
    keyboard_arrow_down

    Naresha K - Better Selenium Tests with Geb

    Naresha K
    Naresha K
    Agile Coach
    AgileFAQs Tech
    schedule 3 years ago
    Sold Out!
    60 mins
    Tutorial
    Beginner

    Selenium tests can quickly grow in size and could become difficult to maintain, unless adhered to DRY principles to the extreme. Geb is built on top of Selenium WebDriver, which brings in the expressive power of groovy to WebDriver API. Geb can be used for all browser automation tasks that can be achieved with WebDriver. This talk will show how Geb can help us to write concise tests that are highly readable. 

    Prior knowledge of Groovy is NOT essential to get started with Geb, however would be helpful in advanced use cases.

  • Liked Sushant Choudhary
    keyboard_arrow_down

    Sushant Choudhary - How we trained our dragon built on enterprise practices to adopt and fail fast with OSS.

    30 mins
    Talk
    Intermediate

    Traditionally companies built over enterprise infrastructure and practices have been hesistant to adopt new practices,framework or tools especially one which can change with a single commit on github. So was the case when mobile portfolio of one of the largest airline was developed and tested in an agile way and striving for continous delivery.

    This is a story of remote-enablement and developing a sense of confidence in the drgaon to go open source and base its complete testing infrastructure on OSS.Today their Mobile testing with its own challenges posed by H/W,OS and Design guidelines is under the OSS umbrella with practices like BDD and compliance with test pyramid adopted with a scalable automation framework built on Ruby,Cucumber,Watir Webdriver and Calabash.

  • Liked Jim Evans
    keyboard_arrow_down

    Jim Evans - Embrace and Extend: How the Selenium Project Convinced the World's Largest Closed-Source Company to Participate

    Jim Evans
    Jim Evans
    Contributor
    Selenium Project
    schedule 3 years ago
    Sold Out!
    60 mins
    Talk
    Beginner

    Microsoft. Just the name of the company alone can send some open-source software activists into fits of apoplexy. From the days when executives of the company compared open-source software to "a virus", the company has been seen as incredibly hostile to open-source software. It is surprising how much has changed over the years.

    This is the story of how the Selenium project has managed its relationship with the software company, from the initial, tentative, often contentious and borderline hostile reaching out, to today's open engagement. The story is told through the prism of the Internet Explorer Driver project, with slight digressions to the .NET bindings and other Microsoft technology stacks. The journey is funny, sometimes frustrating, but always entertaining, and there may be a surprise announcement or two.

  • Liked Santhosh Kumar
    keyboard_arrow_down

    Santhosh Kumar - Combining human intelligence with seleium technology - Getting best of both the worlds, crowd/out sourced human testing and selenium technology.

    Santhosh Kumar
    Santhosh Kumar
    CEO
    scaleqa
    schedule 3 years ago
    Sold Out!
    45 mins
    Talk
    Beginner

    What if you can get best of both outsourced/crowd sourced and most advanced selenium technology? There has been lots of improvement in the world of testing from rather independent directions. While selenium community has been doing extremely well at improving the automation technology, there are hundreds of thousands of testers doing testing through crowd sourced testing or outsourced testing.

    What if we can seamlessly combine both selenium technology with the crowd sourced testing. While selenium recorders are good at repeating the mundane tasks, they are terrible at ignoring harmless ui changes, crowd sourced testers can compensate the dumbness of recorders, pdiff can indeed detect the changes what even humans can miss. If we combine these three while advancing selenium technology, ui testing can be taken to the next stage.

    If we can advance selenium recorders and make it a handy tool for testers, we can improve the efficiency and decrease the costs to significant extent.

  • Liked Shankar Garg
    keyboard_arrow_down

    Shankar Garg - Lets Learn Mobile Automation - Appium

    240 mins
    Workshop
    Intermediate

    This Mobile Testing workshop provides comprehensive and in-depth training on Mobile Test Automation tool - Appium. The Course starts with What is Appium, What are Appium Concepts, What are pre requisite for Android and iOS, Appium UI - Settings and then how to Create and Run your Test Cases.

    The course covers concepts as well as practical examples, case studies and exercises to better understand the world of Mobile Automation Tool – Appium for Android and iOS both.

    During this workshop you will build a solid foundation for Mobile Test Automation using Appium.

  • Liked Bhushan
    keyboard_arrow_down

    Bhushan - Empower Selenium to automate non-HTML UI components

    30 mins
    Demonstration
    Intermediate

    How do you user Selenium to test non-HTML UI components? By integrating Sikuli with Selenium we were able to solve this problem. In this demo, we would like to share our experience in increasing the automation scope to include non-HTML UI components with the help of Sikuli.

    Typically learning new tools to increase automation coverage is a challenge for Selenium users. Especially if those screens or components are not in the scope of Selenium locators (e.g. Non-HTML UI, Native Windows, Desktop Apps, SVG components etc.) Integration with Sikuli makes Selenium automation comprehensive. Sikuli complements Selenium capabilities, and integrates with Selenium seamlessly.

    We have empowered Selenium to identify non-HTML UI by extending Selenium locators (by.xpath, by.CSS) to identify the components with "by.image."

  • Liked L V Srinivasa Darapureddy
    keyboard_arrow_down

    L V Srinivasa Darapureddy - Analytics Driven Testing (ADT) w/ Selenium – Do we really need one more buzzword?

    30 mins
    Talk
    Intermediate

    We heard enough about Data-driven Testing, Business-driven development, and Test-driven development… The new buzzword in town is going to be ADT. So many tools and frameworks for regression test and cross-browser test automation give you pass/fail type results. However, for you to improve your web application’s software quality over time you need rich Analytics and Actionable Intelligence from your test automation framework or tool.

     In this session, we will show you how rich a number of reports generated within an automation framework or tool can help you compare your software’s performance in tests carried out across different browsers, software versions and at different points in time. 

    For example, you can drill down to a specific step where your test failed and look back to previous test runs to see when was the first time this step failed and if it failed when the same test was run against other browsers or previous versions of your software.

  • Liked Vijay Kumar K
    keyboard_arrow_down

    Vijay Kumar K - I18N /L10N testing using Selenium

    20 mins
    Talk
    Beginner

    Internationalization(I18N), Localization(L10N) testing helps to ensure the application is instinctive, explicable and correct for the people who are accessing from different geographical locations and from various languages.

    We are prenting the session on How selenium helps in Portal content verification, live language translation during chat and mobile language translation.

  • Liked Ivan Shubin
    keyboard_arrow_down

    Ivan Shubin - Automated testing for responsive design on multi-screen devices using Galen Framework

    60 mins
    Demonstration
    Intermediate

    iPhone 3g, iPhone 4s, iPhone 5s, Samsung Galaxy, Samsung Galaxy Note, IE, Chrome, Firefox etc... Can you automate layout testing for these with one test?
    At eBay we had to refine our strategy for responsive design implementation. As part of that we wanted to build a stable automated test set that would cover layout testing on multiple screen resolutions. Now whenever there is a small change to a CSS that breaks the design on some specific resolutions - we notice it right away. Do you also have to test your website on different devices? Would you like to automate that and save time? It's easy as 1, 2, 3: write your Selenium test (with a bit of magic of Galen), include it in your continuous integration environment (e.g. Jenkins), get feedback with detailed reports.
    In this presentation we would like to show you how to build a stable solution for testing responsive layout with an open sourced tool Galen Framework. We'll introduce you to Test Driven Development for Responsive Design. We'll show you how to execute tests in Selenium Grid to cover the browser compatibility testing and how we adapted the responsive layout testing at eBay.

  • Liked Santiago S Ordoñez
    keyboard_arrow_down

    Santiago S Ordoñez - Enter JS Unit testing: Cross Browser, reliable, fast and developer friendly

    45 mins
    Talk
    Intermediate

    Ever been frustrated by slow, unreliable Selenium tests that won't work in all browsers? Chances are you're doing it wrong.

    Selenium is an excellent tool, but as all tools, should only be used for the right purpose.

    In this talk I want to walk the audience through current approaches, frameworks, tools and the advantages or using Javascript Unit Tests to get extensive client-side coverage, reliable and millisecond-speed results.

    Leverage client-side unit testing as a complement to a more focussed and stable set of functional Selenium tests. Use the power of Sauce Labs' Javascript API to run these across all browsers with very little effort.

     

     

  • Liked Bernard Kobos
    keyboard_arrow_down

    Bernard Kobos - Mobile testing done right with Appium

    45 mins
    Talk
    Beginner

    Web and mobile UI testing has never been so simple. All the tools that you need to create a solid maintainable app are at your fingertips. Big and small companies are already using it heavily to provide their users the best possible experience. The new kid on the block is the Appium project, which recently turned into version 1.0. It opens the gates to serious mobile testing automation for which many developers and companies were waiting for.During this talk I will tell you why Appium - a completely free open source project - was created and what are its connotations with Selenium. Importance of mobile testing is not something you can neglect anymore. With a wide range of technologies (such as hybrid, web, native), which can be used to create a mobile user experience, comes a great challenge for automation tools developers.
     
    If you're serious about your mobile software you have to do continuous integration for it.  I'll show how easy it is to set it up and run an example test with only few lines of code.
     
    Furthermore, I'll show you some experimental applications of this technology that is being currently researched and that might shape the near future.

  • Liked Kartihkeyan
    keyboard_arrow_down

    Kartihkeyan - Alien Driven Testing with Arquillian Graphene

    Kartihkeyan
    Kartihkeyan
    MTS
    Owler
    schedule 3 years ago
    Sold Out!
    45 mins
    Demonstration
    Intermediate

     Arquillian LogoAutomating a massive application with tons of user stories obviously needs more time and resource as we need to concentrate much on maintainability. Still it’s being a big challenge for QA engineers. This session will discuss how Arquillian Graphene (a dialect of Selenium WebDriver) really helpful for developers to lower the effort needed to build a reliable, robust and maintainable functional test suites in an Alien way!

  • Liked Amit Rawat
    keyboard_arrow_down

    Amit Rawat / Rajeev - Testing of Responsive Web Applications using Appium and WebDriver API

    60 mins
    Tutorial
    Intermediate

    All the modern web applications uses HTML5 and RWD (Responsive Web Design) to have an optimal viewing experience across a wide range of devices (from mobile phones to desktop computer monitors). Automating these applications and running the scripts on different devices is a bigger challenge.

    How Appium and Selenium WebDriver API can be used to automate these applications and can also address all the challenges like:

    1. Running the Webdriver scripts on iOS Safari and Android Chrome with minimal changes to the scripts.

    2. Working with the Responsive web elements and validating their size and layout on different devices and viewports.

    3. Automating complex gestures like Swipe, Tap, Pull to refresh etc.

    4. Working with HTML5 based geo-locations and simulating the Mobile network bandwidth and latency using Browsermob

     

  • Liked Anand Bagmar
    keyboard_arrow_down

    Anand Bagmar - Validate reporting to Web Analytics tools using Selenium

    Anand Bagmar
    Anand Bagmar
    Director - Quality
    Vuclip Inc.
    schedule 3 years ago
    Sold Out!
    60 mins
    Demonstration
    Advanced

    Learn what is Web Analytics, its significance and how to test it manually and eventually automate its validation using WAAT.