Test Automation Reporting based on AI with ReportPortal and Selenium
Teams usually spend time to build their own reporting system, and it's a time-consuming task, because of that we need to find a solution to give us the ability to view rich reports with differents widgets and smart analysis based on Machine Learning.
Report Portal – open-sourced tool for test automation reporting. , it’s especially indispensable for test automation in distributed systems, for test automation with a large number of test cases, the same as for small teams.
Report Portal gives it out of the box. Full-featured reporting management tool with custom dashboards, widgets, metrics, customizable defect type, history and smart analysis based on Machine Learning.
It can give you not only one place for all your test automation results, but also reduce the effort of the team for result analysis.
You will get introduced to the features review, tech specifics, comparison with competitors, benefits, and advantages, how it could integrate with Selenium WebDriver in your project.
ReportPortal setup use Docker and docker-compose file and this is the simple way to install it and you can customize and build your docker-compose file. A MongoDB database included into the compose to save your reports and data.
Steps to running ReportPortal:
- Install Docker
- Run ReportPortal using docker-compse
- Open ReportPortal
- Integrate with test framework
Limitations of ReportPortal
ReportPortal now supports and integrate with different test frameworks such as:
- JUnit 4 and 5
- VS Test
ReportPortal currently not supporting Espresso with Android and limit support for XCUITest.
The role of AI (ML) with ReportPortal
ReportPortal using AI in the following feature:
Collaborative analysis ReportPortal also gives us the ability to collaboratively analyze the test automation results. Particular test cases can be associated with a product bug, an automation issue, a system issue or can be submitted as an issue ticket directly from the execution result.
Historical data of test execution ReportPortal provides enhanced capabilities along with auto-results analysis by leveraging historical data of test execution.
Automatic Analysis With each execution ReportPortal automatically figures out the root cause of a fail. As a result of this analysis ReportPortal is marking a test result with a flag. Engineers will be alerted about this issue to provide the further analysis: if it has been resolved already or which test results require actual human analysis.
In our presentation we will demonstrate how to integrate ReportPortal with Selenium WebDriver , TestNG and Java in a real project and check the results with ReportPortal, how the report analysis works, how to build dashboard and how to integrate it with our bug tracking system
Outline/Structure of the Demonstration
- Why reporting is important?
- Introduction to AI and Test Automation
- Presenting ReportPortal
- ReportPortal Setup with Docker
- Prepare our dashboard, widgets, and metrics for our tests.
- The Integration between Report Portal, TestNG and Selenium WebDriver
- View the test results with the defect types and root causes.
- Reduce the effort of the team for result analysis using Machine Learning
- getting started with a full-featured reporting management tool for Selenium WebDriver with custom dashboards, widgets, metrics, customizable defect types.
Everyone who interested in AI and reporting for Test Automation
Prerequisites for Attendees
Basic understanding of Selenium WebDriver, Java , and TestNG