Test automation integration with CI/CD pipeline is the need of the hour in today's testing world. Test automation integration with CI/CD will initiate, monitor, & visualize test automation executions and yield automated feedback for the Software Development Lifecycle at every stage. This allows your team to move fast while keeping high-quality standards that can be checked automatically. 

GitLab CI/CD provides out-of-the-box integration for Selenium & WebdriverIO for end-to-end testing. GitLab CI/CD uses selenium/standalone-chrome & selenium/standalone-firefox docker images to run selenium/wdio tests.GitLab CI/CD makes it a breeze to link these images to our confidence-check jobs using the service property, making the Selenium server available under a hostname based on the image name. Apart from UI based tests, we can integrate API related tests(SuperTest tool) as well with GitLab CI/CD

In this demo, we will see how to integrate both UI-based & API-based test integration with the GitLab CI/CD pipeline. We will also see how to persist test artifacts like snapshots, results, and downloads using GitLab CI/CD for failure analysis.

For present day needs, it is pretty difficult to scale/maintain a system built in "monolithic" way. Micro-services, is an architectural style, a development style of building enterprise application comprising of small, independent, customer focused, scalable services. Docker & Kubernetes are kind of enablers for microservices architecture. At this juncture, test automation is a very important requirement for a successful, scalable microservices architectured applications.

How do you fasten the process of adding right test cases for microservice architectured applications & automating them? Anwser is, 1. invest less time on repeatable activities (like failed tests debugging & root cause analysis- these should be automated). 2. Get Continuous data which can result in adaptable actions which covers business value. In this talk, we will explore about strategies to test a distributed microservice architectured application by analyzing API flows using trace IDs and build test strategies based on the coverage & unexplored areas. We will effectively make use of both Selenium Logs & microservices logs to develop a coherence between them by time series approach, Trace IDs & span ids. This will identify if there are any automation failures corresponding functional issues via infrastructure/framework which we developed.

We will also talk about challenges faced to test, automate & maintain a high resilient test automation framework. We will look into tools & infrastructure(Zipkin, ELK etc) that are required to quickly test & certify a build and to achieve continuous intelligence in testing.

In contemporary test automation world, we are running 1000's tests every day. Even though most of our test cases are reliable and stable, debugging failures will consume lot of time, if not handled appropriately. This is an effort to reduce the analysis of failures and come up with probable root cause for each and every failure.

In this talk, we will explore all the approaches we have taken to drastically reduce the time to debug the failures & let you concentrate more on adding new tests. We will also talk about the approaches which could not yield results for us initially & why. We will look into building a failures' dashboard, driven by pattern based classification of logs(both server & automation tool) with reporting.