From Pyramids to hourglass - New approach for digital apps testing
About the session: One of the first things you learn when you enter the quality assurance space is the famous triangle breakdown with Unit test at the bottom, Acceptance Tests based on API on top of that (in some places this layer is integration tests but the idea is the same) User Interface (UI) Tests at the very top. This Pyramid has been the main principle on how to approach testing activities (mainly automation) for the past two decades. Flash forward to the present, and we have all been taking part in the "Digital Transformation" happening all over the industry. Mobile Native applications, as well as web applications, take part in almost every activity we do throughout the day, so businesses are building their strategy and shifting resources to deliver applications, while maintaining cost and market share. So what changed? Users are no longer static, they are interacting with apps while on the train heading to the office, while waiting for a flight at the airport, or drinking coffee before their next meeting – these “interactions” are done mostly the user is on-the-go with mobile device. Additionally, applications can now take advantage of sensors within the device to provide a better user experience. The environment where our end users use our application has significant impact on the functionality and performance of our application. At the end of the day, we call this "quality". In the last year we developed a new approach for digital application testing – The “Hourglass” – This new approach expands the well-known "Pyramid" and updates it to the digital era. The client side is now richer and contains many components that impact quality of application. It redefined the definition of coverage. At the top of the pyramid we added 2 additional triangles (to give the hourglass shape). The first triangle is devices – what devices should we test? How we should approach the changes that happens in the device market? The second triangle is environment - where will our end user interact with the application? We've leveraged our investment in automation to get real digital coverage, which helps you reach high quality applications.
Outline/structure of the Session
1. Digital - Market trend and how it impact web and mobile apps. 2. Testing Pyramid - Go over the testing pyramid and go over each layer and explain why this approach worked and what are the cons and pros of each layer. 3. The "Hourglass" - Present the new concept and explain why they are needed. 4. Provide examples on cases that this approached helped and where lack of those tests was translated to low quality app 5. Best practices - How to take the "hourglass" approach and embed it on your testing strategy. Note: This is a pure best practice session and we will not discuss any commercial solution. The best practices are going to be based on Appium and solution.
Attendees will: 1. Get better understanding on what is coverage components for mobile and web applications. Hoe to calculate and define the coverage. 2. Best practices on how to update test plans and automation tests to extend coverage and align it to digital.
Testers, QA Eng, Automation Eng, Developers, Managers