No man ever made a great discovery without the exercise of the imagination.”-George Henry Lewes

The unknowns can often cause more damage than the known. We often tend to overlook or underestimate the “What If” scenarios in our testing life cycle. This is often due to the time sensitive deadlines set to develop, test and deliver a product.  

Testing is an applied practice in industry but lacks research. It is imperative to incorporate all variations of testing not just as a practice but as a culture. In the end you wouldn’t want an average working product. This in turn requires a considerable amount of time, resources and effort. To establish what skipped your sanity and regression tests, it might be a plus for you to have a placeholder for research and intuitive validations. 

Exploratory Testing [ET] is simultaneous learning, test design, and test execution. ET is not Ad-Hoc Testing. It demands time, discovery and imagination. A tester’s creativity and intuitiveness plays a big role in enabling ET across teams. ET can be incorporated in an organization's culture, only when you have reached a few initial milestones like substantial automation coverage, a considerable amount of continuous testing in place and a scalable solution that covers the essential parameters of cross-browser or multi-device testing.

In our talk , we will cover:

  1. What is Exploratory Testing 

  2. Steps and methodologies for ET

  3. How can you make way for ET to be a part of your continuous testing processes

  4. How Exploratory Testing Elevates Agile Practices

  5. Who can be identified as an Exploratory Tester


Outline/Structure of the Talk

  1. Introduction and Greetings  [1 mins]

  2. Building the narrative - What to expect? [1 mins]

  3. What is Exploratory Testing  [3 min] 

  4. Prerequisite for making way for ET  [1 min]

  5. Methodologies to adopt [3]

  6. Exploratory is not ad-hoc testing [2]

  7. How can Bug Backlogs be addressed using ET [1]

  8. How Exploratory Testing Elevates Agile Practices [2]

  9. Case Study for references [3 mins]

  10. How can you identify an Exploratory Tester [1 min]

  11. Q&A [2min]

Learning Outcome

  1. An understanding of how ET can be implemented in Agile Practices

  2. Do they have enough scalable solutions [Automation and cross platform coverage] to divert their existing resources and bridge the gaps found via Production Defects/ Defect Backlogs

  3. How can re-engineering the current testing landscape bring in change

Target Audience

Test Engineers, Software Developers, Test Managers / Directors / VP

Prerequisites for Attendees

Testing landscape

schedule Submitted 8 months ago

  • Benjamin Bischoff

    Benjamin Bischoff - Of plugins and decorators - trivago's e2e test framework in the spotlight

    45 Mins

    Most often, test frameworks are developed from scratch and gradually extended with the required functionality. This approach is perfectly normal, but carries the risk of creeping technical debt as well as poor maintainability, transparency and extensibility. These risks can be minimized by using clean software architecture.

    In this talk, I will present two key parts of our internal Selenium-based end-to-end testing framework, which has been successfully used to test multiple web projects using desktop and mobile browsers during the past five years:

    1. the plugin infrastructure using Java's Service Provider Interface
    2. the custom WebElement decorator that enables more resilient Selenium WebElements

    I will explain the rationale for using these architectural tools and how these approaches mean that we can still evolve this framework quickly and easily to meet new needs.

  • David Burns

    David Burns - Working in the Shadow (DOM) - How to test Web Components

    45 Mins

    As Web Components gain more traction in the web to help websites become more performant it has created a bit of a blind spot on how to test these new features.

    In this talk, David will walk you through what Web Components are and how they are benefiting the web as we move forward. He will then walk you through how we can go about testing these and how, while well-meaning, other frameworks are making things a little harder to test. He will also go through some of the performance aspects of the Web Components and how this translates to your tests.

  • Puja Chiman Jagani

    Puja Chiman Jagani - Selenium has a new trick up its sleeve to track failures

    Puja Chiman Jagani
    Puja Chiman Jagani
    Team Lead
    schedule 8 months ago
    Sold Out!
    45 Mins

    As our systems and tests grow more and more complex we need to make sure that we have the tools to capture the root causes without spending hours or days chasing them down. This is where Observability becomes our best friend. Observability allows us to see what is going on inside a system based on what we think is crucial without trawling through logs! Just like any piece of software should be robust, scalable, maintainable, and reliable, it should also be observable. Observability makes the journey from identifying unexpected problems to identifying the root cause easier.

    To do so, the code should record as much useful granular information as possible. Metrics, logs, and traces are three known ways of encapsulating granular information. They are the primary sources of information to help determine the state of the system at any given point in time. 

    Selenium 4 introduced a fully distributed Grid with multiple components that communicate over the network. Troubleshooting and diagnosing problems in this setup is a challenge. To tackle this, Selenium integrated OpenTelemetry’s tracing and event logs.  This feature is now available out of the box by default when using Selenium.
    The users now have more power in their hands!

    I will dive into Selenium's observability journey by discussing: 

    1. What is observability?

    2. Need for observability

    3. Understanding the three pillars of observability: Metrics, Logging, and Tracing

    4. Generating telemetry data alone does not suffice. It is a process from design to deployment. 

    5. Full-stack tracing in Selenium (Grid and Java client library)

    6. Explain how we, at BrowserStack, are benefiting and exposing this information to our users.

  • Samiran Saha

    Samiran Saha / Dhvani Parekh - Testing Mobile Web Apps on Real Devices: A page out of "How Fortune 100 companies do it"

    45 Mins

    With the advent and advancements in Web APIs, accurately displaying responsive web page content across fragmented mobile device browsers is merely just one of the checkboxes that Quality Assurance teams need to care about, albeit a very important one.

    Similar to native / hybrid apps installed directly on Android and iOS, mobile web applications also implement advanced real world use cases that heavily leverage mobile device hardware such as processor, graphics, memory etc. and device sensors like camera, microphone, location, motion etc.

    In addition, web apps can also access device OS level features for SMS/call integrations, notifications, payments, accessibility which further calls for testing such web apps on real mobile devices.

    In our talk, we are going to cover -

    1. Expansion of mobile web testing landscape with Web APIs

    2. Why is mobile web testing important for businesses

    3. Real-world mobile web testing customer use cases across Finance, Banking and E-commerce

    4. Mimics for a real device : A risky business

    5. Achieving versatility in meeting the dynamic infrastructure needs

  • Samiran Saha

    Samiran Saha - Automation test suite migration - How to go about it?

    45 Mins
    Case Study

    Automation test suites allow teams to uncover defects faster with every new application release. While they provide efficiency, automation test teams should follow appropriate design principles consistently to build a highly robust, reusable, maintainable and scalable test framework. 

    As they get started, Automation testing teams may prioritise short term benefits over the broader overarching test automation vision. This leads to a poor automation experience in the medium to long run. In addition, the choice of the test automation framework library plays a crucial role towards attaining the desired business goals. Over a period of time, some automation test frameworks have gone out of favour in the testing community, owing to: 

    1. Deprecated / unmaintained open-source test framework library
    2. Limited forums. Limited test community support
    3. Limited built-in test parallelisation, limited built-in plugins etc.
    4. Limited or no cloud platform support

    Many such test automation teams encounter a need to migrate their automation framework to a new one or build a brand new framework implementation completely from scratch. In this session, I’ll take an example case study of how our team planned an automation test suite migration for Xamarin.UITest → Appium, and assisted a customer team implement it for their mobile app automation test suite. Specifically, I’ll be covering:

    1. Triggers / Need for test automation migration
    2. Applying a holistic migration strategy
    3. Creating an implementation / action plan
    4. Identified learnings post successful migration
  • Soumyabrata Moitra

    Soumyabrata Moitra / Kamini Pandey - 6 Sensible Defaults to enhance Delivery Quality

    90 Mins

    Through this workshop, learn and experience a collection of Sensible Defaults, that have been observed to have a positive impact on the delivery quality. Take a moment to think of the following situations faced in your current or any past projects:

    • Multiple defects being logged after a user story moves to Testing
    • Developers saying that a particular requirement was never supposed to be a part of a story, so they didn’t develop it
    • Testers validating and logging defects for something that was never even a part of the story
    • BAs assuming the feature doesn’t require any cross-team collaboration and doesn’t have any dependencies on other teams
    • The client/PO saying the developed feature was not as per his/her expectations
    • A story development blocked mid-way due to dependency on another team/vendor

    Almost all the above situations could be avoided if only there was close collaboration and proper communication between the Devs, QAs, BAs, and POs right from the beginning of story development. The sensible defaults that will be presented in this engaging workshop, are means to achieve such collaboration and ensure that what’s being actually delivered is what’s expected. From our own experiences, working in different projects in Thoughtworks, we realised the true potential of these defaults, how they help prevent a majority of defects from going into production, and establish quality as shared responsibility amongst the team members, leading to improvement in the overall quality of delivery. 

  • Debasmriti Ghosh

    Debasmriti Ghosh - How to Test Selenium Device Grid

    20 Mins
    Case Study

    In a fast growing environment where everything is moving first, it is a no brainer to test web and apps on mobile devices. To build it there are so many articles and blogs but none speaks about how to test the device grid meant for testing. We have a similar problem where we need to test mobile device grid consisting of a truly fragmented use case.

    It is different from testing applications on different platforms/versions. Testing cloud services itself has many challenges like 

    1. Are we presenting the same Experience as a real physical device held in their hands to grid users?

    2. Testing Integrations with different components

    3. Implement Automation for complex scenarios like users actions(scroll, click etc) with stability, fast pace, and less maintenance.

    We have faced a lot of complex challenges in this endeavour, and our engineering team has tried to solve it with some amazing results. In this session, we will provide the gist on the below issues:

    • How we simulate user actions in real devices using selenium?

    • How to leverage available frameworks based on your usage

    • Impact of automation on productivity and quality

  • Dhimil Gosalia

    Dhimil Gosalia / David Burns - Why People Hate On Selenium

    20 Mins

    Now that I have your attention, let me tell you why Selenium is bad. People throw the kitchen sink at their test suites and then never fully understand why their tests are
    ● Slow
    ● Brittle
    ● Take an age to run (Who has a test suite that takes a day to run?)
    And this is likely just on one browser. If we add another browser? The complexity grows exponentially!!
    The truth is, yes Selenium can be slow, it can be brittle, it make you do some of the set up yourself. However, Is the reality that Selenium is the problem in our lives?
    The problem with browser automation is that it is overused. People don’t understand how the asynchronous nature of browsers really work. And let’s be honest, browsers are hard, they’re operating system level hard.
    But for now, let’s blame Selenium for our woes. I mean, it is the most common denominator.
    The reality is... Poor test architecture, poor setup and the general “selenium isn’t coding so why practise good development hygiene” are ruining your lives. Implicit knowledge is codified and then people forget that it exists
    In this talk, I will talk about the things that I have learned in supporting BrowserStack customers, the common mistakes to make sure that you don’t have to. I will also talk about how Selenium is gives complete flexibility for you to choose -
    ● Test assertion library
    ● Test analytics or logging tool
    ● Test runner

     ● Test platform - Standalone or grid setup or headless And it has awesome features like
    ● Support all desktop and mobile platforms
    ● Scales better with solid community support
    Note: We are a framework-agnostic organization. We have customers that use BrowserStack at scale with many frameworks including Nightwatch, WebdriverIO, Playwright, Puppeteer, Cypress and of course, Selenium. This talk is a result of my personal frustrations on why Selenium is hated on so much when the fault clearly aren’t Selenium’s.

  • Bharath Raja

    Bharath Raja - UI Developers' guide to support testing

    Bharath Raja
    Bharath Raja
    Developer Relations
    schedule 8 months ago
    Sold Out!
    45 Mins

    The web development space has been growing exponentially over the past decade and the count of new frameworks and design patterns is at its all-time high. Historically there’s always been a gap between devs and QA and this talk is a step towards bridging that gap, enabling more collaboration and exposure to the other side. As a developer, you’d learn about the simple ways you can help test your product, and as a QA engineer you will get a peek into the development process and learn what you can ask from a developer that saves your time.

    We would go through key changes the front-end can make that would help testing and we would have some time for open discussions where the audience can raise their pain points while testing. On a high level, this talk will cover - UI Development process, Web elements, Navigation, Dynamic components and Backdoor access.

  • Shubham Yadav

    Shubham Yadav - Why and how we moved our test automation to Nightwatch - a case study

    Shubham Yadav
    Shubham Yadav
    Senior SDET
    schedule 8 months ago
    Sold Out!
    20 Mins

    With the increasing frequency of releases and an ever-increasing number of automation scenarios, our existing framework wasn't helping the case. We saw an increase in our time and efforts with little to no improvement in results. 

    With a bloated testing framework, we have serious performance and stability issues. Considering that we started to look into the fundamentals and started exploring new testing frameworks. We identified a few candidates that matched our requirements and finally selected Nightwatch. It satisfied all the criteria and gave better results when compared to our already existing framework.

    In this talk, we will cover

    1. Challenges with existing Framework

    2. Why Nightwatch?

    3. Learnings and Outcome from migration

  • Ravi Sawlani

    Ravi Sawlani - Elemental Testing My Dear Watson – Component Testing in Nightwatch

    45 Mins

    While End-End tests can be a great way to test out your applications but realistically, we need to follow the testing pyramid more. Moving more tests away from end-end to component testing will make your test suite faster. Addition of faster component tests while keeping end-to-end tests limited is a way out, especially when we start using reusable components in frontend frameworks.

    In this session, I will present how adding smaller and faster component tests would be beneficial / We can use the same Nightwatch APIs to write them so there is no need to learn extra steps. While most of the test frameworks use JSDOM to render components, some of the load all the files on the test renderer page. Nightwatch aims to provide a combination of both approaches. By the end of the talk, you will know how to test React components on Real browsers with Nightwatch along with visual assertions.