location_city Virtual Platform schedule Sep 12th 02:00 - 03:30 PM place Online Meeting 2 people 48 Interested

With the seismic shift in industry and development of new technologies emerging, QA’s testing approaches are also changing, we must know the right strategies and algorithms to test. One of the latest technology emerging is Artificial Intelligence and Machine Learning. And its applications like Self driving cars, Virtual Assistants are everywhere. They have great impact in our life and most of our decisions, behaviour & destinations depend on them.

So in this presentation/Workshop i would like to present all the ways/strategies/ challenges faced while testing AI/ML applications. Join me in creating a Machine Learning application from scratch and then take it to testing stage, creating edge case scenarios and validations.

Time Management: To make sure that all people are upto date with with setup for hands-on, i will be sharing this document with the participants 12 days before in a temp slack channel, where they can share the progress and ask queries to resolve them quickly.
*No internet is required for participants if they follow the setup doc.


Outline/Structure of the Workshop

Presentation contains following three modules for attendee of different experience types:

Initiation with brief talk on AI/ML concepts [10 minutes]

  • Creating a Beer Wine Classifier [Total -> 30 minutes]
    • Understanding the problem, and coming out with human based solution of same [5 min]
    • Choosing the right machine learning algorithm to test [5 min]
    • Brainstorming possible test cases [5 min]
    • Creating a model [5 min]
    • Executing test case and validating with happy path [5 min]
    • Testing with edge case scenarios [5 min]

  • Image Classifier(CLI Version) [Total -> 30 minutes]
    • Understanding the problem, and coming out with human based solution of same [5 min]
    • Choosing the right tensorflow library to test [5 min]
    • Creating data sets [2 min]
    • Identifying multiple scenarios [3 min]
    • Creating a model [5 min]
    • Executing test case and validating with happy path [5 min]
    • Testing with edge case scenarios [5 min]
  • Android Real time Image Classifier [Total -> 10 minutes]
    • Exporting our model created in second activity to mobile application [5 min]
    • Validating the model with real time images by hovering camera openly at objects [5 min]
QA [10 min]
I will be initiating with theory and explain modular topics via slides in presentation attached.
And parallelly doing the workshop with attendees.

I will be sharing about the model creation steps, strategies and challenges that one may require/face while testing AI/ML apps

Learning Outcome

  • What is AI/ML
  • How technology is shifting towards AI, ML
  • Where does a QA step in
  • Writing test cases for happy paths and edgy scenarios
  • Challenges while testing AI,ML application
  • Maintaining test suite and updating with new upcoming data

Target Audience

This workshop is for audience of all levels (beginner, intermediate, Expert)

Prerequisites for Attendees

Understanding of STLC and attentiveness in Machine Learning and Artificial Intelligence.


schedule Submitted 1 year ago

Public Feedback

    • Srinivasan Sekar

      Srinivasan Sekar / Sai Krishna - Testing And Observability in an Integrated Microservices environment

      45 Mins
      Case Study

      Leading-edge applications are dynamic and adaptive in capabilities that require people to use increasingly dexterous tools and supporting infrastructure, including microservices. All of these applications leverage data in new ways. Decoration and tagging of data with intelligent meta-data have become more important than data itself. To keep up with evolving needs, enterprise devs across industries are shifting from traditional app architectures in favor of more fluid architecture for building data-centric applications.

      Microservices break traditionally structured applications into manageable pieces that can be developed and maintained independently. microservices are often decoupled, allowing for updates with little to no downtime, as the other components can continue running.

      Moving to distributed Microservices ecosystem brings its own challenges; Among them is the loss of visibility into the system, and the complex interactions now occurring between services. Monitoring these applications only reports the health of it but Observability provides granular insights about the behavior of the system along with rich content. In this talk, we will cover the difference of Monitoring and Observability, data path engineering challenges, pillars of observability, distributed tracing of various microservices, testing in distributed microservices ecosystem, automated observability, etc.

    • Tarun Maini

      Tarun Maini - Infrastructure security from the eyes of QA in Devops team

      45 Mins

      Being a functional QA before, Tarun got the chance to grew up as an Infrastructure QA in Devops team for worlds’s first enterprise level Blockchain project where whole infrastructure is over cloud platform.

      Ensuring that all resources are spinning up properly was the main thing in blockchain because breakdown of any block/peers/node in blockchain can affect whole application.

      For the private network to work via quorum client all nodes should need to be in sync with each other to provide consensus for incoming transactions.

      In this talk Tarun will share his experiences and demo via a quick tutorial as how he wrote 1500+ test cases for INFRASTRUCTURE only that run completely under 60 seconds and at the same time ensure the security of infrastructure system at cloud resource e.g. AWS.

      And some incidents like:

      • How some private confidential data files were saved from being public and getting visible to world.
      • How access to some endpoints, ports visible to world were detected with tests & blocked.
      • How it was ensured that all application pods running continously on ec2 containers are healthy.

        both for infra as well as blockchain testing to make things run smoothly.