Exploring the unknown areas of Testing in Analytics

In the Analytics domain, I will share what I know as different facets of Analytics research and application, and its potential impacts on Testing the same.

 
2 favorite thumb_down thumb_up 8 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

I will explore with the audience the different facets of Testing in the Analytics space:
1. Given a subset of data, how can you sanitize it, and come up with good, repetitive models to confirm a set of patterns.
2. Given real and large-ish data, how can you ensure the models are applied correctly, to give the right set of results / outcomes.

The various complexities include:
> sanitizing the data
> verifying the models created are not too rigid, and can be applied across different set of data
> creating data of various types to ensure models give correct 'expected' outcomes when applied on it

I will also share some case studies about the above areas.

Learning Outcome

  • Understand what Analytics domain is about
  • Areas where testing can be done in this domain
  • Limitations and challenges of testing in the Analytics domain

Target Audience

QAs, Data Scientists

schedule Submitted 4 years ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • Tathagat Varma
    By Tathagat Varma  ~  4 years ago
    reply Reply

    Hi Anand - This is a fast-emerging area, and I am sure the audience will be interested in how to apply principles of agility in analytics space, especially when dealing with Big Data. However, it will help if you have more details on your session - e.g., have you made any previous presentations on this and can you share the same, etc.

    -TV

    • Anand Bagmar
      By Anand Bagmar  ~  4 years ago
      reply Reply

      Hi Tathagat,

      No - I have not made this presentation before. This is a new area for me, which I am reading about and understanding as much as I can. That said, I have presented about "The What, Why and How of Web Analytics Testing" before, and also have an open source tool called WAAT to help automate the reporting of Web Analytics testing. More information about this is available on my blog: http://essenceoftesting.blogspot.in/search/label/waat

      • Tathagat Varma
        By Tathagat Varma  ~  4 years ago
        reply Reply

        Anand - can you share a strawman of your presentation deck so that reviewer panel can take another pass at it? Right now, as much as we mostly agree with the importance of this field, don't quite get what exactly you plan to cover in the session, and whether the session will only become a primer on this subject or is backed with real actionable insights from the field?

        -TV

        • Anand Bagmar
          By Anand Bagmar  ~  4 years ago
          reply Reply

          Hi Tathagat,

          Unfortunately I do not have much material in terms of content right now. This is a research topic, and I mainly want to raise questions in the audience's mind about the importance of doing more in this area.

          Regards,

          Anand

  • Ebin John
    By Ebin John  ~  4 years ago
    reply Reply

    Hi Anand,

    Thank you for the submission. Can you please state the relevance of this topic with the theam "Beyond Agile"?

    - Ebin

    • Anand Bagmar
      By Anand Bagmar  ~  4 years ago
      reply Reply

      Hi Ebin,

      Agile is mainstream now - everyone is talking about it, and on that journey in some way. In my mind, the next big thing that we need to work on, keeping the same Agile principles in mind - is Analytics. Hence - Beyond Agile ... as in beyond the software delivery using Agile methodology.

       

      If you think this topic is better suited in another theme, please do let me know.

       

      Thanks. Anand

  • Prasad
    By Prasad  ~  4 years ago
    reply Reply

    Anand,

    If you end extend this to user feedback,  A/B testing, and how anylatics helps to take informed decision on MVPs etc..

    • Anand Bagmar
      By Anand Bagmar  ~  4 years ago
      reply Reply

      Hi Prasad,

      I planned to cover web analytics testing (what, why, how) in this. Including A/B testing also is a good idea. Thanks.


  • Liked Anand Bagmar
    keyboard_arrow_down

    Anand Bagmar - Automate across Platform, OS, Technologies with TaaS

    Anand Bagmar
    Anand Bagmar
    Director - Quality
    Vuclip Inc.
    schedule 4 years ago
    Sold Out!
    45 mins
    Demonstration
    Advanced

    "TaaS" is an open-source product that allows you do achieve the "correct" way of doing integration testing across a variety of products via Test Automation.

    Typically in organizations, there are multiple projects / products. Many organizations like to have a common Test Automation solution across these products in an effort to standardize the framework.

    However, this is not a good idea! Each product should be tested using the tools and technologies that are "right" for it. Yet - these different products talk with each other and you need to test the integration between them in an automated way.

  • Liked Sunil Mundra
    keyboard_arrow_down

    Sunil Mundra - Observing and Enabling The Agile Mindset

    Sunil Mundra
    Sunil Mundra
    Principal Consultant
    ThoughtWorks
    schedule 4 years ago
    Sold Out!
    45 mins
    Talk
    Advanced

    Agile is actually an approach and a Mindset, whereas most people misunderstand it as a set off practices. There are umpteen examples of people implementing the Agile practices and artefacts, but are failing to get the intended positive results. This is a classic problem of ‘doing Agile’ as opposed to aiming to ‘be Agile’. The key to getting the optimal benefits is having the Agile Mindset.

    Mindset is abstract and hence one needs to understand it based on what is visible in behaviours, policies etc. The talk is about not only what these visible characteristics are, but also about what can be some of the enablers to move towards achieving the Agile Mindset. It has been proven that Leadership of an organization plays a key role in enabling the right Mindset, and hence this talk is meant for Leaders.

     

  • Liked Anand Bagmar
    keyboard_arrow_down

    Anand Bagmar - Build the "right" regression suite using Behavior Driven Testing (BDT)

    Anand Bagmar
    Anand Bagmar
    Director - Quality
    Vuclip Inc.
    schedule 4 years ago
    Sold Out!
    90 mins
    Workshop
    Intermediate

    BDT is a way to identify the correct scenarios to build a good and effective (manual & automation) regression suite that validates the Business Goals. We will learn about how this is different from BDD, and do some hands-on exercises in form of workshops to understand the concept better.