Many good product and project teams try to understand the “whys” when they’re asked to build a new feature. But, how do we know whether our reasons are actually good enough?

Are we tracking customer behaviour and feedback to get more insights into building the “right product”?

Do we have analytics? Are we monitoring issues/crashes and user suggestions? Are we automating these processes?

In this talk, we will share how we did our analysis in order to get better insights for building the right product and adding more value to our customers. We will share our experience, challenges, etc. We will also talk about a small utility (Sentiment Analyser) we developed which helps us to generate meaningful reports from user's feedback on daily basis.

We will also cover how we’ve automated analytics and understanding the sentiments of our customers.

There will be a demo for Analytics Automation and Sentiment Analyser.

 
 

Outline/Structure of the Demonstration

  • Understanding Problem Statements
  • How can we have insights about features before they are added?
  • How can we understand user sentiments better in order to design the right product?
  • How do we automate them?
  • Demo of the solutions (Analytics Automation and Sentiment Analyser)

Learning Outcome

  • Understanding benefits of analytics and testing them
  • Understanding value of customer feedback
  • Adding a perspective in testing mindset to value analytics and user feedback
  • Figure out bugs and crashes from feedback
  • Using reports from Sentiment Analyzer to improve product

Target Audience

Anyone (QAs, DEVs, BAs, POs) who is interested in making their product better by understanding customer behaviour, their feedback and needs.

schedule Submitted 1 year ago

Public Feedback

comment Suggest improvements to the Speaker
  • Anand Bagmar
    By Anand Bagmar  ~  1 year ago
    reply Reply

    Hi Rohit, Lavanya,

    A few questions:

    • Is this going to be only a talk, or will you be doing some demo as well?
    • What is this Sentiment Analyzer you are referring to in your learning outcome?
    • How do you figure out bugs & crashes from feedback? 

     

    • Lavanya Mohan
      By Lavanya Mohan  ~  1 year ago
      reply Reply

      Hi Anand,

      Our answers to your questions are:

      1. We will show a demo of how we've automated collecting, classifying and understanding reviews of users from Play Store. We will also show how we integrated it as part of CI pipeline and generate a report everyday.

      We will also explain how we automate the testing of our analytics events at the source itself.

      2. Sentiment Analyser is an open source utility that we built using Watir (a wrapper over selenium) to fetch user reviews from PlayStore and understand how users feel about our product and it's features.

      As of today, this utility fetches reviews, classifies them based on features of the product (configurable), further classifies them based on whether they are an area of improvement or positive review, etc. We use this to generate reports and understand user sentiments.

      We have plans of extending this to fetch reviews from other sites.

      3. We have a tool integrated with our product to track app crashes.
      Apart from that, certain analytics events that we capture give us insights into things that could've gone wrong.
      Also, when there are issues, many users report issues on social media. These customer feedback help us track bugs as well

      Thanks and regards,
      Lavanya & Rohit


  • Liked Srinivasan Sekar
    keyboard_arrow_down

    Srinivasan Sekar / Sai Krishna - Advanced Appium

    Srinivasan Sekar
    Srinivasan Sekar
    Lead Consultant
    Thoughtworks
    Sai Krishna
    Sai Krishna
    Lead Consultant
    Thoughtworks
    schedule 1 year ago
    Sold Out!
    480 Mins
    Workshop
    Intermediate

    At this workshop, you'll learn about advanced concepts in Appium. We will learn how to write a single script for Android, iOS and mobile web apps. Once our tests are established, we will work on framework design and report. We will also have a detailed look at how can we automate various mobile gestures using TouchActions and mobile endpoints in Appium and running distributed tests in parallel on various emulators and simulators.

  • Liked Rajdeep
    keyboard_arrow_down

    Rajdeep - Android Application Backdoor via Appium

    Rajdeep
    Rajdeep
    Sr. Test Automation Engineer
    Badoo
    schedule 1 year ago
    Sold Out!
    45 Mins
    Demonstration
    Advanced

    Application Backdoor via Appium

    There's a shift towards open-source mobile test automation tools happening today among developers and QAs. Whether it be Appium, Calabash or anything else: all are good, with some major limitations.

    While a chosen tool may work well when you first start using it, things can quickly get out of hand with changing business requirements. We started using Calabash at Badoo when there was no Appium. Given the capability of Appium to drive the whole device, we started automation of new apps with Appium. However, we realized a powerful feature was missing in Appium for Android! : The ability to call Application code from automation code like Calabash Backdoors.

    As Appium UiAutomator server is based on instrumentation, we modified it such that we could instrument our app under test. This gave us the power to access context of Application under test and invoke public methods of Activity using reflection APIs. We use these methods to setup app state, seed DB OR even enable/disable some client-side A/B tests. This makes our application more testable and our tests more predictable.

    This talk is going to be about how I achieved the above solution and benefits of backdoors.

    There will be a small demo and code!

  • Liked Anand Bagmar
    keyboard_arrow_down

    Anand Bagmar - Measuring Consumer Quality - The Missing Feedback Loop

    45 Mins
    Case Study
    Intermediate

    How to build a good quality product is not a new topic. Proper usage of methodologies, processes, practices, collaboration techniques can yield amazing results for the team, the organisation, and for the end-users of your product.

    While there is a lot of emphasis on the processes and practices side, one aspect that is still spoken about "loosely" - is the feedback loop from your end-users to making better decisions.

    SO, What is this feedback loop? Is it a myth? How do you measure it? Is there a "magic" formula to understand this data received? How to you add value to your product using this data?

    In this interactive session, we will use a case study of a B2C entertainment-domain product (having millions of consumers) as an example to understand and also answer the following questions:

    • The importance of knowing your Consumers
    • How do you know your product is working well?
    • How do you know your Consumers are engaged with your product?
    • Can you draw inferences and patterns from the data to reach of point of being able to make predictions on Consumer behaviour, before making any code change?
  • Liked NaliniKanth M
    keyboard_arrow_down

    NaliniKanth M / Srinivasan Sekar - New hope in Selenium Docker

    45 Mins
    Demonstration
    Advanced

    Idea behind this talk is to describe how to create a short lived containers for each test and scale to large Selenium Cluster using Selenoid. What is standard Selenium architecture and why it is not suitable for big clusters, Also states issues in maintaining a large Docker Selenium Grid / Selenium Clusters. In this session we will also be talking about the challenges we faced in using official selenium docker images and how we scaled up regression execution time from 3:3 (3 hours to 3 mins). Followed by a demo of how Selenoid server solves the problem with docker. How it works, how to use inside big Selenium cluster, where else it could be used.

  • Liked Smriti Tuteja
    keyboard_arrow_down

    Smriti Tuteja - Migrate to Headless Chrome with Protractor

    Smriti Tuteja
    Smriti Tuteja
    Sr. Consultant
    Thoughtworks
    schedule 1 year ago
    Sold Out!
    20 Mins
    Experience Report
    Intermediate

    In this era of automation where everyone is focused on Agile and DevOps, learn how you can migrate from xvfb (X virtual framebuffer which enabled you to run browser tests without a display on a CI server) to Headless Chrome while you use Protractor.
    Attend this talk to understand how I migrated to headless chrome and the pain points. The discussion will include:

    • things you can take care of when migrating
    • checking versions compatibility for migration
    • things you will need to fix