CodeVigil: Real-time monitoring and analysis of automation runs with defect analytics and advanced notifications

Do you have thousands of automated test cases, multiple test automation suites, do several runs every cycle, and have a hard time monitoring and analysing all of it or getting any meaningful metrics from it?

Have you ever been frustrated because there was an infrastructure issue, a setup failure, or a defect which would require a re-trigger of the entire test run and you had to wait till the end of the run to find out while wasting crucial time?

CodeVigil is an application developed in-house at Gainsight which looks to solve all these problems. It provides the ability to monitor test results and defects as they run while also giving real-time defect analysis even while the suite is running.

In addition, CodeVigil also gives metrics and analysis at every level (Org/Team/Suite/Feature/Scenario/Step).

It also provides targeted and relevant rule-based Slack notifications to make stakeholders aware of risks without inundating them with notifications and numbers. It's been particularly useful to support the BDD model at Gainsight.

The application would be open source and available to use and integrate into your automation process.

2 favorite thumb_down thumb_up 0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist

Outline/Structure of the Demonstration

  • Overview of Automation at Gainsight
  • Need for CodeVigil
  • What is CodeVigil
  • Tech Stack
  • End-to-end Technical Architecture and how to integrate CodeVigil into your process
  • Demo and Code Walk-through
  • Q & A

Learning Outcome

The session would include a code and architecture walkthrough and the code would be made available.

The outcomes would include:

  • The ability to integrate CodeVigil in your automation process.
  • Understanding the use of Elasticsearch to get realtime data in an inexpensive and efficient way and how it can be leveraged in the test automation process.
  • Understanding the technical challenges that were faced in building such an application.

Target Audience

SDETs; QA Managers; QA Directors; QA Engineers

Prerequisites for Attendees

Basic knowledge of Elasticsearch, Angular, Jenkins, and BDD would be helpful but not required.

An understanding of a typical test automation process is all that's needed to understand how you could leverage this tool!

schedule Submitted 1 year ago

Public Feedback

comment Suggest improvements to the Speaker

  • Liked Lavneesh Chandna

    Lavneesh Chandna - Bridging gaps between UI and API automation

    Lavneesh Chandna
    Lavneesh Chandna
    Lead SDET
    schedule 1 year ago
    Sold Out!
    45 Mins

    Are you trying to decide what kind of automation to pursue in your current project - API or UI? Or are you enticed by the clear benefits of doing both, but are worried about the kind of maintenance it may require in your tests going forward?

    This is the same dilemma that we at Gainsight went through, before we came up with an ingenious solution that allows us to target both API and UI automation and at the same time mitigate most of the the maintenance overheads that are generally associated with such an approach.

    The heart of the solution is:

    • A concept called State Transitions which allows to remove navigation level details from test cases.
    • Adherence to common design patterns and industry best practices
    • Designing test cases as a set of business actions rather than a string of click and fill operations.

    Once implemented correctly, the proposed approach allows to target both API and UI tests from a single set of feature files.

  • Liked Somasekhar Bobba

    Somasekhar Bobba - AI Driven Quality Assurance Program

    20 Mins
    Case Study

    State-of-the-art AI solutions automatically find key insights and hidden patterns applied across different domains to solve challenging problems. Embedding automated artificial intelligence as part of SDLC empowers organisations to easily adapt to change & learn fast in driving quality. New Ideas and hypothesis can be efficiently tested and continuously evaluated with datasets available from past test executions - Automated and Manual, Git / Gerrit Code commits, JIRA User stories, Customer Escalations , Product Usage Data, Metadata Configuration, Code Quality Metics, etc

    Automated artificial intelligence provides the following benefits

    • Intelligent automated test suites : Identify and taking decision on what tests to be executed in which phase of the SLDC process.
    • Data Analysis : Artificial intelligence can search and analyse huge combinations in no time to find insights.
    • Impact Analysis and Risk Assessment : Artificial intelligence applies statistical significance, and risk model estimates that manual reports might not consider.
    • Reveals hidden patterns: Artificial intelligence often finds hidden patterns and weak signals that a human might never detect using manual approaches.
    • Reduces Manual bias: Artificial intelligence helps minimise potential bias since insights are purely data-driven.
    • Optimise outcomes: Provides prescriptive, actionable guidance.