In a financial business world dominated by DATA intensive applications there is constant need to collect, manipulate, store and retrieve of large amounts of data. In addition most of the applications being process oriented require analysis and implementation of complex business rules to the data.

Few examples are taxation, customs, excise application, mutual funds, Fund Management organizations, where the underlying data typically scales over time.

Given that the tolerance for faults and errors in such applications is very small, focus has to be bought on how to effectively use data for robust functional testing.

Mostly the data challenges are possible to manage from a manual testing perspective, but that becomes very cumbersome and inefficient overtime, especially for regression testing.

In order to automate the regression of such applications, usually there are 2 options:

  1. Automation tool and scripts build in the complex business rules and validation points in-line with the application. This implies that when tests are executed with multiple data sets, the values calculated by scripts should match the ones generated by the application.
  2.  
  3. The other approach is to use Managed Data to test the functionality of the application. This approach proves more beneficial for data intensive applications where input data is changing frequently. It allows the functionality to be tested against a predictable outcome and insulates the application from external and internal dependencies.
  4. The focus of our discussion will be ‘Testing with Managed Data’ – framework details, prerequisites, pros and cons compared to other approaches.
 
1 favorite thumb_down thumb_up 6 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  1. Understand the challenges of data intensive applications.
  2. Use of Managed Test Data
  3. Details of the framework
  4. Pros and cons
  5. Learnings from the journey

Learning Outcome

Understanding an alternative approach for functional testing of Data Intensive applications.

Target Audience

Testers, test managers, test architects

schedule Submitted 1 year ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • Schalk Cronjé
    By Schalk Cronjé  ~  1 year ago
    reply Reply

    What magnitude of testing data will this focus on? 400MB SQL database or truley Big Data (potentially noSQL)? I am asking that as I am trying to frame the context of the proposal.

    • Schalk Cronjé
      By Schalk Cronjé  ~  1 year ago
      reply Reply

      We never had any replies over 1 month. I have to wonder on whether they are serious in replying.

      • Charu Jain
        By Charu Jain  ~  1 year ago
        reply Reply

        Hi,

         

        The size of the Managed Data is ~270 GB. This is ~60% of the production DB and we have been able to successfully manage and use it for functional testing. We will be using Delphix for refresh and other maintenance related activities.

        In case additional information is required, please feel free to contact me. If needed we can even set up a small call to discuss in detail.

        Apologize for the delay in response, the emails were going to the junk folder.

        Please use charu.jain@fidelity.co.in and charuj@Hotmail.com for further communications.

         

        Thanks


        Charu Jain
         
    • Charu Jain
      By Charu Jain  ~  1 year ago
      reply Reply

       

      Hi Schalk,

      The size of the Managed Data is ~270 GB. This is ~60% of the production DB and we have been able to successfully manage and use it for functional testing. We will be using Delphix for refresh and other maintenance related activities.

      In case additional information is required, please feel free to contact me. If needed we can even set up a small call to discuss in detail.

      Apologize for the delay in response, the emails were going to the junk folder.

      Please use charu.jain@fidelity.co.in and charuj@Hotmail.com for further communications.

       

      Thanks

      Charu Jain

  • Aditya Garg
    By Aditya Garg  ~  1 year ago
    reply Reply

    Hi Charu and Sachin,

    How big is this managed data. Are there any specific tools being used for this data. this comment is similar to Schalks comment.

    Please advise

    • Charu Jain
      By Charu Jain  ~  1 year ago
      reply Reply

      Hi Aditya,

      The size of the Managed Data is ~270 GB. This is ~60% of the production DB and we have been able to successfully manage and use it for functional testing. We will be using Delphix for refresh and other maintenance related activities.

      In case additional information is required, please feel free to contact me. If needed we can even set up a small call to discuss in detail.

      Apologize for the delay in response, the emails were going to the junk folder.

      Please use charu.jain@fidelity.co.in and charuj@Hotmail.com for further communications.

       

      Thanks

      Charu