KPIs for Successful Agile Transformation

Projects success have been measured traditionally through meeting timelines, milestones, budgets and quality for decades. The dawn of agile and digital tools have transformed project management to a whole new level. Agile transformations have become a standard in all organizations than a disruption now a days. Organizations have embarked on agile transformations to improve customer experiences and reap benefits through their products/projects. I will talk about one such agile transformative programs that I've led in the past 3 years with clear benefits and value to the client. Nowadays clients are keen in measuring the outcomes of such agile transformation journeys. They would like to clearly understand what benefits and values that they would be getting in going through such transformations. The KPIs that

I will talk about both engineering and business KPIs.

Business KPIs would include time to market, usability, near zero application downtime, user experience through multiple form factors like mobile, tablets & desktops, plug and play business rules, near zero IT dependencies, improved business productivity through simplification and reduced page navigation, automation of redundant and manual activities/tasks, intelligent alerts on failures and notifications, seamless upgrades with very little or no downtime and intuitive reports/dashboards providing analytics.

Engineering KPIs would include cloud based application development (or cloud native) for scalability, reduction of cycle time and lead time, MTTR (mean time to resolution), device agnostic development, reusable components, feature toggles, zero downtime deployment (only roll forward and no rollbacks), reduction in environment provisioning through dynamic scripts, number of post production defects, product focus over project/service delivery, pod model delivery, domain driven design, reduction in deployment time through automation and 100% code coverage through open source tools. Both the business and engineering KPIs have together defined the success of the agile transformation. Customers are keen in understanding which KPIs can better help in succeeding in such transformations.

The program which I led had more than 24 releases in 2 years with highly scalable, cloud based architecture. The product was highly scalable that we were able to on board 5 markets in 6 months with more than 200,000 users. The program had releases every 6 weeks with over 150+ features delivered seamlessly. The reusable components (25+) developed by the team through the 2 years journey helped them improve the productivity over 15%. The business process developed has also been extended to multiple domains like HR, Tax and Finance. The team has integrated the product to more than 10+ enterprise systems like SAP, Oracle etc seamlessly for greater customer experience. The program helped business configure more than 1000+ business rules themselves at their will without the need for IT support by making the experience truly blissful to customers. The agile transformation KPIs have played key roles in measuring the progress of the journey and the project managers have to learn the new KPIs that define the new digital paradigm to be successful in their carrier.


Outline/Structure of the Talk

The agenda of the session would be the following,

  • (5 mins) The beginning of the Journey / Goals
  • (8 mins) What are Metrics / KPIs?
  • (7 mins) Two major measurements to transformation.
  • (5 mins) Business KPIs - List of KPIs on business agility
  • (5 mins) Engineering KPIs - List of KPIs on engineering agility
  • (5 mins) KPI Maturity
  • (5 mins) Key Learnings and Outcomes
  • (5 mins) Q & A

Learning Outcome

Understanding on the usage of KPIS large scale product development or agile transformation programs

Learn about how and when to use relevant KPIs

Different KPIs on business and engineering KPIs from two large transformational programs

Key challenges with measurements

Learn about the best practices in using different KPIs

Target Audience

Agile Coach, Agile Program Managers, Scrum Masters, Agile Delivery Leaders

Prerequisites for Attendees

Exposure to different agile methodologies especially on Scrum Framework.

Exposure to Product Development

schedule Submitted 1 year ago

Public Feedback

comment Suggest improvements to the Speaker
  • Oana Juncu
    By Oana Juncu  ~  10 months ago
    reply Reply

    Hi Ramkumar,

    Thank you for your proposal.

    Can you give some more details on how you will address  and reinforce Agile Mindset by setting and managing the Business and Engineering KPIs?

    Kind regards,



    • Ramkumar Arumugam
      By Ramkumar Arumugam  ~  9 months ago
      reply Reply

      Hi Oana,

      I will share the story of one of the large programs that I led in 2017 for two years. How did the project start with a very small team, how did evolve large with a size of 90+ FTEs across multi (geo) locations. I will talk about how the program was envisioned, how the teams were formed, challenges faced by the pods, how did we embrace tools and technical practices (XP practices) to accelerate delivery, how did the team evolve from nascent stage innovative stages, to how did we scale quickly and deliver product increments, best practices and lessons learnt from retrospectives throughout the journey. The key message like embracing agile mindset will be reinforced through the metrics (engineering and business KPIs) in each and every phase of the program journey.



      • Ramkumar Arumugam
        By Ramkumar Arumugam  ~  8 months ago
        reply Reply

        Hi Oana,

        I've also updated my presentation based on the above discussion points. Please review and let me know for any questions.