10 Steps to Better Outcomes by Using Metrics

This session is not intended to offer an exhaustible list of metrics or instructions on how to improve all systems. Rather, the intent is to provide a framework on how to ensure the quantitative and qualitative metrics you use are measuring the right things and how to apply them to a system of continuous improvement. Attendees will have a repeatable framework they can apply after leaving the session.

The session is broken into two main parts.

  • Part 1: Identify the right (quantitative and qualitative) metrics that will help people and teams meet outcomes or goals.
  • Part 2: Create a cycle of learning and improvement that aligns people and teams to the outcomes or goals.
 
12 favorite thumb_down thumb_up 0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/Structure of the Talk

  • SETTING CONTEXT [4 min]
    • What we’ll talk about
    • What we won’t talk about

  • INTRODUCTION [1 min]
    • I’m Derek - Systems Thinker, Coffee Drinker, Runner

  • STEPS 1 THROUGH 10 (This is 2 parts) [35 minutes]

  • Part 1: Identify the right (quantitative and qualitative) metrics that will help people and teams meet outcomes or goals.
    • Step 1: Defining the outcome or goal
    • Step 2: Identifying key results and questions that align to the outcome or goal
    • Step 3: Identifying the metrics to measure the key results or answer questions
    • Step 4: Identifying data sources for the metrics used
    • Step 5: Defining collection method and frequency
    • Step 6: Defining acceptable thresholds or variance

  • Part 2: Create a cycle of learning and improvement that aligns people and teams to the outcomes or goals.
    • Step 7: Review the current conditions
    • Step 8: Understand the root cause
    • Step 9: Identify the goal
    • Step 10: Plan and act on the goal
  • SUMMARY [5 minutes]

Learning Outcome

  • Attendees will have a repeatable system they can apply after leaving the session.
  • Attendees will have access to the materials presented with links to templates and working examples

Target Audience

ScrumMasters, Agile Coaches, Managers, Executives

Prerequisites for Attendees

No prerequisites!

schedule Submitted 3 weeks ago

Public Feedback

comment Suggest improvements to the Speaker

  • 45 Mins
    Workshop/Game
    Beginner

    How do you get people to agree on priorities when they may have different objectives? You may be facing an issue now where stakeholders are pushing against each other in order to get their work done first. What would happen if we could create an open dialog among stakeholders and have them understand different perspectives and focus on the goals of the greater good instead of just their own? Let’s face it, proper prioritization is the difference between writing code and developing valuable solutions.

    In this simulation style workshop, you’ll learn practical methods for bringing stakeholders together and openly discuss their different priorities to agree on what’s most important overall. You will see first hand how a combining group discussion with proven prioritization methods such as Weighted-Shortest Job First and (WSJF) and Must Have, Should Have, Could Have and Won’t Have (MoSCoW) work.

  • Liked Zack Ayers
    keyboard_arrow_down

    Zack Ayers / Matt Acors - Andon Cords in Development Teams: Our Experience of Driving Continuous Learning through a Culture of Experimentation

    45 Mins
    Talk
    Beginner

    Summary

    In this session, you’ll learn about one team’s struggle to improve collaboration and how they sought to shorten cycle time by carefully crafting an experiment with an Andon Cord. The Andon Cord is a Toyota innovation designed to empower front-line employees to recognize issues, initiate a stoppage of work, and work together as a team to quickly identify a path forward. The emergency cable strung above assembly lines became a symbol of the Toyota Way, and has widely been copied throughout the auto industry and beyond.

    You’ll be introduced to metrics that show a surprising correlation between collaboration through Andon Cord pulls and Cycle Time!

  • Liked Thomas Stiehm
    keyboard_arrow_down

    Thomas Stiehm - Shifting Security Left - The Innovation of DevSecOps

    Thomas Stiehm
    Thomas Stiehm
    CTO
    Coveros, Inc.
    schedule 1 month ago
    Sold Out!
    45 Mins
    Talk
    Beginner

    DevSecOps uses application security practices that have been around for a while. The innovation of DevSecOps is incorporating security into the daily workflow of the team rather than leaving them to the end of a release like many legacy processes do. Shifting security left is made possible by the ability to automate many aspects of security testing and verification. DevSecOps leverages DevOps practices to make application security a first-class citizen in the practices of modern software product development. DevSecOps starts with a culture change mindset of cross-functional teams creating software through collaboration and fast feedback cycles.

    The security in DevSecOps starts before the code is written by using techniques like threat modeling and risk analysis to help figure out who might want to attack you and how they might do that. This often ignored security practice can be enabled by following the DevSecOps practices of having a cross-functional team involved in the process from the beginning, including security professionals.

    Next, DevSecOps maps application security practices into the build pipeline for a project in order to provide quick feedback about the security posture for any change made to the software. By using automation to allow the team to move quickly while maintaining confidence in the health of the code base, DevSecOps extends that health check to include application security checks. While automation can be used to make security data collection easier it is important to understand what security practices still require a human being.

    This talk focuses on how, when, and where practices should be incorporated into a build pipeline to get the most value out of your security practices through automation. It explores what manual security work still needs to be done by a person and how to maximize value while minimizing the effort of human beings.

  • Liked David W Kane
    keyboard_arrow_down

    David W Kane - Amend the Agile Manifesto!

    10 Mins
    Lightning Talk
    Intermediate

    We all do it. In fact, I've done it already in this talk description. I've amended to title of the "Manifesto for Agile Software Development" to just "Agile Manifesto," and I suspect most of the you attending AgileDC 2019 have done this as well. In this talk I will argue that this truncation of the title of the Manifesto is more than an abbreviation of convenience, it is a sign that how we use the Manifesto in practice has moved beyond what was stated in the foundational document. For many folks Agile has significant importance and impact beyond software development. Just as our nation's Constitution has been amended over the years, I will propose amendments to the Manifesto in this talk.

  • Liked Dane Weber
    keyboard_arrow_down

    Dane Weber - Undercover Scrum Master

    Dane Weber
    Dane Weber
    Sr. Consultant
    Excella
    schedule 4 days ago
    Sold Out!
    45 Mins
    Experience Report
    Intermediate

    After three years as a Scrum Master and Agile coach, I hit a wall coaching a team that did not want to try popular Agile engineering techniques such as TDD and pair programming. I had become a Scrum Master after four years working on the business analysis and account ownership side of things and could not speak from personal experience about engineering practices. In order to get some first-hand experience and to gain a new perspective, I chose to spend a year or two as a software developer on a Scrum team.

    The experience has been eye-opening. I experienced a tremendous cognitive load working with a wide array of technologies; this pulled my attention away from many of the collaborative and process-oriented activities I cared about as a Scrum Master. I was surprised to feel strong pressure to complete work quickly, cutting corners, even when the Product Owner and Scrum Master were not asking me to. When this pressure was explicit, it usually came from my fellow developers. On the other hand, there is real joy in writing code and seeing a system do something worthwhile that it wasn't doing before. My outlook has changed tremendously and is something I want to share with anyone who works with development teams, especially Scrum Masters and other coaches. I am still enjoying my time as a developer, but I'm looking forward to returning to coaching and incorporating this experience into my approach.

  • Liked Katrina Tanner
    keyboard_arrow_down

    Katrina Tanner - Playdoh...play on!

    Katrina Tanner
    Katrina Tanner
    Scrum Master
    Cvent
    schedule 1 month ago
    Sold Out!
    10 Mins
    Lightning Talk
    Beginner

    What happens when 25 product owners, developers, and quality engineers reflect on their previous sprint through the eyes of a child?

    Playdoh took my teams, remote and collocated, from showing up to an obligatory meeting on their calendar to intentional interpersonal and intrapersonal dialogue.

    Between the carpet and the sticky fingers, adults are usually cleaning up more Playdoh than playing with it themselves. Even to my own surprise, in this “Play Retro,” our team members connected, not only on a professional, but also on a personal level in ways they had not done before.

    This session will give an overview of our experience using a “Play Retro” and leave you with tips and things to consider planning a retrospective.

  • Liked Craeg K Strong
    keyboard_arrow_down

    Craeg K Strong - Kanban Antipatterns: What You Don’t Know Can Hurt You

    45 Mins
    Workshop/Game
    Beginner

    In this interactive workshop we will examine multiple examples of Antipatterns observed in real-world Kanban boards. In each case we will identify the issues and discuss ways to improve the situation. We will review a number of better alternatives and see how the improvements map to the core principles of Kanban such as visualization, managing flow, and making policies explicit. Brand new to Kanban? Learning by example is a great way to get started! A long-time Kanban veteran? Come to see how many antipatterns you recognize and help firm up our Kanban Antipattern taxonomy and nomenclature!

    Kanban is an extremely versatile and effective Agile method that has seen significant growth in popularity over recent years. Kanban’s flexibility has led to widespread adoption to manage business processes in disparate contexts such as HR, loan processing, drug discovery, and insurance underwriting, in addition to Information Technology. Like snowflakes, no two Kanban boards are alike. The downside to this flexibility is there is no well-known and easily accessible library of patterns for designing effective Kanban boards. Like Apollo engineers, teams are expected to design their board starting from first principles. Unfortunately, sometimes teams get stuck with board designs that may not provide the visibility and insight into their workflow they hope to see. Worse, some designs actually may serve only to obscure the situation. Working within the limitations of an electronic board can exacerbate the problem even further. Is all hope lost? Certainly not!

    Let’s learn more about effective Kanban system design by examining what to avoid and why. Learning by example is effective and fun!

  • Liked Joel Tosi
    keyboard_arrow_down

    Joel Tosi - Metrics that Matter - Moving from Easy to Impactful

    Joel Tosi
    Joel Tosi
    Dojo & Co
    schedule 1 month ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    Metrics are the bane of many organizations, getting fascinated on measurements that don’t matter or can drive improper behaviours. In this session, we walk through a simple grouping for metrics where the groupings not only call out the metrics, but their limits, and help guide to better metrics.

  • Liked Sameh Zeid
    keyboard_arrow_down

    Sameh Zeid - Hands-on Activity: Managers coaching the transformation using Kata Thinking

    Sameh Zeid
    Sameh Zeid
    Agile Coach
    Ford Motors via Ciber
    schedule 1 month ago
    Sold Out!
    45 Mins
    Workshop/Game
    Intermediate

    Transformation programs usually happen periodically and years apart. They introduce new processes and require organizational restructuring, while they often do not create organizational behavior change. They often ignore the inherent behaviors that have led to the unsatisfying status quo in the first place. These programs separate “the work” from “how we improve the work”.

    Rather than having transformation programs every few years, can we embrace change and experimentation as the daily way of work? We can, when managers act as coaches for their teams on experimentation as the way of work. Meaning, when teams experiment they enable delivery, improvements and innovation.

    This is an activity-based session that demonstrates the non-ending organizational journey towards growth and innovation. We will follow transformation approach based on Kata Thinking Pattern(KTP) to explain how teams experimentally introduce improvements guided by a universal model.

    With minimum lecturing and focus on doing, you would experience first hand the KTP mindset for on-going transformation where managers are coaches. We will use Improvement Cards that are based on industry case studies for digital transformation

    We will be organized into teams each has 4-6 people.

    This session can be relevant to you, if you are interested in Agile Transformation and Lean Management.

  • Liked Joel Tosi
    keyboard_arrow_down

    Joel Tosi - Growing a Learning Organization

    Joel Tosi
    Joel Tosi
    Dojo & Co
    schedule 1 month ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    How do you grow a continuously learning organization? If certifications and wikis were enough, organizations would be crushing it. In this session we look at how we learn in complex domains - focusing on tacit vs explicit knowledge; context learning; and growing coaches and teachers.

  • Liked Erin Randall
    keyboard_arrow_down

    Erin Randall - Graciousness: The Fine Art of Being Kind to Yourself

    Erin Randall
    Erin Randall
    Agile Coach
    Schwab
    schedule 2 months ago
    Sold Out!
    45 Mins
    Talk
    Intermediate

    Exhaustion. Numbness. Emptiness. As coaches, as scrum masters, our work is about serving others, oftentimes at the expense of ourselves. This talk is about learning to act graciously, to act kindly, to do unto ourselves as we do for our teams. We will discuss the urgency of slowing down, of leaving room to contemplate our inner world, and of "bringing calm into the motion and commotion of the world." I discuss the urgency of slowing down, the neurobiology of graciousness and compassion, and how to use practices within the contemplative-practice tree. I will also cover how to use these practices to show when self-care is falling to the wayside and how to build a foundation of compassionate graciousness. Research for this session draws upon primary sources such as Pico Iyer, Dr. Rachel Remen, Mirabai Bush, and Dr. James Doty, philosophers and contemplative thinkers such as Thomas Merton and Henry David Thoreau, and poets such as Emily Dickinson and Mary Oliver. The Dalai Lama says that the one thing without which we cannot live is kindness, and I posit that we must also show that kindness, that graciousness, to ourselves.

    This talk targets Agile practitioners of all skill levels, but particularly Agile coaches and scrum masters. So many of us help others to move forward, to self-organize, but service can be exhausting. This talk is for you, to help you find practices to show that kindness, that graciousness, to yourself.

  • Liked Mindy Bohannon
    keyboard_arrow_down

    Mindy Bohannon - I’m a BA Girl in an Agile World

    Mindy Bohannon
    Mindy Bohannon
    Agile Business Analyst
    Excella
    schedule 4 days ago
    Sold Out!
    45 Mins
    Experience Report
    Beginner

    Have you ever worked with a Business Analyst (BA)? Is what a BA does on an agile project much different from what is done on a waterfall project? All analysts bring excellent communication, collaboration, and trust to their work on project teams. During this session we’ll review the roles a BA can play, a BA's responsibility on the development team, and the skills a good BA possesses. For fun, lets also talk about why an Analyst is part of the 3 Amigos and the complexity of communication channels. Generally speaking, let’s discuss how BAs participate in an agile project’s success and I’ll share some stories about my experience going from waterfall to agile, how I’ve interacted with the PO, and important things I think an Analyst should be involved in.

  • Liked Dr. Patrick McConnell
    keyboard_arrow_down

    Dr. Patrick McConnell - The Velocity Trap: Learning to Value Enterprise Outcomes over Team Output

    45 Mins
    Tutorial
    Beginner

    Behind the creation of every Agile Framework was the intention to improve the Return on Investment for creative work, primarily through faster and richer feedback. But as team-level frameworks like Scrum are internalized by large organizations, that message gets mistranslated. Instead of, “Get better outcomes, sooner,” the drive instead becomes, “Just do more, faster.”

    A common expression of this problem is the confusion of Velocity for Value, where teams are directly managed based on their Output, but the connection between Output and Outcome is lost or ignored. This plays out in all kinds of ways that distract from achieving tangible results, and often incentivizes internal competition over collaboration. This problem can be especially tenacious in organizations with significant institutional ‘status-ing’ behaviors, where leadership struggles to translate common Agile methods like Relative Estimating into existing artifacts like Executive Dashboards or Earned-Value Management.

    In this tutorial, participants will explore the 'Velocity Trap', and will be shown how to setup a results-driven framework that prioritizes 'Maximizing Outcomes while Minimizing Output.'

  • Liked Donald Patti
    keyboard_arrow_down

    Donald Patti / David Bulkin - Plays over Plans: Using Transformation Plays to Coach Enterprise Change

    45 Mins
    Talk
    Intermediate

    Unlike agile at the team level, enterprise agility requires cultural change throughout the organization to be successful. But, cultural change is far from easy. Much like the roots of a tree, culture runs deep, so it takes persistence and the right approach to achieve success.

    In this talk, Donald Patti and David Bulkin will describe multiple successful plays, or approaches, to enterprise agile transformation, providing attendees with a number of practical ways to understand and change an organization's culture.

  • Liked Mark Grove
    keyboard_arrow_down

    Mark Grove - Authority and Trust: Finding the Scrum Master Balance

    Mark Grove
    Mark Grove
    Excella Consulting
    schedule 2 weeks ago
    Sold Out!
    45 Mins
    Talk
    Beginner

    Have you ever seen the term “process authority” used to describe the role of a Scrum Master? You don’t have to look too hard to find this description. In my experience, it has caused a lot of confusion and misunderstanding on project teams. So why is it even used? And should it?

    I worked on a new Scrum project where management informed the project teams that the Scrum Master role was given process authority over the team. There was a lot of confusion and unease about this. Questions started popping up such as “I already have a manager – is the Scrum Master now my boss,” “What does process authority mean,” and “Do we really have to do what she says?” As a result, the teams were becoming hostile to the Scrum Master role, untrusting of the Scrum Master’s responsibility, and concerned Scrum Masters had authority to tell the teams what to do. I was the project’s agile coach and needed to diffuse the confusion and better the working environment as quickly as possible. This did not happen overnight, but our journey started with this interactive discussion which we used as a foundation for the project moving forward.

    In this interactive presentation, we explore the concept of “process authority” and consider the various directions it takes us. To do that, this discussion goes far beyond a typical “the role of a Scrum Master” presentation; It explores…

    • What it should (and should not) mean when/if “process authority” is used to describe the Scrum Master role
    • How the responsibility and expectations of a Scrum Master are different than that of team members
    • How different leadership styles play into understanding the role of the Scrum Master
    • The importance of trust in a Scrum Master/team relationship

    The presentation uses real-time audience feedback to further explore these topics. Audience members will provide answers to questions given throughout the presentation, so we can explore members’ thoughts, opinions, and experiences they have had with the Scrum Master role.

  • Liked Melinda Solomon
    keyboard_arrow_down

    Melinda Solomon / Ken Moser - IV&V Just Looks Like a Four-Letter Word

    45 Mins
    Experience Report
    Intermediate

    The job of an IT Project Manager is a difficult one and traditional approaches to governance tended to make it even more difficult. In the best of times, these approaches employ Independent Verification and Validation (IV&V) as an impediment to project teams; in the worst of times, they set IV&V up as judge, jury, and executioner for projects.


    But just because that’s the way things are often done doesn’t make it right. Oversight entities can be healthy enablers instead of adversarial obstacles.

    Traditionally, the role of a governance framework is to enumerate statutory requirements, promote best practices, and reduce risk. The purpose of an IV&V team within this world is to ensure that appropriate elements of the framework are followed so as to mitigate risk. Larger projects typically present greater risks and require more controls; smaller projects less so.

    The big challenge has always been in defining what is required for a given project.

    Project sponsors want working solutions. The CFO wants tight budgets and lower costs. Project teams want happy sponsors. These stakeholders often oppose IV&V because the cost/benefit case for everything it promotes can be difficult to justify in comparison to business needs. Also, when these stakeholders do not pay directly for development costs they can have a very high tolerance for risk – but that’s an issue for another day.

    What if we re-frame IV&V from risk mitigation to added value?

    • What if, instead of requiring reams of documentation, IV&V identifies information it needs in the tools and processes already in use?
    • What if, instead of forcing teams to follow so-called best practices in cookie-cutter fashion, IV&V provided the metrics and data they need to take specific action when it is most effective?
    • What if, instead of reciting regulations to teams, IV&V worked hand-in-hand help teams meet them in the most efficient ways possible?
    • What if, instead of looking for defects, IV&V asked teams how it could help and then provided the specific support they need, where and when they need it most?
    • What if IV&V helped to onboard new teams and train them in specific skills and resources they will need to succeed?
    • What if IV&V assessed team needs as they worked together and then developed training courses to address those needs?
    • What if IV&V built project dashboards to present useful information from development tools that helped teams surface problems quickly?
    • What if these and other steps help project teams deliver value while meeting regulations, reducing risk, trimming costs, and increasing quality all around?

    What if? There is no what if. This works. It really does.

    These are just some of the innovative governance strategies that our IV&V team at USCIS has employed and it has made all the difference.

    Let us tell you more about them…

  • Liked Joel Tosi
    keyboard_arrow_down

    Joel Tosi - Fostering the Third Way - Your DevOps Dojo

    Joel Tosi
    Joel Tosi
    Dojo & Co
    schedule 1 month ago
    Sold Out!
    45 Mins
    Talk
    Beginner

    In the DevOps Handbook, Gene Kim introduces the Third Way - The Technical Practices of Continual Learning. Enter the DevOps Dojo - an immersive environment where whole teams come together to learn and practice their skills while solving real business problems.

    Joel Tosi and Dion Stewart say teams learn better in the immersive eco-system of Dojos than they do using traditional forms of training. They explain why and how Dojos help teams bond around product, foster rapid experimentation, and reframe small failures as learning.

    In this session, we will frame the need for dojos. From there we will walk attendees through the dojo format, including things they need to think about when creating their own. We wrap up with simple calls to actions for people to take to bring learning forward.

    Come to this session not only to learn about what works in creating a Dojo but also how Dojos help upskill your teams and support the cultural DevOps change.

  • Liked Katrina Tanner
    keyboard_arrow_down

    Katrina Tanner - Journey from Analyst to Product Owner to Scrum Master in less than a year

    Katrina Tanner
    Katrina Tanner
    Scrum Master
    Cvent
    schedule 4 weeks ago
    Sold Out!
    10 Mins
    Lightning Talk
    Beginner

    Not many people can say they have performed as an Analyst, Product Owner, and Scrum Master, much less in the same year, and sometimes at the same time.That has been my journey throughout 2018 and into 2019 thus far, as I made intentional decisions in pursuing my next best step, exploring where I really fit, and experiencing quite a few surprises along the way.

    As a CSM and CSPO, I navigated each role taking what I learned in the classroom and implementing it as a practitioner. Being very team AND operations oriented, I have always thrived when one of these were included in my job description. 3 companies, 3 roles, and 2 organizational restructures later, I have found a career that involves both. Though, it only took me I learned what works and doesn't work for me and my teams, as well as, what I like and dislike compared to my strengths and weaknesses, especially among changes in organizational needs and structure.

    This short and sweet talk will be an overview of my journey and leave attendees with characteristics of each role to help them decide where they might fit in this agile world and tips on how to talk to your boss about your next step.

  • Liked Dave Rooney
    keyboard_arrow_down

    Dave Rooney - #NoProcesses - Getting More Done By Doing Less!

    45 Mins
    Tutorial
    Intermediate

    You may have heard about the #NoEstimates movement, and even #NoProjects. Both of those concepts challenge the assumptions behind two key aspects of delivering software. But what about the process itself? Do we even need approaches like Scrum, Kanban or XP - let alone SAFe, LESS, NEXUS, DAD - in order to be successful? Is following a pre-defined process helpful at all? Is there a simpler way to be effective?

    This session examines the two key principles common to all successful software delivery approaches and builds out based on the experience of the participants. Like #NoEstimates and #NoProjects, the name doesn’t really mean to eliminate process altogether, but rather to build a process that works for your team, in your business domain, with your technology stack.

  • Liked Tyler Grant
    keyboard_arrow_down

    Tyler Grant - Words Matter: Building Trust and Dropping Jargon to Create Stronger Teams

    Tyler Grant
    Tyler Grant
    Scrum Master
    Capital One
    schedule 1 month ago
    Sold Out!
    45 Mins
    Talk
    Beginner

    Within the Agile and technology communities, it can be easy to assume that the language we use every day is common knowledge and shared throughout our professional spaces. Certainly when we interact with other professionals and hear them using the same terms, this just reinforces our assumptions. Especially when we leave the boundaries of technically specific language and enter the realm of jargon or “buzzwords” it can be easy to find validation through other people’s language preferences.

    However, using this type of language can not only create divisions within our teams, it can obfuscate meaning, delay action, and create misunderstandings that can inhibit a team's ability to deliver. By examining the differences between jargon and technical language, we will look at how this use of language can create in- and out- groups and break down trust within an organization.

    By committing to using broadly understood language and being direct in the way we interact with each other, we can improve our ability to perform at a high level in the fast paced technology space.