Case study: The magic of measuring agile adoption in a large organization

“Are we agile yet?”, “Can you get me some metrics on our agile adoption?”, “I want to measure the effectiveness of our agile teams, get me some metrics to do that.”!!!

These are scary questions that can get asked of you from your executives. We’ve all been there. What are you supposed to do? How do you (politely) tell them no, yet still provide your teams with information that will help them? Most importantly, how can we actually help a large set of teams understand their own journey towards adopting agile practices?

Chris and Lee have worked with over 70 agile teams and created an approach that allowed the individual teams to understand where they were on their agile journey while maneuvering through the minefield of executives that wanted performance metrics to hold teams accountable.

This session will be a review of what the challenges were during this process, how they were accepted and mitigated and how the teams were able to get good insight into their agile adoption and performance.

 
13 favorite thumb_down thumb_up 0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

Time

Topic

0-5

Introduction. What is this about? What is the challenge you are trying to address

6-15

Overview of what the survey was

16-25

Challenges in creating the survey and in managing executive expectations

26-35

Survey results - the minefield

36-49

Key learnings - what we would do differently next time

50-60

Questions from the audience & Wrap up

Learning Outcome

Through this session we hope to highlight some of the issues with measuring agile success while dealing with a management structure that wants performance accountability metrics. Additionally, we will share our experiences in creating, delivering and interpreting an agile survey at multiple organizations and why you should consider doing the same.

Target Audience

Executives, Agile Coaches, Analytics junkies,

Prerequisite

An understanding of agile and people management.

schedule Submitted 2 months ago

Comments Subscribe to Comments

comment Comment on this Proposal

  • Liked Gillian Lee
    keyboard_arrow_down

    Gillian Lee - Teams Want a Quick Game to Learn How to Deliver Value Faster

    90 mins
    Workshop
    Beginner

    Agile helps you to deliver what’s valuable to the customer faster. You can capture, prioritize, communicate, and deliver that value with good user stories. In our experience, a major impediment to writing good user stories in the real word is a lack of example stories. We have created a set of games that incorporate 80 examples of good and bad user stories. The games are easy to learn, play, and teach so that you can experience good user stories in just a few minutes. Come play the games and then share them with your friends and co-workers!

  • Liked Sue Johnston
    keyboard_arrow_down

    Sue Johnston - It's Not About The Tools: Facilitating Effective Meetings Across Distance

    40 mins
    Talk
    Intermediate

    A face-to-face conversation is the most efficient and effective method of conveying information to and within a development team. So states the sixth principle of the Agile Manifesto.

    Reality comes with a big "however." Work-at-home, outsourcing and inter-company partnerships mean that, more and more, we find ourselves n meetings where other participants are not in the same room. They may be around the corner or around the world. Some organizations invest in powerful tools to make this arrangement work well - or, sometimes, not so well. Others make do with audio only. Are we fooling ourselves when we call these events "meetings?" Maybe. Yet they're part of our world, so why not make the most of them?

    In this lively session, you'll examine a proven pattern for facilitation, discover ways to overcome the challenges of virtual meetings and learn techniques that encourage meaningful participation. Most of these require more focus and ingenuity than expense.

    Sue will share some of the techniques she learned as a teleworking pioneer in the '90s and a trainer of coaches, via distance, since 2003. Join us to explore ways you can bring your meetings with remote participants to life and respect everyone's time - including your own.

  • Liked Sue Johnston
    keyboard_arrow_down

    Sue Johnston - Do Your Product Owners Speak A Foreign Language? Techniques for creating shared understanding

    60 mins
    Talk
    Intermediate

    Effective interactions, between product owners and designers and team members who develop and make those products real, are key to team, product and organizational success. It's reflected in the first value of the Agile Manifesto.

    Still, one of the chief complaints, from both the product side and the dev side, is poor communication. The list of irritants includes: lack of clarity, lack of understanding, lack of time, lack of access, too many meetings, too much jargon, too many badly written user stories and too many people involved.

    Communication isn''t the only obstacle, but it’s a big one - and it can be overcome with no cost or organizational disruption.

    Regardless of the role we play on the team, part of everyone’s job is to create shared understanding. In this session, Marilyn, an experienced product owner and product manager, and Sue, a communication specialist and coach, will share their research about communication gaps in the product-development relationship and approaches that can close the gap.
    Join them to explore tips and ideas to improve communication flow and help teams move from concept to cash.

    NOTE TO TAC TEAM
    Because we are doing some original research on this topic, I would like to include a co-presenter, Marilyn Powers, PEng, who, at the time of posting, is not yet on confengine. Info about her is available at https://www.linkedin.com/in/marilynpowers

    Here is more biographical info about Marilyn:
    Marilyn has more than 10 years experience bringing products and services to market as a Product Manager. As a licensed professional engineer, she has experience working in a variety of fields, from manufacturing to operations to simulation to SAAS software. Currently, Marilyn is a Product Manager at D2L, a leading Ed-tech company, where she works closely with Product Owners, Dev teams, Designers, Senior Leaders and many other stakeholders to deliver quality software tools to educational institutions and corporations who value learning and development. Her expertise is creating shared understanding between diverse groups, be it external customer advisory groups or internal stakeholders.

    Previous presentations or workshops
    Marilyn has presented at a variety of conferences over the past 20 years, the career highlight of which was a live demo on the main stage keynote at the D2L Fusion 2016 conference. Other conference presentations included Online Learning Conference ( New Orleans, LA 2017), Fusion (2015, 2016), Learning Impact Leadership Institute (San Antonio, TX 2016), Industrial Engineering Student Conference (Kitchener, 2016), ModSim World Canada (Montreal, 2010), Montreal Neurological Institute Day (Montreal, 2009), McGill University invited speaker on Haptics (Montreal, 2006). Prior to these presentations, Marilyn was an Instructor of Engineering at Mount Royal University in Calgary, AB.

  • Liked Gillian Lee
    keyboard_arrow_down

    Gillian Lee - Minutes to Pin It: How to Get Your Whole Team Agreeing

    90 mins
    Workshop
    Intermediate

    What if your team could share new ideas and make unanimous decisions in minutes?

    Agile teams need to create and agree on many things such as a definition of done, a sprint plan, and what changes they’ll try in the next sprint based on the most recent retrospective.

    How often have you participated in a meetings where few decisions were made? Or where the the loudest person in the room made most of the suggestions and dominated your team’s decision making?

    In this interactive workshop, we will practice coming up with new ideas using everybody’s suggestions and making decisions that the whole team agrees on.

    Learn and practice techniques such as Fist-of-Five, Decider Protocol and Resolution Protocol and Shared Visioning with Lego.

    Make group decisions faster, more aligned with the whole team, and more likely to result in follow-through.

  • Liked Ellen Grove
    keyboard_arrow_down

    Ellen Grove - Asking Over Telling: Using Humble Inquiry to Build Great Teams

    90 mins
    Workshop
    Intermediate

    More asking, less telling. As an agile leader, adopt the approach of humble enquiry to build relationships, increase trust and collaboration, and deal with the challenges of organizational transformations.

    "Humble enquiry is the fine art of drawing someone out, of asking questions to which you do not already know the answer, of building a relationship based on curiosity and interest in the other person." - Edgar H. Schein

    Working in an agile way asks us to rethink how we relate to each other as we tackle complex problems and challenge the traditional structures of our organizations. Humble enquiry - the art of asking instead of telling - is a critical skill for agilists who seek to improve collaboration and address difficult problems head on. Inspired by Edgar H. Schein's book 'Humble Enquiry, this workshop will teach you the fundamentals of how to do more asking and less telling. Through mini-lectures and interactive exercises, we'll discuss the different types of questioning, consider the forces around and within us that inhibit our ability to ask instead of tell, and examine how this powerful technique can improve collaboration within agile teams as well as help to address some of the challenges of agile transformations.

  • Liked Charles Maddox
    keyboard_arrow_down

    Charles Maddox - Success Patterns with Scaling Lean-Agile

    Charles Maddox
    Charles Maddox
    Principal
    The i4 Group
    schedule 2 months ago
    Sold Out!
    40 mins
    Talk
    Intermediate

    From actual field experience helping organizations with adopting Lean-Agile at scale, I have observed some patterns of success and anti-patterns that I would like to share. These patterns have to do with how Leadership and the Lean-Agile Center of excellence contribute successfully or unsuccessfully for success at scaling. We discuss how they both need to exhibit some fundamental areas of leadership that are referenced directly from the book The Leadership Challenge, by Kouzes and Posner. In the session, we will discuss the areas of leadership referenced in the book and how they come to life successfully and sometimes unsuccessfully in the organization. The examples that are given the session in tandem with the book can be used as a clear guide on scaling success in the large enterprise.

  • Liked toddcharron
    keyboard_arrow_down

    toddcharron - Change My View: Moral Foundations Theory and You

    60 mins
    Talk
    Advanced

    Anyone who doesn't agree with me is wrong and not just wrong, but morally repugnant and evil.

    What do you think? Is it really likely that everyone that disagrees with you is somehow a monster? Or perhaps it's something else...

    Over the last few years we've seen a lot of viewpoint polarization. But why does this happen? And what does this tell us about our approaches to Agile?

    In this session we'll look at Moral Foundations Theory and how what we value and hold dear can influence our views on an issue.

    We'll also play a game developed at the Agile Games conference based on this framework that will challenge you to take yourself out of your normal comfort zone and see the world from another perspective.

  • Liked toddcharron
    keyboard_arrow_down

    toddcharron - I'd Buy That For A Dollar

    60 mins
    Talk
    Beginner

    What happens if we build it and they don’t come?

    Building features no one cares about is not only bad because the feature isn’t getting used, but is also a wasted opportunity that could have been used to build something truly valuable for your customers.

    But how would we know?

    In many companies, features get prioritized by the HiPPO principle (Highest Paid Person’s Opinion). As it turns out, this is often not the most effective way to prioritize your backlog.

    But if not this, then what?

    In this workshop we explore what value is, how to talk about it, and how we might measure the value we have achieved.

  • Liked Steve Zhang
    keyboard_arrow_down

    Steve Zhang - The Joy Of Functional Programming

    Steve Zhang
    Steve Zhang
    Development Practice Coach
    Scotiabank
    schedule 2 months ago
    Sold Out!
    60 mins
    Talk
    Intermediate

    The popularity of Functional Programming is booming! Are you still wondering what all of the fuss is about? Come to this session and find out! This is an introduction to the power of functional programming. It covers functional programming's basic concepts, and shows you how functional programming will make software simple, elegant, easy to test, and lead to cleaner code. I will share my experiences learning, so you can avoid some of the pitfalls. So if you enjoy coding, love clean code, then you should start learning Functional Programming right now.

  • Liked Mishkin Berteig
    keyboard_arrow_down

    Mishkin Berteig / David Sabine - JIRA is the Worst Possible Choice

    90 mins
    Workshop
    Intermediate

    A rant, with evidence, on why electronic tools in general, and JIRA in particular, are anti-Agile. Participants will use the Agile Manifesto to evaluate the electronic tools they are currently familiar with. JIRA is used as a case study.

    NOTE: Scrum asks us to have courage. The Agile Manifesto asks us to value individuals and interactions over processes and tools. I hope the organizing committee will consider this proposal despite the risk that it might offend some tool vendors. If we can't speak freely about our experiences with tools, we will fail as a community.

  • Liked Howard Deiner
    keyboard_arrow_down

    Howard Deiner - How We Get Agile Transformations Wrong By Trying to Do It All So Right

    60 mins
    Talk
    Intermediate

    Sorry to say it guys, but Agile has gone limp over the last few years.  As we get more and more coaches into the mix, both external as well as internal, organizations somehow have forgotten that it’s software that we’re trying to produce.  Not great stand-ups.

    Technical practices matter.  In fact, if we could dispense with ALL process and still create the valuable quality software that is needed, we should do that.  From a Lean perspective, process adds no customer facing value.  But getting rid of all process is crazy talk.  Even Fred George, who promoted “Programmer Anarchy” several years ago never got away from all process.  In reality, his movement was premised on driving business decision making directly into technical decision making, and completely empowering teams to “be” the company.  He premised the concept of “Programmer Anarchy” on using the best and brightest developers out there, and trusting that if they could do something as difficult as create great code that they could do the business decision making as well.

    But perhaps we don’t have the absolute best talent out there.  Perhaps it’s hard to lure people away from Google and Facebook because of the money and the chance to get great work environment and unbelievable work challenges (change the world, anyone?)  Does that mean that we have to go back into the Fredrick Winslow Taylor world view of “The One Best Way”?  With that way becoming making a choice between Scrum, SAFe, Lean/Kanban, and other development processes?

    I’d like to convince you that what’s going to work for your organization and your employees is something in the middle.  I, of course, lean into the “better technical practices will yield better outcomes” frame of mind.  You may as well.  But when Garrison Keillor said, on “A Prairie Home Companion” (a long running radio show on National Public Radio in the States), “Well, that's the news from Lake Wobegon, where all the women are strong, all the men are good looking, and all the children are above average”, that was satire!  And the same is true of your organization.  It can logically be true that all organizations’ developers are all above average.  But we can hold people to an acceptable level of technical practices that will yield in writing better code than merely having a process that talks about writing better code. 

    This session will speak to the specifics of the whats and whys.

  • Liked Dave Dame
    keyboard_arrow_down

    Dave Dame / Aaron Sampson, PMI-ACP, ITILv3, SMC - Design Thinking for Organizational Change

    40 mins
    Talk
    Beginner

    We all know how people use design thinking to create better products and deliver delightful experiences to our users. However, design thinking can be an excellent tool to use for organizational change. In the case of organizational change, our product is the change that we are trying to drive, and our customers are those people who are impacted (internally and externally) and have to live with that change. In the same way that design thinking puts the user front-and-centre for products, it can be used to put people in the organization front-and-centre. In this talk we will discuss how design thinking works and, as a case study, how we have applied it at Scotiabank to help drive adoption of the Bank’s NPS customer insights into building solutions that serve our customers. In that program, previous internal processes were ineffective in pushing relevant data to delivery teams at the right time. Using a Lean or Agile approach would have provided some benefit, but taking a design thinking approach uncovered an array of useful insights to make the whole process more purposeful. Learn from this example to explore how you might incorporate design thinking to drive greater effectiveness and relevance for your team’s body of work.

  • Liked John Le Drew
    keyboard_arrow_down

    John Le Drew - Swearing, Nudity and Other Vulnerable Positions

    John Le Drew
    John Le Drew
    Owner
    Wise Noodles
    schedule 4 months ago
    Sold Out!
    60 mins
    Talk
    Beginner

    Over 3 months John recorded over 75 hours of interviews and spoke to some of the most respected people in the industry to produce an audio documentary that attempts to answer the question “What is safety? And why is it important anyway?”

    This highly interactive talk will present the findings and guide and challenge you through a journey to understanding safety. Including short interactive sessions and role play exercises to cover the following topics:

    • What is safety?
    • What are the elements that make a team effective?
    • Is psychological safety the foundation to team performance?
    • What can we all do to help foster psychological safety in our teams?
    • What is the relationship between safety, stress and engagement?
    • What is the profound impact of a lack of safety and engagement on society?

    This talk has grown as John created the new podcast The Agile Path. The first season on this podcast is about safety in teams. John has interviewed world renowned specialists in the field; Christopher Avery, David Marquet, Jerry Weinberg, Esther Derby, Johanna Rothman, Woody Zuill and many more in over 75 hours of audio. This has been a fascinating deep dive learning experience for John and he hopes to explore these insights with the audience.

    Here is a short preview video I made for the session:

  • Liked Dave Sharrock
    keyboard_arrow_down

    Dave Sharrock - Epic Budgeting - or how agile teams meet deadlines

    Dave Sharrock
    Dave Sharrock
    Agile Coach
    agile42
    schedule 2 months ago
    Sold Out!
    40 mins
    Talk
    Intermediate

    According to this year's State of Agile survey, the most common success measure for agile initiatives, at 53%, is on-time delivery. But if agile teams can choose how much work they take into a sprint, how can teams be sure of delivering pre-committed scope on time and on budget? There is more to agile delivery than product owners ordering a backlog of work for teams to work on.

    Epic budgeting is one tool that allows the product owner to steer a product across the line, delivering the expected scope on time by managing scope creep or an unsustainable focus on the perfect over the pragmatic. During this session learn about how product owners and their teams work towards a fixed date or budget by applying double loop learning to epic sizing and breakdown. Expect some tales from real companies and a few light hearted moments. And I'm at least 53% certain we will finish on time!

  • Liked thomasjeffrey
    keyboard_arrow_down

    thomasjeffrey - Scaling Agile without the scaling framework

    thomasjeffrey
    thomasjeffrey
    President
    Agile By Design
    schedule 2 months ago
    Sold Out!
    60 mins
    Talk
    Advanced

    Increasingly Agile adoption has focused on how to operate larger enterprises with agility, and run larger and larger initiatives, at scale.

    In many cases, organizations have turned to explicit agile scaling frameworks to address their needs to coordinate increasingly larger efforts to deliver value in a way of that does not sacrifice feedback and self organization . Often these frameworks attempt to address the complexity that comes with large scale by adding extra process and procedure. Prescriptive advice is prescribed in the form of additional roles, stages, gates, and methods. This approach to scaling bears more than a little similarity to the heavy weight methods of the past, but in this case merging agile terminology with much of the same framework bloat and bureaucracy we have seen in the past.

    As a a result adoptees struggle to understand how to fit these frameworks to their context, and seasoned coaches struggle to wrestle out the good bits.

    During this session I will discuss a different approach to scaling agile, one that places an emphasis on both mindset and practice. I'll pay particular attention to the topic of leadership, organizational design, and the role management has to play in designing a system of work that allows larger efforts to work with an agile mindset without being forced into a one size fits all process framework.

    A key part of the discussion will be to showcase how core agile methods and techniques can be extended and expanded to successfully manage coordinated agile deployments that range from hundreds to thousands of FTEs. I'll present these techniques by using real examples of agile deployments I have been a part of during my work with ScotiaBank's agile journey.

    Key Scaling Practices covered will include:
    - The design components required to structure your organization based on demand
    - How to continuously de-scale your organization
    - "Get Out Of the Boardroom" style governance and leadership
    - Operational cadences and Impediment Escalation Flow
    - Managing the flow of value at the Business Technology Asset level
    - Moving the conversation from stories to domains
    - Streamlining finance and budgeting to align to the agile mindset

    I hope to illustrate ways that both management and knowledge workers can select techniques that allow them to scale agile as needed to support ever larger initiatives without succumbing to a one size fits all framework that does not adapt constant change.

  • Liked Andrew Annett
    keyboard_arrow_down

    Andrew Annett - Your Team Is An Object; What's its API?

    Andrew Annett
    Andrew Annett
    Agile Catalyst
    Leanintuit
    schedule 2 months ago
    Sold Out!
    60 mins
    Talk
    Intermediate

    We constantly talk about the value of communication but seldom in terms to which technical teams tend to relate. This session will use the object model, messages and the RESTful architectural style to examine how a development team might interact successfully (or not) with other elements in its system.

    We'll discuss systems thinking, message-based communication, software development as a service. To illustrate these ideas we'll map REST actions to team practices.

  • Liked Ann-Marie Kong
    keyboard_arrow_down

    Ann-Marie Kong - Growing leadership agility: How to cultivate leadership agility in our organizations and our lives?

    90 mins
    Workshop
    Beginner

    Why do we need leadership agility in today’s rapidly changing, interconnected, uncertain, complex world?

    What is leadership agility and how can we cultivate it in our organizations and in our lives?

    How is organizational agility constrained by leadership agility?

    Ann-Marie will lead you on an exploration of these questions and more. You will learn about staged growth development leadership and how taking an integral approach to our leadership produces more effective leaders.

    This workshop is based on the work of Bill Joiner & Stephen Josephs who authored Leadership Agility: five levels of mastery for anticipating and initiating change.

  • Liked Paul J. Heidema
    keyboard_arrow_down

    Paul J. Heidema / Iaroslav Torbin - Vital Behaviours of Successful Scrum Masters and How to Make Them Stick

    90 mins
    Workshop
    Intermediate

    Agile failure is most felt by Scrum Masters. Why do so many fail to properly support their teams? Why do so many fail to inspire meaningful change in the level of leadership? Why do so many fail to guide transformation in their organisations?

    In this workshop, we will harness the knowledge and experience of the participants!

    Influencer Book

    Why?
    Because everyone can contribute to the learning of the entire group. It will dynamic, full or energy, and joyful - woohoo!

    Who can benefit the most from the session and the power of harnessing the group?

    • Scrum Masters that are struggling to do this role well
    • Leaders that are not seeing the results needed for an effective Scrum team through a weak/unskilled Scrum Master
    • Agile coaches that are coaching Scrum Masters without meaningful or consistent results
    • Project managers trying to make the transition to becoming a successful Scrum Master

    This workshop will use concepts and the model from the book "Influencer"

    Prepare to work together to co-discover the Scrum Master vital behaviours!

    Many people are taking on the mantle of Scrum Masters across agile teams around the world. Unfortunately, many of them have come from more traditional work structures that don't develop effective Scrum Masters. There is a misconception about the purpose of a Scrum Master. Often the Scrum Master becomes the facilitator or the project manager. This has to stop. Effective leaders, agile coaches, and Scrum Masters take advantage of vital behaviours in supporting scrum masters or by building mastery within these behaviours.

    Influencer - the model

    During this workshop, participants will go through a series of exercises to identify the purpose of a Scrum Master, how we can measure success, identify potential vital behaviours, learn from others to determine the vital behaviours, and then create a sound influence strategy to enable effective Scrum Masters and the work that they do. This workshop will use concepts and the model from the book "Influencer" (by Joseph Grenny et all) which details the three (3) keys to a successful change initiative and uses the six (6) sources of influence.

    Prepare to work together to co-discover the Scrum Master vital behaviours!

  • Liked Shahin Sheidaei
    keyboard_arrow_down

    Shahin Sheidaei / Shawn Button - Community-Driven Change

    40 mins
    Talk
    Beginner

    Many organizations flatten management structure when they transform to agile. It soon becomes obvious that important activities done by managers are still needed.  A community can fill these gaps. They can provide morale, governance, learning, and mentorship, recruiting and hiring, mutual support, coordination, sharing, innovation and more!

    Unfortunately few companies manage to create a strong community. Even fewer empower that community to fill these gaps. This means they are missing the ultimate benefit of community: a strong, empowered community can transform the organization itself!

    Join Shahin and Shawn in this interactive session to explore communities in organizations. Examine the benefits of building great communities. Learn how to spark the community, and how to support it as it evolves. Hear stories of communities empowered to improve the organization. Learn how to make a community into a driver of positive change.

  • Liked Shuman Ip
    keyboard_arrow_down

    Shuman Ip - Richer in my wallet, poorer in our wallet?

    Shuman Ip
    Shuman Ip
    Scrum Master
    LoyaltyOne
    schedule 3 months ago
    Sold Out!
    60 mins
    Talk
    Intermediate

    Does your company do performance review?

    Since the goal of all for-profit companies is to make profit, how effect is performance review in actually contributing to your business goal?

    In this session, we will go through some activities to explore the hidden side of performance appraisal process, along with some story-telling and discussions on our perspectives.

    Last but not least, there will be some suggestions on things that we can do in place of the traditional performance review.

    If you want to unmask the mystery behind performance review
    If the current performance appraisal process is one of your pain points, or
    If you have experience and stories to share with us regarding performance evaluation, then come to this session and let's have a conversation