Agile Assessment: Helpful Remedy or Harmful Toxin?

Agile is a set of values and a mindset. As such, it can be hard to answer questions that leadership often asks. These questions include: How agile are we? Are we getting more agile? What are the growth opportunities for our team? To address this customer desire, there are now many assessment frameworks available in the Agile space.

Many organizations use assessments to determine their level of agility. This session will introduce several assessment approaches and tools. Like medicine, when used incorrectly, the results can be toxic. We will explore the merits, potential uses, and possible downsides of each approach.

You will leave this session understanding more about your options, as well as insights for framing an assessment that fit your needs best when trying to measure your organization's culture and teams.

 
 

Outline/Structure of the Talk

This session is intended to get participants thinking critically about assessments, the options for assessing "agility," and the potential pitfalls of various assessment methods. In the last three years, I have spent a significant amount of time delivering assessments for clients. During this time, I’ve seen clients with several different desires; a desire to scale, a desire to deliver more reliably, and a desire to figure out why “agile” doesn’t seem to be working for them. I have helped companies understand their current situation and challenges by using various assessment methods.The assessment approach has evolved from one that was primarily based on interview and observation to one that incorporates electronic data collection. The electronic data collection is complimentary to interviews and observations—not a replacement.

Minutes 1-5 Introduction of myself and the topic

Briefly answer the questions:

Who am I?

Why do I have authority on the topic?

I'll draw parallels between non-invasive assessments (weight, blood pressure) and invasive assessments of human health

We will also look at tools. Tools aren’t a weapon on their own but can become one if misused.

Minutes 6-10 Why do companies want an assessment?

They struggle to understand why agile hasn't led them to nirvana yet.

They want to know which teams are doing well and which are not

Sponsors may just be looking for an outside entity to tell them what they already know, but for which outside validation will add credibility to their own perspective.

Minutes 10-20 What are assessments good for?

A point-in-time snapshot

Generating a conversation

Highlighting strengths

Providing teams with additional information they might need for continuing to grow their agility.

Creating options

Feeding a continuous improvement process

Minutes 20 - 25 What should you not use an assessment for?

A replacement for critical thinking

Avoiding a conversation

Highlighting shortcomings

Explicit comparison of one team member to another.

Reward and punishment

Abdicating responsibility

A weapon that destroys psychological safety

Minutes 25 - 40 What is a good practice for conducting an assessment?

I share the phases:
  1. Planning
  2. Data collection
  3. Interpretation of results
  4. Action Planning
I share strategies for helping ensure that:

Safety exists

People are willing to engage in the assessment.

Curiosity exists. The organization is truly trying to understand how to improve, versus judge.

No one perspective will give you a good understanding.

Need to look at organizations from different levels,

Includes the objectives of various groups and individuals

Looks at multiple functional areas,

Explores how groups interact and the how they respond to change.

Combining elements of all the above. This will show how we have used various approaches to gain a truly multi-faceted perspective on agility within an organization.

I plan to handle any questions throughout the session.

Learning Outcome

Upon completion of the session, attendees will be able to:

  • Articulate the reasons organizations invest in assessment
  • Explain the possible benefits of assessment
  • Explain the possible unintended consequences of assessments
  • Recognize assessment approaches that may damage team safety
  • Apply the information from this session to their own organization's agile journey

Target Audience

Leaders and managers interested in understanding good practices for assessing agility.

Prerequisites for Attendees

Bring your open mind and curiosity.

schedule Submitted 1 year ago

Public Feedback

comment Suggest improvements to the Speaker

  • Liked Ellen Grove
    keyboard_arrow_down

    Ellen Grove - Making our Mark: Drawing Together to Enhance Collaboration

    90 Mins
    Workshop
    Beginner

    Co-creating drawings helps teams enhance their systems thinking abilities by really seeing the big picture. A group of people talking around a whiteboard is an effective way to share ideas across a team. Imagine how much richer the conversation is when everyone on the team has a marker in their hand and is actively contributing! Graphic visualization is an important tool for talking about new ideas, generating insights and developing shared understanding. In a team context, drawing is a thinking tool rather than an artistic endeavour. When everyone participates in creating drawings, all team members can see how things fit together and what mental models are at play in defining the situation. And, by drawing together, the team is collaboratively creating meaningful records that are being validated and updated.

    Come along on a visual adventure into how teams can collaboratively visualize ideas and make sure that everyone at the table has a voice. In this workshop, we will warm up with some basic doodling skills practice. No drawing experience is required to take part in this session: if you can hold a marker, we can teach you the skills needed to put your ideas on paper. Together we'll consider the ways that collaborative drawing can be used to enhance group work, and we will share practical activities that you can take back to use with your team for setting the stage, gathering information, and sharing stories.

  • Liked Lee Elliott
    keyboard_arrow_down

    Lee Elliott - How to #FAIL at Agile

    Lee Elliott
    Lee Elliott
    Director of Agile
    Prodigy Game
    schedule 1 year ago
    Sold Out!
    40 Mins
    Talk
    Beginner

    “Are we Agile yet?”, “Of course we are agile, we stand up every day”, “We have a hybrid Waterfall/Agile technique”. Do any of these sound familiar to you?

    After several years at multiple organizations it is interesting to find the same mistakes being made over and over again. This talk will discuss the various ways that your company can fail at agile and what you can do about it.

  • Liked Dave Sharrock
    keyboard_arrow_down

    Dave Sharrock / Melissa Boggs - Don’t Panic: Stories of Cultural Change

    60 Mins
    Talk
    Intermediate
    Don't underestimate the power of your vision to change the world. Whether that world is your office, your community, an industry or a global movement, you need to have a core belief that what you contribute can fundamentally change the paradigm or way of thinking about problems.
    -- Leroy Hood
    You can’t attend an agile conference these days without hearing about organizational culture. Cultural change is not optional for most organizations that want to become more agile. Agility requires a mindset that means many will have to change their traditions, habits, and behaviors.
    But culture is difficult to work with. It’s intimidating; We begin to panic, asking ourselves: “Why do I feel powerless to affect change in my organization? What does it say about me or my org? What does it say about the likelihood of me being able to make these positive shifts outside my team?” and ultimately we may talk ourselves out of any change at all.
    However, wecaninspire others to see the value in the change. Creating sustainable cultural change means creating a movement within your organization, and this is done one story, one experience at a time. Learn how to recognize your existing culture, identify the areas that require evolution, and create a movement that inspires change.
  • Liked Gaël Rebmann
    keyboard_arrow_down

    Gaël Rebmann / Barbara Schultz - Gam'Inception: learn how to build serious games by playing serious games

    60 Mins
    Workshop
    Beginner

    Gam'Inception is a game made of games to learn how to create games... Sounds funnier than dreams in dreams in dreams, don't you think Mr. Nolan?

    By playing three serious games, attendees will learn why serious games are a very efficient way to discover new concepts, mechanisms or tools and that everyone is able to build her/his own ones:

    • Attendees will have to face me in a drawing duel. Be prepared, I'm almost as good with pens than with ASCII art:
      _██_
      ( • ̮ •)
      ( . • . )
      (... • .. )
    • Then, they will travel in time, to Venice, the city of Doges, for a mix of Game of the Goose, a game book and an escape game
    • Finally, they will participate to Top Chef (at least my version of the show...) and will find their own recipes to cook their own games

    The workshop is almost entirely interactive and requires no prior knowledge about serious games (you don't even need to know what a serious game is). At the end of the session, attendees will have learned:

    • how a serious game is structured
    • which steps are essential to building a serious game
    • which steps are 'nice to have' when they build a serious game
    • that they are way more qualified to build their own serious games than they thought
    • how efficient a serious game is to learn new things
    • how highly corruptible I am


    Note that I always try to co-present with Leonardo DiCaprio but, sometimes, he is too busy to come ;-)
    I hosted it successfully several times in Europe (Agile France, Agile Tour Paris, Xebicon and smaller events) last year so the structure is solid.

    Slides, in French, are available here. The workshop (and its slides) will, of course, be in English with the possibility for attendees to ask me anything in French if they are more comfortable with this language

  • Liked Martin Aziz
    keyboard_arrow_down

    Martin Aziz - "When do you need it by?" Business-Agility Metrics in an Agile World

    Martin Aziz
    Martin Aziz
    Principal Consultant
    SquirrelNorth
    schedule 1 year ago
    Sold Out!
    60 Mins
    Talk
    Intermediate

    “When will it be done?” is a question asked in just about every business I’ve encountered, Agile or otherwise. In this metrics-focused session we will explore why that question is so hard to answer and whether it is even the right question to ask.

    We will explore current thinking about measurement in knowledge work fields. How every business needs to identify their own appropriate metrics to measure for their own business challenges and goals. While metrics are always unique for each individual business context, we will identify 4 metric categories identified from the Fit for Purpose framework.

    To connect these concepts to your Agile organization we explore going past looking at measurement as a team phenomena and connect this to the level of services or value streams.

    Digging further we continue to examine questions around measuring and predicting delivery times. We contrast prediction approaches using deterministic methods vs probabilistic methods. And consider multiple sources of variability that make predictions challenging and often impossible.

    We conclude by considering more appropriate questions to replace “When will it be done?” Rather asking “When do we need it” followed by “and so, when should start?”

  • Liked Eric Landes
    keyboard_arrow_down

    Eric Landes - Quality is Job One - Ensuring automation in your teams quality process

    Eric Landes
    Eric Landes
    Sr. DevOps Consultant
    AgileThought
    schedule 1 year ago
    Sold Out!
    40 Mins
    Talk
    Intermediate

    To increase the speed of delivery, your team needs test automation! Eric walks through scenarios to help increase your test automation. Scenarion 1 - Helping your team jump start unit testing a legacy application, Eric shows how to start introducing test automation into your release pipeline. Scenario 2 – We hate TDD - Eric walks through a strategy to help a team resistant to Test Drive Development/Design that helps introduce this practice. Eric then takes questions on increasing test automation to improve pipeline quality

  • Liked Michael Sahota
    keyboard_arrow_down

    Michael Sahota - Wave 2 of Agile: Living The Agile Mindset

    60 Mins
    Talk
    Intermediate

    Wave 2 of Agile is a way to understand the high-performance results that come from Being Agile. We know many in our industry have fallen into the trap or “Doing Agile” – where people lose sight of the objectives and lasting results.

    Wave 2 is about Living Agile. It is how we show up. It is how we work with people and organizations to shape the Culture. It is living Mahatma Gandhi's truth:

    “Be the change that you want to see in the world”.

    When we focus on our own behaviour, we model Being Agile. This is the only way to invite the Agile Mindset. This is Wave 2 Agile. We stop creating conflict and resistance. We become the effective leaders and influencers of lasting change in our organizations.

    “To be or not to be? That is the question.”

  • Liked Savita Pahuja
    keyboard_arrow_down

    Savita Pahuja / Mariete Sequera Hernandez - Empathy Driven Product Vision – the art of creating an impactful product vision using emotions and magic of visual effects

    40 Mins
    Talk
    Beginner

    "Customers don’t buy products, they hire products to do a job” – Clayton Christensen

    • Are your customers ready to buy your product even before you release it?
    • Are your customers inspired by your product?
    • Is your product vision aligned with your customers’ needs?
    • Does your product vision motivate your team?

    Join us to experience a new way of creating an empathy-driven product vision, a powerful tool to start your journey of creating the right products or services. Experience the power of Emotions inspired by Human-Centered Design concepts, iterative feedback loops, and Visual creativity.

    With this approach, customers and team are involved and convinced with your product or service right from the start.

    A few benefits of empathy-driven product vision are:

    1) Seeing Is Believing: visualization has a better impact on the mind

    2) Easy to understand and getting feedback from the customers

    3) Helpful for marketing and sales to think of their product strategy

    4) Empower team to be focused for the product goal in their whole development cycle

    5) Helpful for start-ups to pitch a new product idea or invention to a potential investor

    6) The team understands better, the vision of the new product initiatives by the company

  • Liked Cherie Silas
    keyboard_arrow_down

    Cherie Silas - Power Coaching – Pushing the Boundaries to build better teams

    60 Mins
    Talk
    Intermediate

    Elevator Pitch

    Sometimes teams need more than just questions. They need scrum masters and coaches who are courageous enough to have the hard conversations, challenge their decisions, push them to the next level. During this session we will introduce participants to some anti-patterns that have arisen in the scrum master and agile coaching communities and discuss ways to break free!

    Description:

    Coaching Agile Teams is all about asking questions and allowing them to self organize, right? Well, that's just part of the mission. During this session we will introduce participants to some anti-patterns that have arisen in the scrum master and agile coaching communities and discuss ways to break free!

    Sometimes teams need more than just questions. They need scrum masters and coaches who are courageous enough to have the hard conversations, challenge their decisions, push them to the next level. However, sometimes we push our teams a bit too hard and create negative conflict. It's times like this when we need to demonstrate how to reach out and make the first move to repair the relationship. We will introduce the concept of repair bids to help in this area.

    Lastly, we learn a model to put into practice to create a coaching alliance with teams so you can be in agreement on how you will work together for their best interest and improvement over a period of time.

    The reason we chose to create this session is that over the past few years we have noticed that as people are learning more about coaching they are getting out of balance and believing that the only thing that coaches are allowed to do is ask questions. We've noticed that scrum masters lean so far in the direction of self organization that they no longer believe they can challenge teams to grow or to move beyond where the team decides to be. We believe that the root of the problem rests in the fact that people are learning a bit about coaching but not actually learning how to be a coach. We would like to introduce to the attendees the more direct coaching methods that are available for use such as 1) direct communication, 2) challenging, 3) courageous questions that push the edge of the comfort zone, etc.

    Session is collaborative and includes interaction with the participants throughout. Also has collaborative exercises.

  • Liked Daniel Doiron
    keyboard_arrow_down

    Daniel Doiron - Tameflow : The Real Kanban - The Path to Hyper Performance

    Daniel Doiron
    Daniel Doiron
    President
    Agile Agonist
    schedule 1 year ago
    Sold Out!
    40 Mins
    Talk
    Advanced

    In today's agile, scaling of any framework comes with its own ... framework! Not so with Real Kanban as the scaling approach is to simply do more of it.

    The Real Kanban approach from Steve Tendon supports all flows - Operational, Financial, Informational & Psychological - by proposing the exact same models at the team, project, portfolio and enterprise level. Talk about robustness !

    Operational Flow (How well are we delivering?) deals with reducing cycle time so that work in progress does not stall in the system accumulating costs. By reducing cycle time - the time an item spends in the system - Operational expenses are trimmed leading the way to more productivity.

    Financial Flow (How much wealth are we creating?) recognizes throughput - the number of unit coming out of the system per unit of time - as the ultimate economic indicator for sales. Having a healthy beat is key to financial health.

    Informational Flow (How well are we communicating?) uses visualization and metrics from the Theory of Constraints and Throughput Accounting to ensures system thinking behavior and alignment.

    Psychological Flow (How happy are out people?) - The Real Kanban approach also allows employees to increase their skills and capabilities with WIP control, so that they can tame by themselves the boundaries of boredom and anxiety to always find a way to better themselves at their pace with the ever present slack existing in a Kanban system. The benefits - psychological flow - resulting from this system thinking's approach is to leverage the consciousness level and lead to continuous improvement by supplying metrics that guide each decision.

    Teachings from Queuing Theory, Tameflow, Real Options and other fascinating Kanban and Lean tools will be presented.

  • Liked Sam Tabbara
    keyboard_arrow_down

    Sam Tabbara - End to End Enterprise Agile Program Delivery, yes even in large regulatory initatives

    Sam Tabbara
    Sam Tabbara
    Portfolio Lead
    Agile By Design
    schedule 1 year ago
    Sold Out!
    40 Mins
    Experience Report
    Intermediate

    A walkthrough of my experience as a portfolio coach leading teams of agile coaches supporting large (60million+, 120person+) regulatory programs in the financial services industry.

    Comparing the similarities during my time leading a team of transformation coaches and scrummasters delivering customer-facing new technology at Bell, in the regulated telecom space.

  • Liked Robert Pieper
    keyboard_arrow_down

    Robert Pieper - Financing Agile Delivery with Forecasts

    Robert Pieper
    Robert Pieper
    CEO
    RESPONSIVE ADVISORS, INC
    schedule 1 year ago
    Sold Out!
    60 Mins
    Talk
    Advanced

    Your team’s been trained to deliver new features in a short time frame. You’re estimating work using abstractions like “story points”. The predictability and quality of delivery has improved. However, every December you’re still asked to estimate large initiatives for annual budgeting. Something doesn’t make sense and you’re having a hard time explaining it to senior leadership.

    Those funding projects are trying to invest wisely and mitigate risk. They need to understand what to fund and what to avoid while looking at scary numbers. However, they’re still using conventional methods of mitigating risk with big plans and committed dates.

    How agile can your organization be when budgets are designed for large fixed cost, scope, and time projects? In this session we’ll talk about how to mitigate financial risk and improve return on investment by working in smaller batches. Join us and learn how you can start forecasting!

  • Liked Sam Falco
    keyboard_arrow_down

    Sam Falco - Coaching Around Resistance

    Sam Falco
    Sam Falco
    Agile Coach
    AgileThought
    schedule 1 year ago
    Sold Out!
    90 Mins
    Workshop
    Intermediate

    When coaches encounter resistance to agile transformations, we often treat it as a phenomenon to be overcome, confronted, or combated. But resistance is a natural reaction to change, and that reaction can't be alleviated by violent opposition. Rather than meeting resistance head on, the clever coach will work around it by helping people recognize and resolve the negative emotions that drive it. Once those negative emotions are resolved, people are more likely to let down their guard and embrace change.

    In this interactive workshop, participants will learn how to identify common "faces" of resistance--behaviors that might indicate that a person is experiencing an emotional reaction to change. Participants will then work in table groups to identify strategies for helping clients recognize the emotional underpinning of their resistance. Finally, a role-playing experience will give participants the chance to practice coaching resisters to resolve their reluctance to embrace agile transformation.

  • Liked Adam Ulery
    keyboard_arrow_down

    Adam Ulery / Dan Neumann - What are your principles?

    90 Mins
    Workshop
    Beginner

    Many companies attempting Agile are not getting the benefits they hope for. I believe most of these companies are more focused on blindly following practices than living the agile principles. Many of these companies have not fully embraced the principles and some do not even know the principles! For an organization to reap the benefits that agile offers, it must live the principles. In this workshop, I'll teach you exercises and techniques to reset the people in your organization around the 12 Principles Behind the Agile Manifesto and the 4 Modern Agile Principles.