Retrospectives are great! They result in great process changes for a team to adopt to become more efficient.

But how do you determine when the process change adopted by one team should become part of the overall recommended practice for the organization?  What worked in one team very well might not be helpful or effective on another team, and at the same time, the organization needs to take advantage of the innovation happening at individual team levels and adopt the best ones as recommendations.

 

This talk will look at a more formal method of tracking the effectiveness of specific retrospective improvements and how to decide when to make team process changes into organizational recommendations. This will show how to us Bayesian Statistics to track the effectiveness of specific process improvements and setting threshholds for organizational wide recommendations can lead to a good process for organizational process improvement based on team successes.

 

Specifically, we will look at how to set up the process at the organziational level and the team level:

      What processes need to be agreed to?

      What changes in governance need to be agreed to?

      How to decide when to make recommendations?

      What changes should be made at the team retrospective level?

I will also discuss how this experiment is working and what we have learned from trying to adopt this methodology.

 

This method should be very helpful within organzations with high oversight and governance, such as the government, to allow for continuous process innovation while still maintaining concurrence from those bodies.

 
5 favorite thumb_down thumb_up 0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

Introduction to Bayesian Statistics and definition of experiments (15 Minutes)

Application of Bayesian Statstics to Agile process improvement (5 minutes)

Organizational structure for tracking and monitoring (5 minutes)

Changes at the team retrosepcive level (10 minutes)

Execution of the process (5 minutes)

Experiences at current organization (5 minutes)

Questions and feedback (15 minutes)

 

Learning Outcome

How to apply this new method at an organizational level to do continuous process improvement and bring team learning into the organization.

Target Audience

Agilists looking to adopt agile across an enterprise with many programs, projects, and teams; governance and oversight people; enterprise process imrpovement people

schedule Submitted 3 years ago

Comments Subscribe to Comments

comment Comment on this Proposal

  • Liked Richard Cheng
    keyboard_arrow_down

    Richard Cheng - Agile at the Office of Personnel Management: The USAJOBS Product Owner's Perspective

    Richard Cheng
    Richard Cheng
    Principal
    Excella Consulting
    schedule 3 years ago
    Sold Out!
    60 mins
    Talk
    Beginner

    The USAJOBS program was a highly visible, time sensitive program, with potentially high government dollar value. To effectively execute the project, the USAJOBS program decided on an Agile approach and in this approach, government program managers were identified to be Agile Product Owners. This session features the experiences, thoughts, and challenges facing the Agile Product Owners on USAJOBS. Key thoughts from this session include:

     

    1. The differences between Project Management and Product Management 

    2. Shifting from big up front planning to responsible up front planning combined with just in time planning 

    3. Managing Product Owner bandwidth expectations 

    4. The impact of Agile from a Product Owners view

     

    The session is hosted by the former USAJOBS Product Owner along with an Agile Coach.  The session will explore Product Ownership and Agility on Federal Programs.

    Bios:

    Alesia Booth grew up in Federal human resources - her first job was with the National Institutes of Health payroll office at 16 years old. Since then, she's managed websites, document libraries, corporate recruitment programs, staffing systems and hiring reform process change management activities. Which is she ended up at USAJOBS. Since then, Alesia moved to Department of the Treasury to be the program manager of the HR Line of Business CareerConnector product for classification and staffing. At Treasury, she continues concentrate on solving multiple agency recruitment challenges to bring the best and brightest talent into the Federal workforce. Additionally, she worked with Treasury Enterprise Business Solutions as a champion of Agile development and recruitment data standardization Government-wide. Alesia is now back at OPM leading OPM's USAStaffing efforts.

     

    Richard Cheng, Principal Consultant at Excella Consulting, provides consulting services to commercial and federal clients in the Washington, DC area. Richard coaches, mentors, and trains clients on understanding and implementing Agile and Scrum. He also leads Excella’s Agile Center of Excellence.  A graduate of Virginia Tech, Richard has authored several publications on project management, presented at Agile and PMI sponsored industry events, is a member of Mensa, and holds certifications including Certified Scrum Training (CST), Certified Scrum Master (CSM), Certified Scrum Product Owner (CSPO), Certified Scrum Professional (CSP), PMI Agile Certified Practitioner (PMI-ACP) and Project Management Professional (PMP).  Richard is a founder and on the executive committee of the Agile Defense Adoption Proponents Team (ADAPT).

  • Liked David Bulkin
    keyboard_arrow_down

    David Bulkin - Build Righter Stuff with HDD (Hypothesis Driven Development), a.k.a., HDD is TDD for the Business Case

    David Bulkin
    David Bulkin
    Managing Director
    Grow-Lean LLC
    schedule 3 years ago
    Sold Out!
    60 mins
    Workshop
    Intermediate

    With TDD (Test Driven Development) a coder writes a small test, and then just enough code to make the test pass, cleaning up the code along the way.  Imagine applying the same concepts to the business case.  Now stop imagining and use HDD (Hypothesis Driven Development) to test your business case and refactor it for success.

    Our hands on session will cover the basics of ATDD (Acceptance Test Driven Development) and BDD (Behavior Driven Development) to specify by example, so all stakeholders get on the same conceptual page, developers build what the business really wants, and testers can prove it. 

    But building what we want it not enough, so we will go further and use HDD to validate, or invalidate, business outcomes, focusing us on value instead of on adherence to specification.

    This is a hands on session, so come with pen, paper and a readiness to learn by doing!

  • Andrea
    Andrea
    Agile Coach
    Santeon
    schedule 3 years ago
    Sold Out!
    60 mins
    Workshop
    Beginner

    Project success =  f (listening, feedback, intentionality, practices) 

    To make your agile practices and processes come to fruition, you need to cultivate an environment that promotes listening, learning, inquisitiveness, intentionality and top notch feedback that everyone is comfortable with. 

    Agile projects succeed when there are frequent high-quality reinforcing feedback loops. I will share communication models based on Clean Language questions of David Grove and the Systemic Modelling techniques of Caitlin Walker that can greatly increase clarity, sense of purpose and listening skills within your team and collaborative endeavors.  These include: Clean Questions, Clean Feedback, and Clean Setup.

    This is a hands-on, try it out, concrete practice session.

  • Liked Wyn Van Devanter
    keyboard_arrow_down

    Wyn Van Devanter - A Thin Automation Framework for Managable Automated Acceptance Testing

    60 mins
    Demonstration
    Intermediate
    Automated Acceptance Tests (AAT) can provide huge value, and can automate time-consuming tasks like regression testing, but aren't easy to scale.  Have you tried implementing them only to abandon them later?  Are they fragile?  Do they give a lot of false positives?  Do they take more time to write than the value you're getting out of them?  These are common problems with automated acceptance testing, but there are ways to mitigate these issues.  One great way is to create a very thin automation framework that helps you write the tests faster while reducing the fragility.  Wyn will walk through writing a thin automation framework, illustrating a test-driven approach that yields a framework appropriate for the software being tested.  The resulting tests are very clean and readable, and they become faster and faster to write as the framework evolves.  He will use C# and Selenium but the concepts are applicable to other languages and browser automation frameworks.  He will also illustrate simple approaches that reduce the fragility and maintenance costs of the tests.  Participants will come away knowing how to get started on an automation framework that will be easy to understand and maintain, and that should scale as much as needed.  
  • Liked John Hughes
    keyboard_arrow_down

    John Hughes - Testing Inside Your Timebox: Death to the Hardening Sprint

    John Hughes
    John Hughes
    Director and Agile Coach
    Sevatec
    schedule 3 years ago
    Sold Out!
    60 mins
    Workshop
    Intermediate

    Testing sprints? Hardening sprints? Why do so many of us have these and other ways to get around completing all our required testing inside our defined timeboxes? Isn’t our goal to produce deployable features at the end of every Sprint?

    During our session, we will examine why it’s so hard to accomplish all necessary testing inside the iteration and show how to complete these tests within your timebox. Through interactive discussion and real world examples, we will provide insights on foreseeing, overcoming, and avoiding your hurdles and send you home with both long term methods and short term actions that will yield tangible results in achieving your goal.

    Our session will:
    • Illustrate the value of completing all of your testing inside your timebox
    • Identify the challenges in completing all these tests in such as seemingly short period of time
    • Discuss ideas and options to successfully overcome these challenges
    • Explore how to enable your organization and environment for efficient, rapid testing
    • Discuss real world examples of enablement and how we navigated the pain points of enabling testing processes that allow complete testing within an iteration
    • Explore DevOpsSec and how achieving testing within your timebox is a precursor to DevOpsSec
    • Provide short term tactics and actions to immediately improve your ability to complete your testing
    • Allow you to voice your concerns and challenges and discuss potential solutions to these impediments

    Most of us implement agile to reduce the time to deliver valuable working software and to increase the frequency of delivery with high quality through increased and earlier collaboration, shorter feedback loops, and reduced risk. While you can show improvement over Waterfall by performing typical agile methods, you cannot really live the dream without optimizing your agile execution.

    You will leave this session armed with the right knowledge to improve delivery on your current project or start your new projects properly so that you or your clients can reap the benefits of efficient process and high-quality software capable of achieving continuous deployment of fully-tested code at the end of each iteration.

  • Paul Boos
    Paul Boos
    IT Executive Coach
    Excella
    schedule 3 years ago
    Sold Out!
    60 mins
    Workshop
    Beginner

    So what does Collaboration really mean?  It's just ensuring people understand what each other is doing right?

    The Power of 13 Collaboration Game illustrates what true collaboration means.  We'll do work by rolling dice over a 3 week Sprint. We'll then explore the results and start our next Sprint. In each Sprint, we're going to increase the participation across players and see what the effect is on productivity.  Prepare to be surprised!

    Should there be enough time remaining in the hour; we'll then specifically apply true collaboration to better understand the effects of pair programming by playing Pair Poetry.  This simulates the power of pair programming and demonstrates why the one screen, one keyboard concept works.

  • Jason Tice
    Jason Tice
    Agile Coach
    Asynchrony
    schedule 3 years ago
    Sold Out!
    60 mins
    Workshop
    Beginner

    Agile and Lean principles call for teams to delay decisions and activities until the “last responsible moment” so as to minimize rework and waste.  While this sounds good in concept, sometimes teams fall victim to waiting until it is “too late” to make a decision or get started on a needed activity resulting in missed opportunities and/or down-to-the-wire heroic efforts to meet a deadline.  This workshop entails a competitive LEGO simulation where participants will divide into small teams, each team will be given the same simple LEGO build challenge, and then each team will be able to conduct their own experiments as to when the “last responsible moment” really is.  Following the LEGO build challenge, participants will engage in a debrief to discuss the outcome of the challenge, identify factors that helped to successfully identify the last responsible moment, establish linkages between the LEGO simulation and agile software development activities, and of course congratulate the winners of the challenge.  During the debrief, participants will complete a debrief worksheet to reinforce key learnings and takeaways from the simulation that they will be able to take with them from the session.  Best of all, this is a LEGO session, so you will get to play with LEGO and fun will be had by all!

  • Liked David W Kane
    keyboard_arrow_down

    David W Kane - Making Movies and Software at the Speed of Thought!

    60 mins
    Workshop
    Beginner

    Director Robert Rodriguez (Spy Kids, El Mariachi, Sin City) is an Agile Director. He enjoys making highly creative movies quickly and cheaply. His ambition is to make movies at the speed of thought. To achieve this goal, he works in small teams to develop the ideas, visualize them quickly, shoot the movie fast, and build the movie in layers. This workshop will introduce Rodriguez's approach to film making by screening several of his 10 minute flick school featurettes and we will explore how these techniques translate to Agile software development in a lively group discussion.

  • Liked Katy Saulpaugh
    keyboard_arrow_down

    Katy Saulpaugh - Agile Pushback: Change is hard. Changing to Agile is Harder.

    30 mins
    Talk
    Beginner

    Adopting Agile enables an organization or team to fundamentally change their operating ethos, empower team members and improve project outcomes - and yet those advocating that organization change to Agile are repeatedly confronted with “Agile pushback,” because it “will be too hard,” or say, because “it has always been done this way.”

    How can you use Change Management to help organizations embrace change and make successful Agile adoption?  The key to overcoming the Agile pushback and successfully adopting Agile is the intentional engagement of the 4Cs of Change management – Coaching, Commitment Culture and Communication.

    • COACHING: Using change management as a tool to deepen relationships that help you and the organization leads understand the steeped organizational concerns. This will simultaneously address the core concerns and pushback and while formulating Agile champions.
    • COMMITMENT: Engaging the team will increase commitment to the shift to Agile through a clearly defined mutual understanding of the opportunity of Agile.
    • CULTURE: Aversion to organization change of any size is often rooted in individual concern -- using change management to provide the organization that the change will not be easy but the outcomes will benefit reduce the self-concern and helping the culture understand the4 Agile will empower the culture
    • COMMUNICATION: Agile implementation, like Change Management, is based on intentional communication that clearly articulates roles and expectations – eliminating waste and inefficiency.

     

    Katy Saulpaugh shares her experience, successes and challenges when helping government and nongovernment organizations eliminate Agile pushback and increase Agile adoption. Katy will share case studies from both the public and private sector providing attendees with concepts, methods and change management tools that defeat Agile pushback and easily transfer to a current project or a future Agile adoption.

  • 30 mins
    Talk
    Beginner

    Agile methodologies originated with and gained recognition from software development projects. With an enviable track record of success, more and more organizations are adopting Agile as the standard approach to managing all types of projects.

    You rarely hear about the enviable track record of success managing Business Intelligence projects so you may find yourself thinking about using Agile on your next BI project. Once you decide to try Agile, it can be tough to know where to start. In this presentation, we will focus on the first major step in getting started: Assess the Current State.

    Before you embark on implementing Agile, a crucial path to success starts with knowing where you are today and where you want Agile to take you. The group will identify what we think are the biggest BI challenges. We will go through a provisional maturity model to determine what questions to ask and will discuss how those challenges may or may not be addressed by taking steps to increase your organization's Agile BI maturity.

  • Liked Philip Rogers
    keyboard_arrow_down

    Philip Rogers - Lean Coffee: Creative Uses of this Technique to Rapidly Surface Ideas and Encourage Team Collaboration

    Philip Rogers
    Philip Rogers
    Scrum Master
    NPR
    schedule 3 years ago
    Sold Out!
    30 mins
    Workshop
    Intermediate

    Lean Coffee is frequently used in meetup and conference settings. The beauty of Lean Coffee is its simplicity, and it is this very simplicity which makes it an appealing choice in various Agile team contexts. Specifically, Lean Coffee is particularly good for ad hoc training sessions and for retrospectives. The focus of this workshop will be on the use of Lean Coffee in these two types of settings, where we will split up into small groups and practice using Lean Coffee to cover ad hoc training topics and to do a mini-retrospective.

     

  • Liked Alexei Zheglov
    keyboard_arrow_down

    Alexei Zheglov - Lead Time: What We Know About It and How It Can Help Forecast Your Projects

    60 mins
    Tutorial
    Intermediate

    The session is about just one metric, but a very important one - lead time.  Simply put, lead time is the time between the start of work and delivery.  And there is a catch: if the work has to wait in a queue or if we switch from it to work on something else, the clock keeps ticking until we deliver.  Lead time has proven to be a difficult metric to game.  Even when people try, they often end up delivering faster, with less delay - win-win.

    We will look at examples of real-world lead time data for several different types of work from different companies.  We will discuss the very recent new insights into lead time distirbutions.  Those will then lead us to building useful probabilistic delivery forecast models for your process.  Building such models is surprisingly easy and takes surprisingly few data points.  The models, in turn, enable better decisions.

    Are your ready to embrace the probabilistic approach?

  • George Paci
    George Paci
    Agile Coach
    Santeon
    schedule 3 years ago
    Sold Out!
    30 mins
    Talk
    Intermediate

    Agile planning tools started simple: index cards, markers, and a table or wall. On many projects, for many reasons, these old stalwarts have been supplemented (or even replaced) by software solutions: Rally, VersionOne, Jira Agile, Trello, Trac, Scrumy, and literally dozens more, even BaseCamp. These tools have undeniable advantages over cardboard and ink in some aspects, but they're not superior in every situation.

    This session will highlight the pitfalls of centering planning meetings around software tools—even the best ones, like [your ad here]—and make a badly-needed sales pitch for index cards on a wall (compensating for Oxford's oddly anemic marketing effort). You'll see how cards can make better use of your team's time and brainpower, promote parallelism in meetings, and increase engagement by all participants.

  • Liked Shannon Ewan
    keyboard_arrow_down

    Shannon Ewan - The Art of Facilitating Agility

    60 mins
    Workshop
    Intermediate

    From an agile implementation perspective, emphasizing the art of facilitation is an incredibly powerful tool for creating a culture of collaboration, and then leveraging that culture as a springboard to organizational transformation.  With strong facilitators at the gateway between business and IT, within IT delivery teams, and at key intersection points within an organization, the challenges to achieving organizational agility diminish. Strong facilitators bring forth the wisdom of teams and provide a container for self-organization. Facilitation is the cornerstone of servant leadership. 

  • Liked Fadi Stephan
    keyboard_arrow_down

    Fadi Stephan - Techniques for Keeping Distributed Retrospectives Effective and Fun

    30 mins
    Talk
    Intermediate

    Are you working in a distributed team and feel like your retrospectives are failing to deliver meaningful results? Are you spending less and less time on them? Are your retrospectives becoming boring dull and uninspiring? Retrospectives are a key mechanism for continuous improvement. This is especially true with non-collocated teams that deal with additional impediments and barriers due to communication difficulties. Come to this session to reverse this trend and learn new tools and techniques to conduct distributed team wide retrospectives that keep everyone engaged and result in effective discussion and follow-up action items and continuous improvement.

  • Liked Joshua Seckel
    keyboard_arrow_down

    Joshua Seckel - No defects in a government setting? What does that really mean?

    60 mins
    Talk
    Intermediate

    We have heard a lot about no defects or zero defects, but is that reasonable or achievable in the government context?  How else can each sprint be deployable? Or how can you get to true flow with each story deployed to production?

     This session will explore how to get to a no defects posture across all of the tests required in a government setting. 

    We will look at the various types of testing:

    Unit, Functional, Integration, Security, 508, System, User Acceptance, etc 

    We will look at what defects mean and how (or if) they should be tracked

    We will look at what potential impediments from government organziations may exist in reaching a no defect state of software delivery

    We will look at what tools and techniques can be used successfully in the government setting to address the impediments and achieve no defects in released software

  • Liked Dave Chesebrough
    keyboard_arrow_down

    Dave Chesebrough - Considerations for Agile Adoption at the Team, Project, and Organizational Levels

    60 mins
    Panel
    Advanced

    Change is hard. For any organization, team, or individual, the ability to change is difficult even when the desire for the change exists. Some studies have revealed that even when people know they need to change, even at the risk of their lives, it is still difficult to adopt new practices and behaviors.  Knowing this, what are organizations and project teams doing to make agile adoption easier and how are they supporting the teams and the individual new to this way of developing software products and systems?

    Through a roundtable discussion with representatives from industry and government, we will share with you our experiences with Agile on Federal government projects and programs, the challenges we faced, lessons learned, and different activities we performed as we went through an agile transition. The intent is that our experiences will provide you with ideas that you can take back to your organization and teams to support your agile journey.

    The panelists will share their experiences in bringing agile to their own organizations as well to their government clients.  Topics to be addressed include:

    • What makes adoption easier?
    • Challenges faced and tactics to overcome them.
    • Lessons learned from a broad spectrum of successful, and unsuccessful, adoptions of agile methods in acquisition.

    Moderator:

    Dave Chesebrough, President, Association for Enterprise Information

    Panelists:

    Dr. Suzette Johnson, PMP, CSP, CSC, Certified (Agile) Scrum Coach, NGIS Technical Fellow and Chair of the Northrop Grumman Agile CoP.  Suzzette leads development of agile practices across programs serving government customers, including DoD and Federal Health IT. 

    Robin Yeman, Agile Transition Lead / SME, at Lockheed Martin where she defines Agile Strategy across capability areas at IS&GS; identifies and implements metrics to ensure results of strategy and enable course correction; develops Agile SMEs to support strategic consulting for program start-up, transition for waterfall, release planning, and execution; teaches and educates all levels at LM to allow LMCO to better meet customer needs; certifies large teams in the Scaled Agile Framework; and provides support in developing Performance Measurement Baseline and Agile EVM.

    Jerome (Jerry) Frese, Program Management Analyst at the Internal Revenue Service, is the organizer of an Inter-Agency Seminar whose purpose is to bring federal SDLC practitioners together so they can establish a network, learn about and share best practices and collaborate on new and innovative ways to support projects. Through the series of nine seminars he has worked with 33 other Government agencies fostering the implementation of agile in Federal IT. In his own agency, he brings 40 years of software development experience to his job the Senior Methodologist at the IRS.    

    James Barclay, Senior Systems Engineer, NGA Architecture & Engineering Group National Geospatial-Intelligence Agency.

  • Liked Roland Cuellar
    keyboard_arrow_down

    Roland Cuellar / Ken - IV&V for Federal Agile Programs: A Customer Experience Report

    60 mins
    Talk
    Intermediate
    1. Many federal government organizations have a requirement to perform independent verification and validation (IV&V) of software development projects for purposes of risk identification and compliance
    2. As more federal agencies move towards agile, they will need to devise agile-appropriate methods for evaulating agile teams and contractors for process performance and project risk identification
    3. Traditional approaches to IV&V are heavily biased towards waterfall, gate reviews, and traditional SDLC artifacts and hence, do not work well within an agile envrionment
    4. Agile programs have their own process-specific risks and issues that need to be evaluated uniquely.  The document-centric approach that has traditionally been used is innapropriate and ineffective for agile teams as it does not find the right risks and does not find them early enough in the development process.
    5. We at DHS/CIS have developed a unique, agile-appropriate IV&V model for a large agile transformation effort within DHS
    6. The model is used to discover process risks, design risks, code risks, and testing risks in real-time for agile teams
    7. The model serves as actionable and real-time feedback to teams, contractors, and federal managers that can be used for process improvement, vendor evaluation, and as a means to find and elevate delivery risks on agile projects
    8. Positive results, challenges, and recommendations related to the development, roll-out, and execution of this agile-appropriate IV&V model will  be shared
  • Liked Richard Cheng
    keyboard_arrow_down

    Richard Cheng - A Roadmap for (Agile) Engineering Best Practices – What Every Non-Technical Person Needs to Know

    Richard Cheng
    Richard Cheng
    Principal
    Excella Consulting
    schedule 3 years ago
    Sold Out!
    60 mins
    Talk
    Beginner

    Summary: Presenting a roadmap explaining engineering best practices, why it’s needed, supporting tools, level of effort to implement, and sequence for implementing.

    21st Century IT development requires building quality into our development practices yet many software teams fail to implement technical practices that are necessary for long term success. Practices like automated builds, automated tests, automated deployments, continuous integration, and continuous delivery are now considered essential for the success of any software development project. Without these practices, the quality of software goes downhill and teams can no longer sustain their initial high levels of productivity.

     

    However, understanding and implementing the practices can seem daunting.  This session presents an easy to understand roadmap for implementing engineering best practices.  The roadmap explains what the practices are, the tools that support the practices, a recommended sequence to implement, and effort to implement.

     

    Though this topic is about engineering best practices, attendees do not have to be technical to get value from this session.  The session gives a non-technical look at a technical concept and is great for any person in the organization managing, working with, or working on IT teams/programs.

     

     

  • Liked Doguhan Uluca
    keyboard_arrow_down

    Doguhan Uluca - Agile done right: Streamlined JavaScript and Node.JS

    60 mins
    Talk
    Intermediate

    Agile development is difficult. Teams can often miss their delivery goals; the unsustainable pace of development can result in fatigue; and technological bottlenecks can make it impossible to deliver a high quality end product. When done right Agile can enable your team to deliver a sustainable and consistent forward flow of features. To achieve this goal you must use technologies that discourages skill silos, are easy to work with and allow for the straightforward application of Agile Engineering Best Practices. JavaScript and Node.JS are the perfect set of technologies that can organically grow within your organization and existing code base utilizing a RESTful architecture. The web is the OS of this decade, and JavaScript is its native language. Creating a technology strategy that effectively utilizes JavaScript is essential to unlocking the full potential of your team and allowing for greater flexibility and reduced risk.