From Chaos to Clarity- Sustainable Test Practices for Continuous Delivery

In Agile Teams, Testing acts as a safety net and helps doing any kind of development and change seamlessly. The confidence when the Continuous delivery system give a Pass signal comes from the quality of the test . Test code lives as long as the code lives.

But strangely, though enough buzz  and importance is there on the continuous delivery, deployment and devops practices but some teams don't give equal priority to the deeper testing practices.

In this presentation Anish along with Rajith will explore the anti patterns of Agile Testing and provide overview about the Onion Layered Test Practice Map (Task, Story, Sprint, Release Level). Without good test practice and quality test, continuous delivery may only give false confidence.

 

 
1 favorite thumb_down thumb_up 14 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  • Overview about the Agile Testing
  • Some Anti Patterns of Agile Testing
    • Test is not everybody's responsibility
    • Dual Test Pyramid, Inverted Test Pyramid
    • Lack of Clean Test Coding Practices, False Alarms
    • Test Suite Organization and Orchestration in Deployment Pipeline
    • Automation Architecture not just tools
    • Test not designed for Infrastructure
    • No Explicit Hardening Phase
  • Agile Test Practice Map
    • Task Level
    • Story Level
    • Sprint Level
    • Release Level
  • Conclusion

Learning Outcome

  • Be constantly aware of the anti patterns of testing
  • Better Adoption of the Agile Test practice
  • Take the real benefits from the Continuous Delivery practices

Target Audience

Developers , Testers, Scrummasters

schedule Submitted 2 years ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • Tathagat Varma
    By Tathagat Varma  ~  2 years ago
    reply Reply

    Anish - we went thru your slide deck and the blog. Given that there have been presnetations around concepts in previous conferences, we were wondering if there are concrete examples (say from the work around Hadoop that seems to be shown in a few of the screen shots), it would make a great story - how exactly you found the issues in your deployment pipeline and what test practices helped you reduce the pain pints, and what were some of the hard metrics that show the results? Let us know if you think you can add some of that kind of practitioner examples to the session.

    • Anish Cheriyan
      By Anish Cheriyan  ~  2 years ago
      reply Reply

      Hi Tathagat,

       

      These practices are learnt from our experience in various projects related to embedded and application development. 

      We will add specific concrete examples for test code refactoring, test suite organization, automation architecture, deployment pipeline optimization with clear results for the respective project.

      But, I may require more time to update those examples in the slide deck. 

       

      Thanks and Regards

      Anish

       

      • Tathagat Varma
        By Tathagat Varma  ~  2 years ago
        reply Reply

        Anish - by when you can do it, not a very detailed one, but something that helps us understand what level of practical / real-life examples will be added?

        • Anish Cheriyan
          By Anish Cheriyan  ~  2 years ago
          reply Reply

          Hi Tathagat,

          I have updated the slides with some related examples.

          https://www.slideshare.net/secret/Cs6Ijt6hPrJQGr

          Our examples will be similiar lines:

          Slide 21 updated with the Layered framework in Mobile Device automation. Here we will add our experience of refactoring the complete test suite based on the updated framework.

           Slide 23 updated with the test suite organized from Hadoop as example.

           

          Regards

          Anish

        • Anish Cheriyan
          By Anish Cheriyan  ~  2 years ago
          reply Reply

          Hi Tathagat,

           

          I will add the practical examples by Monday 9th Nov.

           

          Regards

          Anish

  • Ellen Grove
    By Ellen Grove  ~  2 years ago
    reply Reply

    Hi Anish

    Great topic, and useful list of anti-patterns.  

    I notice you've tagged this as a tutorial - is there a hands-on element for the participants?  It's not clear from the outline.

    Thanks!

    Ellen

    • Anish Cheriyan
      By Anish Cheriyan  ~  2 years ago
      reply Reply

      Thanks for your kind words. We would be covering code samples for the applicable anti patterns.  Right now we have not planned for hands-on. So it is put as tutorial.

      • Tathagat Varma
        By Tathagat Varma  ~  2 years ago
        reply Reply

        Anish - thanks for your proposal. Do you have any specific case study where you might be able to demonstrate these anti-patterns in some of your work, and how did you deal with it as you proceeded to continuous delivery? That might be a great value to the audience as they can learn from a parctitioner point on view?

        • Anish Cheriyan
          By Anish Cheriyan  ~  2 years ago
          reply Reply

          Hi Tathagat,

          We will add case studies for most of the anti patterns.

          We will bring out the case study of teams where they followed all of the Agile test practices including the Automation Architecture and Deployment pipeline construction.

          I will try to add the slides for this and make the slides with case study ready.

           

          Regards,

          Tathagat

           

          • Tathagat Varma
            By Tathagat Varma  ~  2 years ago
            reply Reply

            Thanks Anish. Can we get a high-level deck / strawman of these at the earliest so the team can compelte the review and make a final call?

            • Anish Cheriyan
              By Anish Cheriyan  ~  2 years ago
              reply Reply

              Hi Tathagat,

               

              I have added the draft slides. I have added some examples at the end with respect to Test Automation architecture, Suite organization, Pipeline. Kindly note these are draft slides and will add more examples going further.

               

              Regards

              Anish

  • Naresh Jain
    By Naresh Jain  ~  2 years ago
    reply Reply

    Wondering if this should be part of Agile in the Trenches or DevOps and Continuous Delivery theme?

    Also can you please share an example of Agile Test Practice Map at these levels: Task, Story, Sprint and Release Level?

    • Anish Cheriyan
      By Anish Cheriyan  ~  2 years ago
      reply Reply

      Hi Naresh,

      Since we were explaining the anti patterns first and then the solutions, so kept in this theme. It can also be part of the Continuous Delivery theme.

      I have blogged the details with some examples in this blog:

      http://www.thinkinginagile.com/2015/07/agile-testing-practices-mapped-to.html

      Regards

      Anish Cheriyan