Did you work on a project where maintaining test suite was more painful than delivering new functionality? Let’s talk about the reasons of such non-deterministic test suites and some ways to fix it, so that you can trust your test suite again.

 
1 favorite thumb_down thumb_up 5 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

Some of us must have been on that one project, where your test suite was causing more problem than solving it. You change one thing, and hundred tests will fail. Your continuous integration build will fail randomly, but will pass if you just re-trigger it.

This eventually leads to people loosing all the trust on test suite. They stop adding tests, because it’s more painful than writing production code. They start ignoring failing test, because they fail randomly and nobody knows why. Everybody knows tests are now more trouble than help.

In this talk, we will talk about some behaviors and reasons which leads to this "flaky test suite" situation. What are some development practices, which can avoid such situation. And finally we will also talk about how to fix this situation if you already in it.

Learning Outcome

This talk will be most beneficial for people who have a test suite for their project.

If you are a developer or a QA, you will learn what are the practices you can follow to keep your test suite maintainable.

If you are manager, you can understand on which things related to test suite you should keep an eye on so that your team keep delivering functionality without slowing down because of tests.

Target Audience

Quality Analysts, Testers, Developers

schedule Submitted 1 year ago

Comments Subscribe to Comments

comment Comment on this Proposal
  • Brijesh Deb
    By Brijesh Deb  ~  1 year ago
    reply Reply

    This is a very good topic. Do you think 20 minutes would suffice?

    • Shirish Padalkar
      By Shirish Padalkar  ~  1 year ago
      reply Reply
      Well, I have given this talk and in general 30 minutes is a good time for topic. I think I can cut some slides to fit it into 20 minutes.

      Or do you think it should be 45 minutes topic?

      With regards,
      Shirish (http://twitter.com/_Garbage_)


      On Thu, Mar 31, 2016 at 2:35 PM, Global Test Retreat <info@confengine.com> wrote:
      Dear Shirish Padalkar,

      Your proposal Who will test your tests? has received a new comment from brijesh-deb

      This is a very good topic. Do you think 20 minutes would suffice?


      Visit https://confengine.com/global-test-retreat/proposal/2398#comments to respond to the suggestion OR simply reply to this email (Please make sure, you delete the previous comment's content from the email before replying.)

      Regards,
      Global Test Retreat Team
      aditya.garg@agiletestingalliance.org
      https://confengine.com
      You are receiving this email from ConfEngine on behalf of Global Test Retreat. Thanks for using ConfEngine's Conference Submission System.
      Click here to unsubscribe from all email updates from ConfEngine.

      • Renu Rajani
        By Renu Rajani  ~  1 year ago
        reply Reply

        This topic needs to be related to Machine Learning and Robotics Process Automation (RBA) and not model based testing alone..

         

        Unless it goes deeper in machine learning, the topic is fit for only 20 minutes snippet.

         

        Regards

        Renu

         

        From: Global Test Retreat [mailto:info@confengine.com]
        Sent: Thursday, March 31, 2016 3:20 PM
        To: Anish Cheriyan; Schalk Cronjé; Aditya Garg; Brijesh Deb; Ashish Mishra; Amit Janorikar; Dinesh Madne; Rajani, Renu
        Subject: Speaker replied to a comment on Who will test your tests?

         

        Dear Committee Members,

        Your proposal Who will test your tests? has received a new comment from shirish-padalkar

        Well, I have given this talk and in general 30 minutes is a good time for topic. I think I can cut some slides to fit it into 20 minutes.

        Or do you think it should be 45 minutes topic?


        With regards,
        Shirish (http://twitter.com/_Garbage_)

         

        On Thu, Mar 31, 2016 at 2:35 PM, Global Test Retreat <info@confengine.com> wrote:

        Dear Shirish Padalkar,

        Your proposal Who will test your tests? has received a new comment from brijesh-deb

        This is a very good topic. Do you think 20 minutes would suffice?


        Visit https://confengine.com/global-test-retreat/proposal/2398#comments to respond to the suggestion OR simply reply to this email (Please make sure, you delete the previous comment's content from the email before replying.)

        Regards,
        Global Test Retreat Team
        aditya.garg@agiletestingalliance.org
        https://confengine.com

        You are receiving this email from ConfEngine on behalf of Global Test Retreat. Thanks for using ConfEngine's Conference Submission System.
        Click here to unsubscribe from all email updates from ConfEngine.

         


        Visit https://confengine.com/global-test-retreat/proposal/2398#comments to respond to the suggestion OR simply reply to this email (Please make sure, you delete the previous comment's content from the email before replying.)

        Regards,
        Global Test Retreat Team
        aditya.garg@agiletestingalliance.org
        https://confengine.com

        You are receiving this email from ConfEngine on behalf of Global Test Retreat. Thanks for using ConfEngine's Conference Submission System.

        This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
        • Shirish Padalkar
          By Shirish Padalkar  ~  1 year ago
          reply Reply

          Hey Renu,

           

          I am not sure I understand what you mean. Why it has to be related to these topics? Did I choose the wrong catagary to submit the talk?

          • Brijesh Deb
            By Brijesh Deb  ~  1 year ago
            reply Reply

            Shirish, 

            I think there's some other proposal Renu must be referring to. Your proposal looks good for 30 minutes. Please update the time on your proposal to say 30 minutes. Thanks!