Rakuten Membership team has realized continuous testing in real DevOps world through implementing Shift-Left/Right test in our CI/CD pipeline in order to keep ZERO incident and high quality for our systems.
It is extremely difficult to achieve both agility and quality, especially critical legacy system. But we have achieved Zero Production defect in 2019.
In this talk, we’d like to share our methodologies based on Behavior Driven Development (BDD) automation test and Monitoring Driven Release (MDR), which can guarantee test coverage in all environments. We have implemented 100% UI/API automation test with Selenium and Cucumber, and have 300,000 test cases in our daily regression test which has been triggered every night and has 100% success ratio. MDR is to perform the release with limited user traffic on production environment and increase the traffic to 100% gradually based on monitoring feedback.