Sushant will be presenting the following session
-
keyboard_arrow_down
Balvinder Kaur Khurana / Sushant Joshi - Real time insights for better products, customer experience and resilient platform
Balvinder Kaur KhuranaPrincipal Consultant/Data ArchitectThoughtWorksSushant JoshiProduct PrincipalThoughtworks technologiesschedule 1 year ago
45 Mins
Case Study
Intermediate
Businesses are building digital platforms with modern architecture principles like domain driven design, microservice based, and event-driven. These platforms are getting ever so modular, flexible and complex.
While they are built with architecture principles like - loose coupling, individually scaling, plug-and-play components; regulations and security considerations on data - complexity leads to many unknown and grey areas in the entire architecture. Details on how the different components of this complex architecture interact with each other are lost. Generating insights becomes multi-teams, multi-staged activity and hence multi-days activity.
Multiple users and stakeholders of the platform want different and timely insights to take both corrective and preventive actions.Business teams want to know how business is doing in every corner of the country near real time at a zipcode granularity. Tech teams want to correlate flow changes with system health including that of downstream stability as it happens.Knowing these details also helps in providing the feedback to the platform itself, to make it more efficient and also to the underlying business process.
In this talk we intend to share how we made all the business and technical insights of a complicated platform available in realtime with limited incremental effort and constant validation of the ideas and slices with business teams. Since the client was a Banking client, we will also touch base handling of financial data in a secure way and still enabling insights for a large group of stakeholders.
We kept the self-service aspect at the center of our solution - to accommodate increasing components in the source platform, evolving requirements, even to support new platforms altogether. Configurability and Scalability were key here, it was important that all the data that was collected from the source platform was discoverable and presentable. This also led to evolving the solution in lines of domain data products, where the data is generated and consumed by those who understand it the best.
1. What got you started/interested in modern software development methods?
The impact great software can create on people's lives is amazing. I was a developer and I coded something that would get executed every minute, obviously, it was part of something big, but the sheer joy of impact is amazing. That was a trigger for me to get interested deeper in software that works and things that make it work.
2. What do you think is the biggest challenge faced by the software product engineering community today?
Scale - Delayed scaling is value erosion and premature scaling is value destruction. I believe striking the balance is the challenge everyone is grappling with today.
3. What do you think are the most exciting developments in software product engineering today?
Ability to work with data in near real-time and make those insights available in a reasonably non-tech way.
4. Why did you choose the topic(s) you will be speaking about at the conference?
Data is so common a talking point that it's difficult to find any engineering not talking about it. Yet, while we were posed with the problem we struggled to find meaningful relevant examples. The problem also gave a great learning experience of working with ambiguity & uncertainty. There were a lot of aha movements and we felt our experience will benefit the entire community.
5. What are some of the key takeaways from your session(s) at Agile India?
The journey towards data-based insights is full of ambiguities
Upfront thoughts on scaling can stifle the progress on problem-solving
Data-driven thinking can truly empower the team and drive the org culture