Deep Learning, Production and You
Simply building a successful machine learning product is extremely challenging, and just as much effort is needed to turn that model into a customer-facing product. Drawing on their experience working on Zendesk’s article recommendation product, Wai Chee Yau and Jeffrey Theobald discuss design challenges and real-world problems you may encounter when building a machine learning product at scale.
Wai Chee and Jeffrey cover the evolution of the machine learning system, from individual models per customer (using Hadoop to aggregate the training data) to a universal deep learning model for all customers using TensorFlow, and outline some challenges they faced while building the infrastructure to serve TensorFlow models. They also explore the complexities of seamlessly upgrading to a new version of the model and detail the architecture that handles the constantly changing collection of articles that feed into the recommendation engine.
Topics include:
- Infrastructure for continuously changing textual data
- Deploying and serving TensorFlow models in production
- Real-world production problems when dealing with a machine learning model
- Data, customer feedback, and user experience
Outline/Structure of the Case Study
We will:
- Explain the problem that we are trying to solve, i.e., building article recommendation product for Zendesk
- Give details on how we serve a deep learning model
- Talks about the challenges we faced when hardening and scaling the system
- Summarise the lessons we learned throughout the project.
Learning Outcome
As a result of this session the audience should:
- Understand some of the engineering challenges you may encountered while implementing a deep learning product
- Understand/appreciate the fact that building a successful machine learning product requires lots of effort from the various disciplines such as product, engineering, science and UX.
Target Audience
Data Engineers, Data Scientists, Machine learning product team
Prerequisites for Attendees
Basic understanding of machine learning.
Basic knowledge of data and distributed systems.
Links
Related blogpost : https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
Data and Innovation Summit Melboure: https://theinnovationenterprise.com/summits/big-data-analytics-innovation-summit-melbourne-2018/speakers/17914
Strata Singapore 2017 Conference: https://conferences.oreilly.com/strata/strata-sg/public/schedule/detail/62829
Oz Big Data Meetup : https://www.meetup.com/Oz-Big-Data-Melbourne/events/244852096/?eventId=244852096&chapter_analytics_code=UA-40163874-2
Machine Learning & AI Meetup: https://www.meetup.com/Machine-Learning-AI-Meetup/events/238794181/
YowData! 2016 https://www.youtube.com/watch?v=3NWiZ3zFX_I