Which Plane Woke Snowy the Cat?
Our new cat, Snowy, is waking early. She is startled by the noise of jets flying over our house.
This talk describes how common radio receivers can be configured to gather aircraft transponder signals. With an opensource data streaming framework (Apache Kafka) we can build a streaming data pipeline to rapidly process aircraft movements in real-time.
With data and spatial visualisations we can really determine which plane woke Snowy the cat.
Outline/Structure of the Case Study
- Problem statement (time ordered data streaming and insight generation)
- Introduction to aircraft ADS-B transponder signals & software defined radios
- Kafka streaming architecture
- Code vs., configuration choices when building a streaming framework
- Discoveries using visualisations
Learning Outcome
Attendees will learn how to design and build a fast data streaming framework. The use-case covers difficulties in data processing IoT sensors, wrangling out of sequence event data along with geospatial visualizations
Attendees will learn
- strategies for dealing with complex streaming data
- exposure to the intriguing world of software defined radios
- techniques for geospatial visualizations using opensource projects
Target Audience
Data Engineer's & Data Architect's
Prerequisites for Attendees
A basic understanding of any streaming system (eg., Kafka, Flink, Spark) and SQL is helpful but not necessary.
Links
Irregular presenter at Sydney Meetups and Industry Events
A similar talk was presented at Sydney-Data-Engineering-Meetup - https://www.meetup.com/Sydney-Data-Engineering-Meetup/events/256905159/