location_city Sydney schedule May 6th 09:50 - 10:20 AM place Red Room people 61 Interested

Our new cat, Snowy, is waking early. She is startled by the noise of jets flying over our house.

This talk describes how common radio receivers can be configured to gather aircraft transponder signals. With an opensource data streaming framework (Apache Kafka) we can build a streaming data pipeline to rapidly process aircraft movements in real-time.

With data and spatial visualisations we can really determine which plane woke Snowy the cat.


Outline/Structure of the Case Study

  • Problem statement (time ordered data streaming and insight generation)
  • Introduction to aircraft ADS-B transponder signals & software defined radios
  • Kafka streaming architecture
  • Code vs., configuration choices when building a streaming framework
  • Discoveries using visualisations

Learning Outcome

Attendees will learn how to design and build a fast data streaming framework. The use-case covers difficulties in data processing IoT sensors, wrangling out of sequence event data along with geospatial visualizations

Attendees will learn

  • strategies for dealing with complex streaming data
  • exposure to the intriguing world of software defined radios
  • techniques for geospatial visualizations using opensource projects

Target Audience

Data Engineer's & Data Architect's

Prerequisites for Attendees

A basic understanding of any streaming system (eg., Kafka, Flink, Spark) and SQL is helpful but not necessary.

schedule Submitted 1 year ago