You say big data, I say Fast data

getting-started Accepted Talk 45 Mins Beginner scala spark streaming
Nilanjan Raychaudhuri
Nilanjan Raychaudhuri
Software Developer
Typesafe Inc.
location_city Bengaluru schedule Sep 11th 04:15 - 05:00 PM place Grand Ballroom 1
Nowadays most of the "Big Data" problems are dealing with speed not size. Folks want "Fast Data". Speed is the problem to solve, not size. Most organizations today actually face smaller big data problems that they are trying to address through in-memory cached real-time processing of data. In this presentation we will explore architectures used for solving "Fast Data" problems. 
 
We will be using Spark Streaming and Scala for code examples.

 

 
0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/Structure of the Talk

- Introduction to data streaming landscape

- Types of streaming/fast data/near real time big data problems

- Challenges we face (lambda architecture, reactive streams)

- Spark streaming

- Examples

Learning Outcome

Audience will get exposed to following things

- Fast data problems

- Data streams (working with real time events) 

- Tools

- Spark streaming and Scala

Target Audience

developers and architectures

Video


Watch Video ondemand_video

Links

schedule Submitted 5 years ago

People who liked this proposal, also liked:

  • Nilanjan Raychaudhuri
    keyboard_arrow_down

    Nilanjan Raychaudhuri - Implementing Reactive Applications using Akka (and Play)

    deep-dive Accepted Workshop 480 Mins Intermediate concurrency-models actors reactive-applications futures
    Nilanjan Raychaudhuri
    Nilanjan Raychaudhuri
    Software Developer
    Typesafe Inc.
    schedule 5 years ago
    Sold Out!
    480 Mins
    Workshop
    Intermediate

    So you have read the reactive manifesto. What does it mean? How reactive traits are used in real world applications? How does one implement - event-driven, scalable, resilient & responsive applications for JVM?

    I think its time to act on it. In this workshop we will take ideas from manifesto and implement them in an application.

    Its time to take ideas from the manifesto and implement them in an application and learn how these ideas can be used in real world. We will use Java 8 and Scala to build our solution.

    2 comments
    View Details play_arrow
  • Nilanjan Raychaudhuri
    keyboard_arrow_down

    Nilanjan Raychaudhuri - Scala for Java developers

    getting-started Workshop 480 Mins Beginner scala fp concurrency-models
    Nilanjan Raychaudhuri
    Nilanjan Raychaudhuri
    Software Developer
    Typesafe Inc.
    schedule 5 years ago
    Sold Out!
    480 Mins
    Workshop
    Beginner
    Scala is a general-purpose object functional programming language that runs on Java Virtual Machine (JVM). But the recent explosion of programming languages on JVM raises a question that every developer faces today: which programming language to learn next? Which languages are ready for mainstream development? Among the heap of programming languages why should you learn Scala?
     
    In this workshop we will focus on 10 Scala features and play with it. I am sure by end of the day you will be convinced that Scala should be your next language.
     
    0 comments
    View Details play_arrow
Active Members
help