Hanging on in Quiet Desperation: Time & Programming
Time has a profound impact on the complexity of the systems we build.
A significant amount of this software complexity comes from either an inability to recall previous states or the inability to understand how a state was arrived at.
From the foundations of AI, LISP and functional programming [1], to causality in distributed systems [2], to the more grungy practices of immutable infrastructure, or the unreasonable effectiveness of fact-based approaches to large scale data systems; the ability to adequately cope with time, and the change and conflict it inevitably creates, is a common thread to being able to build and reason about these systems.
This talk looks at the impact of time on system design. We will walk through examples of large-scale systems and their battles with complexity. At the end of the talk, the audience should start to see the common spectre of time and have an appreciation of how understanding time is fundamental to maintaining clarity, correctness and reliability in systems.
[1] Situations, Actions, and Causal Laws
John McCarthy
http://www.dtic.mil/dtic/tr/fulltext/u2/785031.pdf
[2] Times, Clocks and the Ordering of Events in a Distributed System
Leslie Lamport
https://amturing.acm.org/p558-lamport.pdf
Outline/Structure of the Talk
This talk will be about 25% concepts, 75% discussion of the application of those concepts in real systems. The examples are primarily from systems I have built, although I will spend some time relating it to other popular tools/techniques (for example react/redux front end approaches, git/dvcs approaches), there will be a mix of data/machine-learning examples, distributed systems, and some more specific functional programming language examples.
Learning Outcome
This is a very general talk and would be appropriate for attendees from graduate programmers through to experienced engineers and architects.
From this talk I hope that attendees walk away with a better understanding of the role of time in software systems and how rigorous application of techniques that embrace time and state changes can help reduce complexity while improving clarity, correctness and reliability.
This talk is ideal for pushing people beyond the idea of programming languages as a solution. Throwing Haskell or Scala at a team and doing _functional_ programming doesn't get people very far, this talk wants to point at a more fundamental shift in how to approach thinking about complex software that can really make a difference to the quality and value of the systems we deliver.
The talk is very applicable to a functional programming audience as they will are probably already be using some or many of the techniques, and will appreciate a practical look at how their knowledge of functional programming can help make better decisions around software in general.
Target Audience
A general software developmentr audience who could benefit from FP techniques in their systems.
Video
schedule Submitted 4 years ago
People who liked this proposal, also liked:
-
keyboard_arrow_down
Michael Snoyman - Functional Programming for the Long Haul
45 Mins
Keynote
Beginner
How do you decide whether a programming language is worth using or not? By necessity, such decisions are usually based on assessments that can be made relatively quickly: the ease of using the language, how productive you feel in the first week, and so on. Unfortunately, this tells us very little about the costs involved in continuing to maintain a project past that initial phase. And in reality, the vast majority of time spent on most projects is spent in those later phases.
I'm going to claim, based on my own experience and analysis of language features, that functional programming in general, and Haskell in particular, are well suited for improving this long tail of projects. We need languages and programming techniques that allow broad codebase refactorings, significant requirements changes, improving performance in hotspots of the code, and reduced debug time. I believe Haskell checks these boxes.
-
keyboard_arrow_down
Saurabh Nanda - "Refresh-driven" development with Haskell & Elm
45 Mins
Tutorial
Beginner
We sorely missed the rapid "refresh-based" feedback loop available in Rails (and other dynamically typed web frameworks), while writing Haskell. Change your code, hit save, and refresh your browser!
In this talk we will share a few tips on how we finally hit productivity nirvana with ghcid and automated code-gen.
Best of both worlds -- rock-solid type-safety AND being able to reload code with every change.
-
keyboard_arrow_down
Raghu Ugare / Vijay Anant - (Why) Should You know Category Theory ?
Raghu UgareArchitect, Designer, DeveloperLambdaMattersVijay AnantArchitect, Designer, DeveloperLambdaMattersschedule 4 years ago
45 Mins
Talk
Intermediate
Category Theory has been found to have a vast field of applications not limited to programming alone.
In this fun-filled talk (Yes! We promise!) , we want to make the audience fall in love with Math & Category Theory in general, and Haskell in particular.
We will address questions such as below:- What is the mysterious link between the abstract mathematical field of Category Theory and the concrete world of real-world Programming ? And why is it relevant especially in Functional Programming?
- Most of all, how can You benefit knowing Category Theory ? (Examples in Haskell)
-
keyboard_arrow_down
Tony Morris - Parametricity, Functional Programming, Types
45 Mins
Talk
Intermediate
In this talk, we define the principle of functional programming, then go into
detail about what becomes possible by following this principle. In particular,
parametricity (Wadler, 1989) and exploiting types in API design are an essential
property of productive software teams, especially teams composed of volunteers
as in open-source. This will be demonstrated.Some of our most important programming tools are neglected, often argued away
under a false compromise. Why then, are functional programming and associated
consequences such as parametricity so casually disregarded? Are they truly so
unimportant? In this talk, these questions are answered thoroughly and without
compromise.We will define the principle of functional programming, then go into
detail about common problems to all of software development. We will build the
case from ground up and finish with detailed practical demonstration of a
solution to these problems. The audience should expect to walk away with a
principled understanding and vocabulary of why functional programming and
associated techniques have become necessary to software development. -
keyboard_arrow_down
Michael Ho - Making the Switch: How We Transitioned from Java to Haskell
45 Mins
Case Study
Intermediate
In this case study presentation, SumAll's CTO, Todd Sundsted, and Senior Software Engineer, Michael Ho, will discuss the move from Java to Haskell along two parallel paths. First, the business/political story — how SumAll convinced the decision makers, fought the nay-sayers, and generally managed the people impacted by the transition. Second, the technical story — how they actually replaced their Java code with Haskell code. Along the way, they will address their hopes and expectations from transitioning from Java to Haskell, and will conclude with the results they've gained and seen to date.
-
keyboard_arrow_down
Anupam Jain - Purely Functional User Interfaces that Scale
45 Mins
Talk
Beginner
A virtual cottage industry has sprung up around Purely functional UI development, with many available libraries that are essentially just variants on two distinct approaches: Functional Reactive Programming (FRP), and some form of functional views like "The Elm Architecture". After having worked extensively with each of them, I have found that none of the approaches scale with program complexity. Either they are too difficult for beginners trying to build a hello world app, or they have unpredictable complexity curves with some simple refactorings becoming unmanageably complex, or they "tackle" the scaling problem by restricting developers to a safe subset of FP which becomes painful for experienced developers who start hitting the complexity ceiling.
In this talk I give an overview of the current Purely Functional UI Development Landscape, and then present "Concur", a rather unusual UI framework, that I built to address the shortcomings of the existing approaches. In particular, it completely separates monoidal composition in "space" (i.e. on the UI screen), from composition in "time" (i.e. state transitions), which leads to several benefits. It's also a general purpose approach, with Haskell and Purescript implementations available currently, and can be used to build user interfaces for the web or for native platforms.
The biggest advantage of Concur that has emerged is its consistent UI development experience that scales linearly with program complexity. Simple things are easy, complex things are just as complex as the problem itself, no more. Reusing existing widgets, and refactoring existing code is easy and predictable. This means that Concur is suitable for all levels of experience.
- For Learners - Concur provides a consistent set of tools which can be combined in predictable ways to accomplish any level of functionality. Due to its extremely gentle learning curve, Concur is well suited for learners of functional programming (replacing console applications for learners).
- For experienced folks - Assuming you are already familiar with functional programming, Concur will provide a satisfying development experience. Concur does not artificially constrain you in any form. You are encouraged to use your FP bag of tricks in predictable ways, and you are never going against the grain. It's a library in spirit, rather than a framework.
-
keyboard_arrow_down
Debasish Ghosh - Managing Effects in Domain Models - The Algebraic Way
45 Mins
Talk
Intermediate
When we talk about domain models, we talk about entities that interact with each other to accomplish specific domain functionalities. We can model these behaviors using pure functions. Pure functions compose to build larger behaviors out of smaller ones. But unfortunately the real world is not so pure. We need to manage exceptions that may occur as part of the interactions, we may need to write stuff to the underlying repository (that may again fail), we may need to log audit trails and there can be many other instances where the domain behavior does not guarantee any purity whatsoever. The substitution model of functional programming fails under these conditions, which we call side-effects.
In this session we talk about how to manage such impure scenarios using the power of algebraic effects. We will see how we can achieve function composition even in the presence of effects and keep our model pure and referentially transparent. We will use Scala as the implementation language.
In discussing effects we will look at some patterns that will ensure a clean separation between the algebra of our interface and the implementation. This has the advantage that we can compose algebras incrementally to build richer functionalities without committing to specific implementations. This is the tagless final approach that offers modularity and extensibility in designing pure and effectful domain models.
-
keyboard_arrow_down
Michael Snoyman - Applied Haskell Workshop
480 Mins
Workshop
Intermediate
This full day workshop will focus on applying Haskell to normal, everyday programming. We'll be focusing on getting comfortable with common tasks, libraries, and paradigms, including:
- Understanding strictness, laziness, and evaluation
- Data structures
- Structuring applications
- Concurrency and mutability
- Library recommendations
By the end of the workshop, you should feel confident in working on production Haskell codebases. While we obviously cannot cover all topics in Haskell in one day, the goal is to empower attendees with sufficient knowledge to continue developing their Haskell skillset through writing real applications.
-
keyboard_arrow_down
Jayaram Sankaranarayanan - YAAeM : Yet Another Attempt To Explain M
45 Mins
Talk
Beginner
It's another attempt to explain Monads to all those who are curious of this M-word.
The famous Mars Rover problem is used to demonstrate a solution for it using basic Haskell tools and then introduces Monads and demonstrates a solution using the State Monad.
-
keyboard_arrow_down
Brian McKenna - Starting Data61 Functional Programming Course
90 Mins
Workshop
Beginner
Following Tony and Alois' Introduction to Haskell syntax and tools, we will work through the first few modules of Data61's Functional Programming Course. These modules cover writing functions for the optional and list data types.
We will complete enough exercises to cover basic data types, functions and polymorphism. We'll practice the techniques of equational reasoning, parametricity and type/hole driven development. After completing these modules, you should be able to use the techniques to attempt most other exercises in the repository.
This workshop has the same requirements as Tony's introduction, along with a download of a recent version of the fp-course repository (https://github.com/data61/fp-course).
-
keyboard_arrow_down
Luka Jacobowitz - Testing in the world of Functional Programming
45 Mins
Demonstration
Intermediate
Testing is one of the most fundamental aspects of being a software developer. There are several movements and communities based on different methodologies with regards to testing such as TDD, BDD or design by contract. However, in the FP community testing is often not a large topic and is often glossed over. While it’s true that testing in functional programming tends to be less important, there should still be more resources on how to create tests that add actual value.
This talks aims to provide exactly that, with good examples on how to leverage property based testing, refinement types and the most difficult part: figuring out how to test code that interacts with the outside world.
-
keyboard_arrow_down
Mark Hibberd - Property Based Testing
90 Mins
Workshop
Beginner
Building on the earlier two introductions to functional programming with types, property based testing is the extra verification technique you need to ensure working software. We will work through the patterns of property based testing, starting with simple functions, working up to verification of a larger program.
By the end of this workshop participants will have a better understanding of the advantages of property based tests over example based tests, as well as acquiring the skills and confidence to start applying property based testing techniques to their current work.
This workshop has the same requirements as Tony's introduction, and will require a recent clone of the workshop repository available at https://github.com/markhibberd/property-based-testing-workshop.
-
keyboard_arrow_down
Aaron Hsu / Dhaval Dalal / Morten Kromberg - Array-oriented Functional Programming
Aaron HsuComputer ResearcherDyalog Ltd.Dhaval DalalSoftware ArtisanCalixir Consultants Pvt. Ltd.Morten KrombergCXODyalogschedule 4 years ago
90 Mins
Workshop
Beginner
APL is the original functional programming language, the grand-daddy, the Godfather, and the old workhorse. But don't let Grandpa's age fool you. APL programmers have been leveraging the use of functional programming with arrays long before it was cool to be chasing pointers in an ADT using statically typed pattern matching, and they've refined their own style and approach to getting the most from a "functional paradigm."
In this workshop, you will have the chance to spend some time thinking like a functional array programmer. What makes it different? How does the code look at the end? What thought process do you go through to get there? Get a chance to play around with some classic problems and try solving them "the APL way."
Taijiquan Classics say, "Four ounces deflects a thousand pounds."
APLers might say instead, "Fifty characters solve a thousand problems."
-
keyboard_arrow_down
Tony Morris - Let's Lens
480 Mins
Workshop
Intermediate
Let's Lens presents a series of exercises, in a similar format to the Data61 functional programming course material. The subject of the exercises is around the concept of lenses, initially proposed by Foster et al., to solve the view-update problem of relational databases.
The theories around lenses have been advanced significantly in recent years, resulting in a library, implemented in Haskell, called lens.
This workshop will take you through the basic definition of the lens data structure and its related structures such as traversals and prisms. Following this we implement some of the low-level lens library, then go on to discuss and solve a practical problem that uses all of these structures.
-
keyboard_arrow_down
Jayaram Sankaranarayanan - Ring Of Effects Architecture Driven by FP!
20 Mins
Experience Report
Beginner
This talk shares case study on how an application's design and architecture evolved when functional principles were applied and application was refactored.
The transformation of the architecture and how developers understood the structure of the application is also discussed.
It starts with outlining the basic use case, initial implementation tech stack and high level design and how iteratively the design was changed by applying the following FP principles.
1. No mutable global state
2. Use pure functions
3. Effects as Data and Restrict effects to outer ring of the application
-
keyboard_arrow_down
Markus Hauck - Free All The Things!
45 Mins
Talk
Intermediate
Have you ever asked yourself why we only free monads? Turns out there are a lot of other structures that want to be liberated from the constraints of their existence! In this talk, we will investigate what other poor (algebraic) structures we can free from the dirty hands of imperative programmers. Our journey starts with the well-known free monads, but after that we will have a look at all the other interesting structures that can be freed and of course we will also look at what we can do with them.
-
keyboard_arrow_down
Sean Chalmers - Condensed Applied FP Course
480 Mins
Workshop
Intermediate
Intermediate functional programmers often find it daunting to move from examples provided in books and blogs to developing their first fully functioning application. The Queensland Functional Programming Lab at Data61/CSIRO have produced a course for exactly this purpose. Building on the fundamentals, we work through the process of constructing a REST application covering the following topics:
- Package dependencies
- Project configuration
- Application testing & building
- Encoding / decoding messages
- Persistent storage integration
- App state & configuration management
- Error handling & reporting
-
keyboard_arrow_down
Andrew McMiddlin - Property-based State Machine Testing
45 Mins
Talk
Intermediate
Automated testing is key to ensuring the ongoing health and well-being of any software project,giving developers and users confidence that their software works as intended. Property based testing is a significant step forward compared to traditional unit tests, exercising code with randomly generated inputs to ensure that key properties hold. However, both of these techniques tend to be used at the level of individual functions. Many important properties of an application only appear at a higher level, and depend on the state of the application under test. The Haskell library hedgehog, a relative newcomer to the property based testing world, includes facilities for property-based state machine testing, giving developers a foundation on which to build these more complicated tests.
In this talk, Andrew will give you an introduction to state machine property testing using hedgehog. He'll start with a quick refresher on property based testing, followed by a brief introduction to state machines and the sorts of applications they can be used to model. From there, he'll take you on a guided tour of hedgehog's state machine testing facilities. Finally, Andrew will present a series of examples to show off what you can do and hopefully give you enough ideas to start applying this tool to your own projects. The first set of examples will test a web application written in Haskell. These tests will include: content creation and deletion, uniqueness constraints, authentication, and concurrent transactions. A second set of examples will test an application written in a language other than Haskell to demonstrate that this technique is not limited to applications written in Haskell.
An intermediate knowledge of Haskell and familiarity with property based testing will be beneficial,but not essential. The slides and demo application will be available after the talk for people to study in detail.
-
keyboard_arrow_down
Ankit Rokde - My Haskell Program does not fail. Proof?
20 Mins
Talk
Intermediate
Proving correctness of programs and ensuring they are bug-free has always been a challenging problem.
Mostly we have relied on manual testing to check the correctness of programs.
Strong static type systems help us to write bug free programs from the start but many interesting cases can miss out.
Many tools such as QuickCheck, Liquid Haskell have been developed to address this issue.
In this talk, we will presenting a different approach, Bounded Model Checking (BMC), which has been very successful in proving correctness of imperative programs by means of tools such as CBMC.
We will explain how BMC works at high level, how we have adopted it for Haskell and our success with the same.
We will also present how you can use it to prove correctness of your Haskell programs.