Simplifying Amazon ECS by Weaving overlay networks

Amazon ECS is a widely-used Docker container scheduling and orchestration platform, but some of the constraints it applies makes for ... interesting ... workarounds. Chief among the challenges are connecting containers to each other, across services, clusters, and even regions. Working in hybrid cloud environments is also a problem.

This talk will show you one way to address these challenges: by using the "weave" Docker overlay network, a self-discovering and self-configuring mesh network that permits configuration simplicity and out-of-the-box parity with the popular docker-compose structure.

 
6 favorite thumb_down thumb_up 0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  • Brief introduction and overview of Docker (a peek under the covers)
  • Brief introduction and overview of AWS ECS
  • How local Docker and ECS are similar, and how they differ -- challenges presented
  • Particular issues of configuration and networking
  • Using weave to solve these problems, and bring local and ECS back into line
  • Auto-discovery and self-configuration with weave
  • Demonstration
  • Unlocking bonus powers: cross-region, cross-cloud-provider, and cloud-to-on-premise networking, transparent to containers
  • Where you wouldn't use this
  • Resources for learning more

Learning Outcome

Understanding of Docker overlay networking, and how to use weave to enable container communications across diverse locations, providers, and platforms in a way that's transparent to the container

Target Audience

Technical folk, network and solution architects, dev, ops, and tech leads who want options for simpler AWS Docker deployments

Prerequisite

Experience with Docker, and at least passing familiarity with docker-compose; Awareness of AWS, at least as far as EC2 and Auto-Scaling. Experience with ECS is not a pre-requisite.

schedule Submitted 1 month ago

Comments Subscribe to Comments

comment Comment on this Proposal

  • Liked Gabor Devenyi
    keyboard_arrow_down

    People Power - Build on strengths of the individuals

    Gabor Devenyi
    Gabor Devenyi
    schedule 2 months ago
    Sold Out!
    20 mins
    Talk
    Beginner

    One of the principles of the Agile manifesto is build projects around motivated individuals. “Give them the environment and support they need, and trust them to get the job done.”.

    However, individuals have different strengths and weaknesses. Our focus shifts quite often on how to improve their performance and how we can “develop” their weaknesses. Science and my personal experience shows that building on the strengths rather than improving our weaknesses will get better results, and not only when we want to build projects around motivated individuals.

  • Liked Tom Partington
    keyboard_arrow_down

    An introduction to Web Performance Optimisation - practical steps for reducing costs and improving the user experience

    Tom Partington
    Tom Partington
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Beginner

    The web is increasingly becoming the standard way in which we conduct our business, but despite the use of ever improving technologies many websites are frustratingly slow and getting slower. It is becoming more difficult to compete for and retain users attention, and If you operate in the online space you can no longer afford to ignore the performance of your website or platform.

    This talk will provide an introduction to and the benefits of web-performance optimisation, explain why it matters now more than ever and why it's so commonly overlooked during the development process. It will also show how you can identify and fix the most common performance pitfalls, resulting in reduced costs, and increased user engagement and satisfaction.

    During this talk there will be an opportunity to follow along on your own laptop and learn how to use some of the tools firsthand.

  • Liked Stephen Dodd
    keyboard_arrow_down

    South Park Sprint - Design Thinking Insights

    Stephen Dodd
    Stephen Dodd
    schedule 1 month ago
    Sold Out!
    20 mins
    Talk
    Beginner

    Listening to a talk by Jeff Patton around user story mapping and in particular the origins of story mapping left me thinking of similarities to a documentary featuring South Park's Trey Parker and Matt Stone called 6 days to air.

    This talk aims to explain and highlight interesting and unexpected similarities between the South Park team's 6 day episode creation sprint and an Agile software team. Throughout it will extract some of the reasons why / how the South Park creation team can do what they do and explain how we can use these takeaways in our own teams to encourage creativity and input from all team members.

     

  • Liked Steve Mactaggart
    keyboard_arrow_down

    Evolving the role of team leadership in a devops transformation

    Steve Mactaggart
    Steve Mactaggart
    schedule 1 month ago
    Sold Out!
    20 mins
    Talk
    Beginner

    There is much discussion about the changing roles of Development and Operations staff when organisations undergo agile/digital/devops transformations. But what about the changing role of the Team Leader?

    In pre-agile environments, as a Team Lead, your role is one of structure and co-ordination, it is through you that work routes. You know the skills and capacity of your team and are regularly making decisions about what can and can’t be done.

    But as your team starts to work in agile teams, the need for you to keep them busy is reduced, as this is now a responsibility of the product owner and agile team itself.

    You might find yourself asking “Do we need Team Lead’s in an agile/devops culture?”, and if so “What value can I provide?

    This sessions looks at the opportunities existing Team Leaders have to support and drive digital transformation through the discussion of focus' they can bring to the team.

  • Liked LJ Kenward
    keyboard_arrow_down

    Junior Developers - The Next Generation

    LJ Kenward
    LJ Kenward
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Beginner

    Demand for technologists is fast becoming unfulfillable. The pool of talent is drying up, with the oldies heading into retirement, management or just straight up senility, it is never a more important time than now to grow the next generation of technologists!

    I'll take you on the Junior Developer journey with me, from justifying why Juniors are good for business, how to help them jump In and level up when they first join a team, and then how to continue developing their skills and career throughout their journey. 

    I'll talk problems, benefits, hints, how to use agile to help make the process painless and prosperous, based on a combination of personal experience, local research, and industry practises, plus some ideas a little left of centre.

  • Liked John Contad
    keyboard_arrow_down

    The Importance of Teaching in Organizations

    John Contad
    John Contad
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    Mentorship matters. A lot.

    The future is going to be weird: technologies are growing faster than we can teach them, and we need more experts quick. In this talk, we'll discuss the many ways we teach DevOps practices in an organization as analogues of how systems transmit data. We'll talk about the advantages and pitfalls of:

     - Broadcast systems (e.g., Universities)
     - 1:1 Discovery (e.g., Mentorships)
     - Gossip protocols (e.g., Communities and guilds)

    We'll unpack each methodology, discuss the information dispersal mechanisms and attributes of each system, and see where they fit. Because really: DevOps isn't about technology choice, or language, or infrastructure. First and foremost, it's about people.

     

  • Liked Anna Fiofilova
    keyboard_arrow_down

    Survival guide for women in IT

    Anna Fiofilova
    Anna Fiofilova
    schedule 1 month ago
    Sold Out!
    20 mins
    Tutorial
    Beginner
    Working in the IT industry today is hard, but it is even harder if you are a woman. There is still lots of “old school thinking" that women face daily. This talk is a survival guide based on real-life stories and different challenges from women of different ages, cultural backgrounds and roles in the Australian IT industry.
     
    Like any survival guide, this one provides you with the essential information to help you identify and overcome the most frequently encountered hazards. Each chapter contains useful tips, instructions and practical advice on a particular issue so you can implement the skills and techniques even under the most stressful circumstances. From the hiring process to promotions and corporate events, you'll have the tools to survive.
     
    You will learn these skills and more:
    • Assess your situation and prioritize your needs;
    • Surviving techniques for the hiring process;
    • Assemble your own custom emergency kit with essentials tools;
    • Manage extreme work conditions and overtime;
    • Survive corporate parties and drinks;
    • Build trust network and create allies; 
    • Identify your enemies and their habits.
    Preparation is the key. If you are starting your career in IT or navigating through it - this guide is for you.
  • Liked Kelsey van Haaster
    keyboard_arrow_down

    Synchronous Communication is overrated! : How to thrive in an uber distributed team

    Kelsey van Haaster
    Kelsey van Haaster
    schedule 3 weeks ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    The ThoughtWorks Identity team is a globally distributed remote team of 5 people. We deliver IDAAS (Identity as a service) to more than 5000 ThoughtWorkers in 14 different countries and we do it 24 hours a day 7 days a week. 

    We don't have an always-on video link.  There is no time of day of when we can all get on a call together, yet we succeed in providing end to end product development and support to our customers. Including delivering new product to production on a daily basis. 

    We achieve this through choosing not to fight against our distributed nature, but by embracing it and by leveraging the advice contained in the principles and values of the Agile Manifesto 

    This presentation will share our journey and some of the things we have learned along the way and we will challenge the existing thinking behind what is required to thrive as a member of a distributed team.  

  • Liked Jagannath Vaikuntham
    keyboard_arrow_down

    Ensuring Better Quality with Docker

    Jagannath Vaikuntham
    Jagannath Vaikuntham
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Beginner

    Docker is an awesome container platform. As part of this talk , I would like to show and discuss , how it can help solve some of the common and annoying issues faced while testing . Namely :

    • "It worked on my machine" problem
    • Testing different configurations, with the same codebase
    • Efficiently testing on your / dev's machine.
    • Setting up the Continuous Integration Environment
    • Scaling  / Parallelising Test Runs ( via Selenium Grid  & Docker Compose ) 
  • Gendry Morales
    Gendry Morales
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    Data driven decision making culture. It sounds great in theory, but how do you really get there in practice?

     

    In this talk, I will share insights and stories from my quest for a data driven decision making culture. Where to start, how to overcome common data resistance patterns and how to create the kind of cultural maturity needed to use data as an input to making decisions.

     

    But data is confronting and often doesn’t support decisions that have already been made or visions that have already been imagined so a big part of this story is about how we conquer issues around ego, blame and data resistance.

     

    And why is data so essential to me? As Lean, Agile and Systems Thinking become more mainstream, it appears the amount of misinformation and misuse is growing and the lack of tangible business outcomes is putting our industry at risk.  We have an obligation to protect the integrity of these practices by showing the relationship between cause and effect. Showing how we have affected business performance, aiming to understand when we have improved it and when we have gone backwards. Having the evidence as well as the great stories about our transformations.

  • Liked Tim Pittman
    keyboard_arrow_down

    From Consultant to Client

    Tim Pittman
    Tim Pittman
    Shannon Rowe
    Shannon Rowe
    schedule 1 month ago
    Sold Out!
    20 mins
    Talk
    Beginner

    Join Shannon and Tim for a fast paced account of their move from being high-flying consultants to down-to-earth product people.

    Where do they now add value? How has their relationship with their team changed? How many timesheets are they doing?

    All will be revealed!

     

     

  • Liked Adel Smee
    keyboard_arrow_down

    Vulnerability & Management

    Adel Smee
    Adel Smee
    schedule 1 month ago
    Sold Out!
    45 mins
    Workshop
    Intermediate

    There's a lot of subtle and not-so-subtle pressure on managers to have the answers and always be confident, capable and upbeat. But as we are actual human beings the only way to do that 100% of the time is to fake it. The old command and control management systems are giving way to collaboration, cultivation of psychological safety and delegation of responsibility. Managers are no longer required to tell workers what to do, but to support and inspire them to do it. The best managers I've known don't create an artificial aura of omniscience, they can be confused, inquisitive, engaged, vulnerable and above all authentic. Cultivating authenticity at work is easy on a good day but can be terrifying on a bad one. So let's talk about what that looks and feels like, and discuss techniques to help strip away the veneer and get real.

  • Liked Rob Manger
    keyboard_arrow_down

    "How do I test this?" - Exploring test plan design

    Rob Manger
    Rob Manger
    Many Joy
    Many Joy
    schedule 1 month ago
    Sold Out!
    45 mins
    Workshop
    Beginner

    In this interactive session, Rob and Many from REA Group will go through an exercise designed to explore the agile testing mindset.  Together with the rest of the room we will build up a mindmap of a test plan for a simple application.  

    Testing is an often mis-understood, under-estimated role.  We hope to challenge people into thinking outside the box and give people a better understanding of what a "QA" role brings to a high performing agile team.

  • Liked Pete Cohen
    keyboard_arrow_down

    “GameDay” - Achieving resilience through Chaos Engineering

    Pete Cohen
    Pete Cohen
    Matt Fellows
    Matt Fellows
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Intermediate
    Agility has brought us iterative software development, independent feature teams, nimble architectures and distributed, scalable infrastructure. But how do you have confidence that your production environment keeps working in the face of this emergent complexity and fast paced change?
     
    The answer is to anticipate failure, and to build resilience into every layer. This requires your whole system - not just the software and infrastructure, but also people and processes - to be able to respond quickly and appropriately to unexpected events. And the way to simulate the truly unexpected is to do experiments through the introduction of some chaos.
     
    GameDays bring together people from across an organisation to collaboratively break, observe and recover a system - with the impact on the holistic customer experience at front of mind. Apart from learning how the technical system responds under stress, some of the main benefits come from the shared understandings and process improvements which are generated. GameDays should be more than just an event or a one off exercise - they embody an enduring mindset and a culture.
     
    This session will examine, from a first hand perspective, several case studies of where GameDays have been successfully executed in organisations ranging from startup to enterprise scale. The theoretical underpinnings to chaos engineering will be explored, and a range of practical tips and reference material will be shared.
  • Liked James Holmes
    keyboard_arrow_down

    Hierarchy is not a dirty word

    James Holmes
    James Holmes
    schedule 2 months ago
    Sold Out!
    20 mins
    Talk
    Intermediate

    A common problem for software development teams is that of career progression for technical people. Experienced programmers stagnate at Senior Developer or move into management roles for which they are not trained or they are sometimes simply ill suited.

    This presentation discusses the work underway at MYOB to address this issue.

  • Mike Jones
    Mike Jones
    schedule 2 months ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    Water-scrum-fall just wasn't working for me. Something was fundamentally wrong. I couldn't quite figure out what - or how to fix it - until I found Value Stream Mapping. This was only the beginning.

    Deep dive into the seven wastes of software development and how to apply Value Stream Mapping to software development. Learn where I went wrong, and tips for running your own mapping workshops.

    If you are a people manager, project manager, scrum master or product owner this session will help you see where the bottlenecks REALLY are. 

     

  • Liked David Williams
    keyboard_arrow_down

    Scaling scrum in a different dimension

    David Williams
    David Williams
    schedule 1 month ago
    Sold Out!
    45 mins
    Case Study
    Beginner

    This session is a case study of how to apply Scrum and Systems thinking to a small development and support group working on multiple products at the same time. Scrum explains how to organise a single team working on a single product. Scaling frameworks such as Safe, LeSS, Nexus & DAD provide ways for multiple teams to work on a single product, but what do you do when you have multiple products and one siloed team?

  • Liked Benji Portwin
    keyboard_arrow_down

    How identity defines Spotify’s culture

    Benji Portwin
    Benji Portwin
    schedule 2 months ago
    Sold Out!
    45 mins
    Talk
    Beginner

    From the outside Spotify is a company who has solved the riddle of scaling agile, but the insiders perspective might surprise you, with our structure more closely resembling a collection of startups sharing a wifi connection.

  • Liked Alistair Sloley
    keyboard_arrow_down

    The Value Story - do your stories have value?

    Alistair Sloley
    Alistair Sloley
    schedule 1 month ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    What's in a story? Perhaps more applicable to agilists today, what's in a user story?

    Let's get real about user stories and what they are trying to achieve. Perhaps the user story is not the story format we should be using!

    Let's examine the user story format that we all know and love today. We will dive a little deeper into how a story and personas can create synergy. We will discuss how a user story can be presented on a ticket and how stories can be supplemented with information like acceptance criteria.

    Of course something so widely used will have anti-patterns. Let's look at a few and have a few laughs as well.

    Let's go even further and talk about user story alternatives, I will propose two. But wait! Are there even other user story alternatives? I will introduce two more.

    Finally, let's sum up the purpose of the user story and conclude with the central idea that's really important - your story can be anything you want it to be!

  • Liked Niall McShane
    keyboard_arrow_down

    Why LeSS is the heart of Scaled Agile

    Niall McShane
    Niall McShane
    schedule 2 months ago
    Sold Out!
    20 mins
    Talk
    Intermediate

    Over the last 2 years Niall has coached teams of agile teams through the launch of two Agile Release Trains (SAFe). Niall helped leaders, managers and teams through the process of adopting SAFe.

    Using his real experience as the basis for the presentation, Niall will make the case for moving past SAFe and going to the heart of scaled Agile using Large-Scale Scrum (LeSS).