Simplifying Amazon ECS by Weaving overlay networks

schedule Jun 30th 01:30 PM - 02:15 PM place EN 308 (C40) people 13 Attending

Amazon ECS is a widely-used Docker container scheduling and orchestration platform, but some of the constraints it applies makes for ... interesting ... workarounds. Chief among the challenges are connecting containers to each other, across services, clusters, and even regions. Working in hybrid cloud environments is also a problem.

This talk will show you one way to address these challenges: by using the "weave" Docker overlay network, a self-discovering and self-configuring mesh network that permits configuration simplicity and out-of-the-box parity with the popular docker-compose structure.

 
6 favorite thumb_down thumb_up 0 comments visibility_off  Remove from Watchlist visibility  Add to Watchlist
 

Outline/structure of the Session

  • Brief introduction and overview of Docker (a peek under the covers)
  • Brief introduction and overview of AWS ECS
  • How local Docker and ECS are similar, and how they differ -- challenges presented
  • Particular issues of configuration and networking
  • Using weave to solve these problems, and bring local and ECS back into line
  • Auto-discovery and self-configuration with weave
  • Demonstration
  • Unlocking bonus powers: cross-region, cross-cloud-provider, and cloud-to-on-premise networking, transparent to containers
  • Where you wouldn't use this
  • Resources for learning more

Learning Outcome

Understanding of Docker overlay networking, and how to use weave to enable container communications across diverse locations, providers, and platforms in a way that's transparent to the container

Target Audience

Technical folk, network and solution architects, dev, ops, and tech leads who want options for simpler AWS Docker deployments

Prerequisite

Experience with Docker, and at least passing familiarity with docker-compose; Awareness of AWS, at least as far as EC2 and Auto-Scaling. Experience with ECS is not a pre-requisite.

schedule Submitted 5 months ago

Comments Subscribe to Comments

comment Comment on this Proposal

  • Liked Steve Mactaggart
    keyboard_arrow_down

    Steve Mactaggart - Evolving the role of team leadership in a devops transformation

    20 mins
    Talk
    Beginner

    There is much discussion about the changing roles of Development and Operations staff when organisations undergo agile/digital/devops transformations. But what about the changing role of the Team Leader?

    In pre-agile environments, as a Team Lead, your role is one of structure and co-ordination, it is through you that work routes. You know the skills and capacity of your team and are regularly making decisions about what can and can’t be done.

    But as your team starts to work in agile teams, the need for you to keep them busy is reduced, as this is now a responsibility of the product owner and agile team itself.

    You might find yourself asking “Do we need Team Lead’s in an agile/devops culture?”, and if so “What value can I provide?

    This sessions looks at the opportunities existing Team Leaders have to support and drive digital transformation through the discussion of focus' they can bring to the team.

  • Liked LJ Kenward
    keyboard_arrow_down

    LJ Kenward - Junior Developers - The Next Generation

    LJ Kenward
    LJ Kenward
    Junior Developer
    Xero
    schedule 5 months ago
    Sold Out!
    45 mins
    Talk
    Beginner

    Demand for technologists is fast becoming unfulfillable. The pool of talent is drying up, with the oldies heading into retirement, management or just straight up senility, it is never a more important time than now to grow the next generation of technologists!

    I'll take you on the Junior Developer journey with me, from justifying why Juniors are good for business, how to help them jump In and level up when they first join a team, and then how to continue developing their skills and career throughout their journey. 

    I'll talk problems, benefits, hints, how to use agile to help make the process painless and prosperous, based on a combination of personal experience, local research, and industry practises, plus some ideas a little left of centre.

  • Liked John Contad
    keyboard_arrow_down

    John Contad - The Importance of Teaching in Organizations

    John Contad
    John Contad
    Senior Systems Engineer
    REA Group
    schedule 5 months ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    Mentorship matters. A lot.

    The future is going to be weird: technologies are growing faster than we can teach them, and we need more experts quick. In this talk, we'll discuss the many ways we teach DevOps practices in an organization as analogues of how systems transmit data. We'll talk about the advantages and pitfalls of:

     - Broadcast systems (e.g., Universities)
     - 1:1 Discovery (e.g., Mentorships)
     - Gossip protocols (e.g., Communities and guilds)

    We'll unpack each methodology, discuss the information dispersal mechanisms and attributes of each system, and see where they fit. Because really: DevOps isn't about technology choice, or language, or infrastructure. First and foremost, it's about people.

     

  • Liked Anna Fiofilova
    keyboard_arrow_down

    Anna Fiofilova - Survival guide for women in IT

    20 mins
    Tutorial
    Beginner
    Working in the IT industry today is hard, but it is even harder if you are a woman. There is still lots of “old school thinking" that women face daily. This talk is a survival guide based on real-life stories and different challenges from women of different ages, cultural backgrounds and roles in the Australian IT industry.
     
    Like any survival guide, this one provides you with the essential information to help you identify and overcome the most frequently encountered hazards. Each chapter contains useful tips, instructions and practical advice on a particular issue so you can implement the skills and techniques even under the most stressful circumstances. From the hiring process to promotions and corporate events, you'll have the tools to survive.
     
    You will learn these skills and more:
    • Assess your situation and prioritize your needs;
    • Surviving techniques for the hiring process;
    • Assemble your own custom emergency kit with essentials tools;
    • Manage extreme work conditions and overtime;
    • Survive corporate parties and drinks;
    • Build trust network and create allies; 
    • Identify your enemies and their habits.
    Preparation is the key. If you are starting your career in IT or navigating through it - this guide is for you.
  • Liked Jagannath Vaikuntham
    keyboard_arrow_down

    Jagannath Vaikuntham - Ensuring Better Quality with Docker

    Jagannath Vaikuntham
    Jagannath Vaikuntham
    Quality Craftsman
    Cevo
    schedule 5 months ago
    Sold Out!
    45 mins
    Talk
    Beginner

    Docker is an awesome container platform. As part of this talk , I would like to show and discuss , how it can help solve some of the common and annoying issues faced while testing . Namely :

    • "It worked on my machine" problem
    • Testing different configurations, with the same codebase
    • Efficiently testing on your / dev's machine.
    • Setting up the Continuous Integration Environment
    • Scaling  / Parallelising Test Runs ( via Selenium Grid  & Docker Compose ) 
  • Liked Tim Pittman
    keyboard_arrow_down

    Tim Pittman / Shannon Rowe - From Consultant to Client

    20 mins
    Talk
    Beginner

    Join Shannon and Tim for a fast paced account of their move from being high-flying consultants to down-to-earth product people.

    Where do they now add value? How has their relationship with their team changed? How many timesheets are they doing?

    All will be revealed!

     

     

  • Liked Adel Smee
    keyboard_arrow_down

    Adel Smee - Vulnerability & Management

    Adel Smee
    Adel Smee
    Team Lead
    Zendesk
    schedule 5 months ago
    Sold Out!
    45 mins
    Workshop
    Intermediate

    There's a lot of subtle and not-so-subtle pressure on managers to have the answers and always be confident, capable and upbeat. But as we are actual human beings the only way to do that 100% of the time is to fake it. The old command and control management systems are giving way to collaboration, cultivation of psychological safety and delegation of responsibility. Managers are no longer required to tell workers what to do, but to support and inspire them to do it. The best managers I've known don't create an artificial aura of omniscience, they can be confused, inquisitive, engaged, vulnerable and above all authentic. Cultivating authenticity at work is easy on a good day but can be terrifying on a bad one. So let's talk about what that looks and feels like, and discuss techniques to help strip away the veneer and get real.

  • Liked Rob Manger
    keyboard_arrow_down

    Rob Manger / Many Joy - "How do I test this?" - Exploring test plan design

    45 mins
    Workshop
    Beginner

    In this interactive session, Rob and Many from REA Group will go through an exercise designed to explore the agile testing mindset.  Together with the rest of the room we will build up a mindmap of a test plan for a simple application.  

    Testing is an often mis-understood, under-estimated role.  We hope to challenge people into thinking outside the box and give people a better understanding of what a "QA" role brings to a high performing agile team.

  • Liked David Williams
    keyboard_arrow_down

    David Williams - Scaling scrum in a different dimension

    45 mins
    Case Study
    Beginner

    This session is a case study of how to apply Scrum and Systems thinking to a small development and support group working on multiple products at the same time. Scrum explains how to organise a single team working on a single product. Scaling frameworks such as Safe, LeSS, Nexus & DAD provide ways for multiple teams to work on a single product, but what do you do when you have multiple products and one siloed team?

  • Liked Benji Portwin
    keyboard_arrow_down

    Benji Portwin - How identity defines Spotify’s culture

    Benji Portwin
    Benji Portwin
    Agile Coach
    Spotify
    schedule 6 months ago
    Sold Out!
    45 mins
    Talk
    Beginner

    From the outside Spotify is a company who has solved the riddle of scaling agile, but the insiders perspective might surprise you, with our structure more closely resembling a collection of startups sharing a wifi connection.

  • Liked Alistair Sloley
    keyboard_arrow_down

    Alistair Sloley - The Value Story - do your stories have value?

    45 mins
    Talk
    Intermediate

    What's in a story? Perhaps more applicable to agilists today, what's in a user story?

    Let's get real about user stories and what they are trying to achieve. Perhaps the user story is not the story format we should be using!

    Let's examine the user story format that we all know and love today. We will dive a little deeper into how a story and personas can create synergy. We will discuss how a user story can be presented on a ticket and how stories can be supplemented with information like acceptance criteria.

    Of course something so widely used will have anti-patterns. Let's look at a few and have a few laughs as well.

    Let's go even further and talk about user story alternatives, I will propose two. But wait! Are there even other user story alternatives? I will introduce two more.

    Finally, let's sum up the purpose of the user story and conclude with the central idea that's really important - your story can be anything you want it to be!

  • Liked Tom Partington
    keyboard_arrow_down

    Tom Partington - An introduction to Web Performance Optimisation - practical steps for reducing costs and improving the user experience

    Tom Partington
    Tom Partington
    Systems Performance Engineer
    Cevo
    schedule 5 months ago
    Sold Out!
    45 mins
    Talk
    Beginner

    The web is increasingly becoming the standard way in which we conduct our business, but despite the use of ever improving technologies many websites are frustratingly slow and getting slower. It is becoming more difficult to compete for and retain users attention, and If you operate in the online space you can no longer afford to ignore the performance of your website or platform.

    This talk will provide an introduction to and the benefits of web-performance optimisation, explain why it matters now more than ever and why it's so commonly overlooked during the development process. It will also show how you can identify and fix the most common performance pitfalls, resulting in reduced costs, and increased user engagement and satisfaction.

    During this talk there will be an opportunity to follow along on your own laptop and learn how to use some of the tools firsthand.

  • Liked Stephen Dodd
    keyboard_arrow_down

    Stephen Dodd - South Park Sprint - Design Thinking Insights

    20 mins
    Talk
    Beginner

    Listening to a talk by Jeff Patton around user story mapping and in particular the origins of story mapping left me thinking of similarities to a documentary featuring South Park's Trey Parker and Matt Stone called 6 days to air.

    This talk aims to explain and highlight interesting and unexpected similarities between the South Park team's 6 day episode creation sprint and an Agile software team. Throughout it will extract some of the reasons why / how the South Park creation team can do what they do and explain how we can use these takeaways in our own teams to encourage creativity and input from all team members.

     

  • Liked Pete Cohen
    keyboard_arrow_down

    Pete Cohen / Matt Fellows - “GameDay” - Achieving resilience through Chaos Engineering

    45 mins
    Talk
    Intermediate
    Agility has brought us iterative software development, independent feature teams, nimble architectures and distributed, scalable infrastructure. But how do you have confidence that your production environment keeps working in the face of this emergent complexity and fast paced change?
     
    The answer is to anticipate failure, and to build resilience into every layer. This requires your whole system - not just the software and infrastructure, but also people and processes - to be able to respond quickly and appropriately to unexpected events. And the way to simulate the truly unexpected is to do experiments through the introduction of some chaos.
     
    GameDays bring together people from across an organisation to collaboratively break, observe and recover a system - with the impact on the holistic customer experience at front of mind. Apart from learning how the technical system responds under stress, some of the main benefits come from the shared understandings and process improvements which are generated. GameDays should be more than just an event or a one off exercise - they embody an enduring mindset and a culture.
     
    This session will examine, from a first hand perspective, several case studies of where GameDays have been successfully executed in organisations ranging from startup to enterprise scale. The theoretical underpinnings to chaos engineering will be explored, and a range of practical tips and reference material will be shared.
  • Liked Niall McShane
    keyboard_arrow_down

    Niall McShane - Why LeSS is the heart of Scaled Agile

    20 mins
    Talk
    Intermediate

    Over the last 2 years Niall has coached teams of agile teams through the launch of two Agile Release Trains (SAFe). Niall helped leaders, managers and teams through the process of adopting SAFe.

    Using his real experience as the basis for the presentation, Niall will make the case for moving past SAFe and going to the heart of scaled Agile using Large-Scale Scrum (LeSS).

     

  • Liked Gabor Devenyi
    keyboard_arrow_down

    Gabor Devenyi - People Power - Build on strengths of the individuals

    Gabor Devenyi
    Gabor Devenyi
    Agile Coach
    DXC Consulting
    schedule 6 months ago
    Sold Out!
    20 mins
    Talk
    Beginner

    One of the principles of the Agile manifesto is build projects around motivated individuals. “Give them the environment and support they need, and trust them to get the job done.”.

    However, individuals have different strengths and weaknesses. Our focus shifts quite often on how to improve their performance and how we can “develop” their weaknesses. Science and my personal experience shows that building on the strengths rather than improving our weaknesses will get better results, and not only when we want to build projects around motivated individuals.

  • Liked Kelsey van Haaster
    keyboard_arrow_down

    Kelsey van Haaster - Synchronous Communication is overrated! : How to thrive in an uber distributed team

    45 mins
    Talk
    Intermediate

    The ThoughtWorks Identity team is a globally distributed remote team of 5 people. We deliver IDAAS (Identity as a service) to more than 5000 ThoughtWorkers in 14 different countries and we do it 24 hours a day 7 days a week. 

    We don't have an always-on video link.  There is no time of day of when we can all get on a call together, yet we succeed in providing end to end product development and support to our customers. Including delivering new product to production on a daily basis. 

    We achieve this through choosing not to fight against our distributed nature, but by embracing it and by leveraging the advice contained in the principles and values of the Agile Manifesto 

    This presentation will share our journey and some of the things we have learned along the way and we will challenge the existing thinking behind what is required to thrive as a member of a distributed team.  

  • Liked James Holmes
    keyboard_arrow_down

    James Holmes - Hierarchy is not a dirty word

    James Holmes
    James Holmes
    Architect
    MYOB
    schedule 6 months ago
    Sold Out!
    20 mins
    Talk
    Intermediate

    A common problem for software development teams is that of career progression for technical people. Experienced programmers stagnate at Senior Developer or move into management roles for which they are not trained or they are sometimes simply ill suited.

    This presentation discusses the work underway at MYOB to address this issue.

  • Liked Mike Jones
    keyboard_arrow_down

    Mike Jones - Value Stream Mapping and The Seven Wastes

    Mike Jones
    Mike Jones
    Lead DevOps Engineer
    Bupa
    schedule 6 months ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    Water-scrum-fall just wasn't working for me. Something was fundamentally wrong. I couldn't quite figure out what - or how to fix it - until I found Value Stream Mapping. This was only the beginning.

    Explore the seven wastes of software development and how to apply Value Stream Mapping to software development. Learn where I went wrong, and tips for running your own mapping workshops.

    If you are a people manager, project manager, scrum master or product owner this session will help you see where the bottlenecks REALLY are. 

     

  • Liked Gendry Morales
    keyboard_arrow_down

    Gendry Morales - Less talk, more data driven conversation.

    Gendry Morales
    Gendry Morales
    Principal Consultant
    elabor8
    schedule 5 months ago
    Sold Out!
    45 mins
    Talk
    Intermediate

    Data driven decision making culture. It sounds great in theory, but how do you really get there in practice?

    In this talk I will share insights, stories and examples of data visualisations from my quest to create a data driven decision making culture. I'll show you where to start in building a data driven culture, how to overcome common data resistance patterns and how to create an environment where people use data by default as an input to making decisions around product delivery.

    But data is confronting and it often doesn’t support decisions that have already been made or visions that have already been imagined so a big part of this story is about how we conquer issues around data resistance, sharing data with others and how to build robustness needed to stand up to data undermining attempts.

    And why is data so essential to me? As Lean, Agile and Systems Thinking become more mainstream, it appears the amount of misinformation and misuse is growing and the lack of tangible business outcomes is putting our industry at risk.  We have an obligation to protect the integrity of these practices by showing the relationship between cause and effect. Showing how we have affected business performance, aiming to understand when we have improved it and when we have gone backwards. Having the evidence as well as the great stories about our transformations.