Other articles

  1. 'IaaS v PaaS' is the new 'Build v Buy'

    A decade ago we used to talk about Build v Buy. Maybe we still do. IT Managers would passionately argue about the benefits of these approaches. Battles would won and lost. People held deep seated beliefs in the benefits of one over the other, and were frequently stubborn about accepting …

    read more
  2. CloudFormation parameters

    Sometimes you want to deploy your CloudFormation templates in a way that results in specific and different configuration per stack. Perhaps you deploy to a production stack and a development stack and need to flag a different logging value. Maybe your stacks connect to different databases, or expect a different …

    read more
  3. Lambda function environment variables with CloudFormation

    Automated deployments are a good idea, if only because deploying is tedious. Being able to reproduce something confidently, easily, and quickly is priceless.

    I've recently had the need to deploy Lambda functions with some included parameters, so went out to learn about passing variables to CloudFormation and consuming those values …

    read more
  4. 5 Minute Rest API with Docker

    Docker is a wonderful technology to manage environment consistency. It delivers on the promise of Vagrant without having to use Vagrant. All the things that you thought you’d be able to do with virtual machines are easy with Docker.

    In this post I wanted to see how long it …

    read more
  5. Debugging Spark logs with YARN

    Debugging Spark can be quite painful. The error that you see in your application, or even in your job, might not reflect the underlying problem. Here’s how I dig into the executor logs to find what (might) be really happening.

    From the YARN job list, find your job. If …

    read more