This week was nuts. We dealt with a service degradation due to issues between our CDN and data center edge network. On a long, holiday weekend it’s the last thing you want to deal with. There were eighteen action items to come out of the post mortem (which was long enough to merit an executive summary). This was one of the weirder issues I have ever seen as it involved three different companies and a few bad hops in a network path. I quoted Baruch Sadogursky two weeks ago, “Pain is instructional.” It definitely is! Meanwhile, my company, Bankrate, was getting acquired by Red Ventures for $1.24 billion.
Hopefully, the week ahead will be calmer. Doubtful given I’ll be in Atlanta on Monday, Denver on Tuesday, back in North Carolina on Sunday, and then back to Michigan later the following. Next week’s edition of DevOps’ish Weekly will be written right after the conclusion of GopherCon 2017! I’m attending GopherCon for the first time ever and am so thankful to have the opportunity to do so. If you’re there ask me for a DevOps’ish sticker.
Full Stack Fest 2017: Problems of today, wonders from the future.
Barcelona, 4–8 Sept. 2017
Are you a curious mind? Full Stack Fest is a week-long conference based in the amazing city of Barcelona that peeks into the web of tomorrow. Serverless, Blockchain, WebVR, Distributed Web, Progressive Web Apps… Come and see! Early bird tickets available with a 10% discount using the code DEVOPSISH. SPONSORED
Department of Choice Concepts
Let’s Encrypt Wildcard Certificates Coming January 2018: “Wildcard certificates will be offered free of charge via our upcoming ACME v2 API endpoint. We will initially only support base domain validation via DNS for wildcard certificates, but may explore additional validation options over time.”
HTTPS for free in Go, with little help of Let’s Encrypt: Here’s how to start HTTPS web server that uses free SSL certificates from Let’s Encrypt.
zinc: Route 53 zone manager. Policy Records on the Cheap.
sops: sops is an editor of encrypted files that supports YAML, JSON and BINARY formats and encrypts with AWS KMS and PGP (by Mozilla).
goreleaser: GoReleaser builds Go binaries for several platforms, creates a GitHub release and then pushes a Homebrew formula to a repository. All that wrapped in your favorite CI.
Kubernetes Playground: This is so cool! Stand up a Kubernetes cluster with dashboard and everything in seconds to tinker with for up to four hours at a time.
Using a GPG key for SSH Authentication: PGP keys and SSH keys are different. It took me longer than I care to admit to understand this, given that the first StackExchange thread I found on the subject made it pretty clear that it’s not trivial to use one where you’re supposed to use the other.
How a 20-year old kernel feature helped USDS improve VA’s network: “this bug is fascinating because we started debugging Ruby on Rails from AWS and found the root cause in the NSOC Cisco Routers thanks to an ancient feature in the Linux kernel.”
kube-shell: Kubernetes shell - An integrated shell for working with the Kubernetes CLI
kubeval: Validate your Kubernetes configuration files, supports multiple Kubernetes versions
Open Sourcing Iris and Oncall: Iris, named after the Greek goddess of messages, is our open-sourced solution for incident escalation and reliable messaging, and has provided LinkedIn with fast, automated escalations for almost two years now.
OpenBSD Will Get Unique Kernels on Each Reboot: A new feature added in test snapshots for OpenBSD releases will create a unique kernel every time an OpenBSD user reboots or upgrades his computer.
Netflix Platform Engineering — we’re just getting started: As Netflix continues to evolve and grow, so do our engineering challenges. The nature of such challenges changes over time — from “greenfield” projects, to “scaling” activities, to “operationalizing” endeavors — all at great scale and break-neck speed.
Department of Dafuq
RIP, Systems Administrator, Welcome DevOps: While the traditional sys admin role may fade away, those who are willing to change can take an exciting journey with cloud and DevOps.
Two Commits That Wrecked the User Experience of Git: Git didn’t have to be so obnoxious, but these two commits set a terrible, unfixable precedent
7 Specific Suggestions to Sabotage DevOps Simply: Have you ever felt like people were conspiring to make DevOps fail? They probably had good intentions but they just made DevOps more difficult than it should be. What if it was actually intentional? The resistance gets organized…
Department of Assemblage Obtainment
SoundCloud Cuts 40% of Staff in Push for Profitability: Music service will close offices in San Francisco, London
Microsoft plans thousands of job cuts in a sales staff overhaul to fuel cloud growth: Microsoft’s layoffs will mostly affect sales, and thousands of jobs will be cut. Most of the changes will affect employees outside of the U.S.
Department of Sane Workplaces
Depression is not a sign of weakness: “What you don’t see is how terribly afraid I am of my own code, what if it’s bad? What if they laugh at me? What if they see how much I actually don’t know? Will I ever know enough?”
It’s 2017 and Mental Health is still an issue in the workplace: “We are in a knowledge economy. Our jobs require us to execute at peak mental performance. When an athlete is injured they sit on the bench and recover. Let’s get rid of the idea that somehow the brain is different.”
Finding, and Landing, the Right Job for You: Finding the right job is really hard. Take a look at my LinkedIn profile and you’ll see evidence of this fact. Finding the right balance of challenge and culture is very hard. These tips on navigating job hunting from Conor Delanbanque are a good start.
How to Interview Engineers: On the other side of job seeking is hiring. As a hiring manager, I am finding it very challenging to get people to open up during that initial phone call. I want details but not rambling, I want low ego but please tell me what you’re proud of. This how to is good and I especially think asking every candidate the same questions is very important.
DevOps’ish Tweet of the Week
I'm Chris Short, 20+ veteran of the IT industry and 11 year veteran of the US Air Force. I help people and companies embrace DevOps practices and tools through writing and public speaking. I am a staunch advocate for transparency and open source solutions to problems. Follow me on Twitter and LinkedIn.
Join the DevOps'ish group on Telegram for insight and in-depth discussions about real technical challenges facing real people.