Working Code Podcast - Episode 54: We're So Quacked!

At 3:30 AM the day before Thanksgiving, I received an emergency page about a failing API end-point. Rushing to my desk, groggy-eyed and in various states of undress, I jumped into the #incident channel on Slack to see what was happening. What unfolded over the next 30-hours was the manifestation of my worst nightmare. The moment I had been dreading for the last 4-years had finally come to pass: two of my database columns had run out of storage space! Using feature flags, emergency hot-fixes, shadow tables, and a database migration being performed over a transient and unstable terminal session, my and my team somehow made it through to the other side just in time to enjoy Thanksgiving turkey and pumpkin pie!

"Hug your data engineers - they are amazing people!" — Ben Nadel

All that and more on this week's show:

... featuring these beautiful, beautiful people:

• Adam Tuttle → Website, Twitter, LinkedIn
• Carol Weiler → Twitter, LinkedIn
• Tim Cunningham → Twitter, LinkedIn
• Ben Nadel (that's me) → Website, Twitter, LinkedIn

With audio editing and engineering by ZCross Media.

For the full show notes and links, visit the episode page. And, be sure to follow the show and come chat with us on Discord! Our website is workingcode.dev and we're @WorkingCodePod on Twitter and Instagram. Or, leave us a message at (512) 253-2633 (that's 512-253-CODE). New episodes drop weekly on Wednesday.

Short link: https://bennadel.com/4171