← Back to the carnage
BUILDKITE
⚪ Buildkite's job dispatcher developed a sudden appreciation for slowness between 02:30-03:13 UTC—turns out a 'critical query optimization' was actually a critical query pessimization. Someone's feature flag is now permanently flipped to the 'off' position after its wild 43-minute joyride. (Auto-resolved: no updates in 24h)
// The official story
Increased dispatch latency
// Status page says
Jan 16 , 03:46 UTC Resolved - This incident is now resolved. Jan 16 , 03:42 UTC Monitoring - Between 02:30 UTC and 03:13 UTC we observed an increase in latency dispatching jobs in concurrency groups for some customers. We've identified a code change which modified a critical query in selecting jobs in a concurrency group, and disabled the associated feature fla
🔗 Official status page (for the PR-approved version)
https://www.buildkitestatus.com/incidents/6qp681ppdyqjBuildkite's Greatest Hits
🟢 BUILDKITE
Sep 21, 2026
🔴 AWS decided to take the entire us-east-1 region offline without asking permission. Buildkite's engineers are now in that special state of alert where 'monitoring the situation' is corporate speak for 'refresh the status page and hope it fixes itself.'. (Auto-resolved: no updates in 24h)
🟢 BUILDKITE
Aug 03, 2026
🟠 Buildkite's pipeline machinery got sluggish across job dispatch, uploads, and webhooks. Turns out the problem was bigger than expected—scheduled builds also decided to take the scenic route. Engineers claim the fix is rolling out, which in status-page speak means 'we're throwing things at the wall.'. (Auto-resolved: no updates in 24h)
🟢 BUILDKITE
May 08, 2026
🟡 AWS's us-east-1 decided to ghost one of its availability zones. Buildkite's engineers are refreshing their dashboards with the confidence of someone who hasn't noticed the fire yet. Thoughts and prayers for the monitoring alert budget. (Auto-resolved: no updates in 24h)
🟢 BUILDKITE
May 01, 2026
🔴 Someone shipped a change that thought it was a feature but was actually a saboteur. They're frantically hitting ctrl+z and praying it sticks. The pipeline has left the building. (Auto-resolved: no updates in 24h)