← Back to the carnage
BUILDKITE

⚪ Buildkite's job dispatcher developed a sudden appreciation for slowness between 02:30-03:13 UTC—turns out a 'critical query optimization' was actually a critical query pessimization. Someone's feature flag is now permanently flipped to the 'off' position after its wild 43-minute joyride. (Auto-resolved: no updates in 24h)

⏰ Jan 19, 2026 Fixed (for now) spotted via status_rss

// The official story

Increased dispatch latency

// Status page says

Jan 16 , 03:46 UTC Resolved - This incident is now resolved. Jan 16 , 03:42 UTC Monitoring - Between 02:30 UTC and 03:13 UTC we observed an increase in latency dispatching jobs in concurrency groups for some customers. We've identified a code change which modified a critical query in selecting jobs in a concurrency group, and disabled the associated feature fla

🔗 Official status page (for the PR-approved version)

https://www.buildkitestatus.com/incidents/6qp681ppdyqj

Buildkite's Greatest Hits

🟢 BUILDKITE Sep 21, 2026
🔴 AWS decided to take the entire us-east-1 region offline without asking permission. Buildkite's engineers are now in that special state of alert where 'monitoring the situation' is corporate speak for 'refresh the status page and hope it fixes itself.'. (Auto-resolved: no updates in 24h)
🟢 BUILDKITE Aug 03, 2026
🟠 Buildkite's pipeline machinery got sluggish across job dispatch, uploads, and webhooks. Turns out the problem was bigger than expected—scheduled builds also decided to take the scenic route. Engineers claim the fix is rolling out, which in status-page speak means 'we're throwing things at the wall.'. (Auto-resolved: no updates in 24h)
🟢 BUILDKITE May 08, 2026
🟡 AWS's us-east-1 decided to ghost one of its availability zones. Buildkite's engineers are refreshing their dashboards with the confidence of someone who hasn't noticed the fire yet. Thoughts and prayers for the monitoring alert budget. (Auto-resolved: no updates in 24h)
🟢 BUILDKITE May 01, 2026
🔴 Someone shipped a change that thought it was a feature but was actually a saboteur. They're frantically hitting ctrl+z and praying it sticks. The pipeline has left the building. (Auto-resolved: no updates in 24h)