Facebook Outage Caused by Router Command Bug, Disconnecting Global Network

A routine maintenance command accidentally severs Facebook's global backbone network after a bug in an audit tool fails to stop the error.

A recent massive outage affects Facebook and its platforms after a routine maintenance job goes wrong. The issue stems from the system that manages Facebook's global backbone network, which consists of thousands of miles of fiber-optic cables connecting massive data centers to smaller internet-facing facilities.

During a standard maintenance task, an engineer issues a command to assess global backbone capacity, but this unintentionally disconnects all Facebook data centers from the internet. A bug in the audit tool prevents the system from catching and stopping the erroneous command, leading to a complete loss of server connections.

This total disconnection triggers a secondary problem because the smaller facilities normally handle DNS queries, which act as the internet's address book. With the network completely down, these facilities cannot resolve DNS requests, making it impossible for users to reach Facebook, Instagram, or WhatsApp through standard web addresses.

Read More at the original source →