Configuration changes were the root cause of recent major outage says Facebook
- Published: Tuesday, 05 October 2021 07:13
On October 4th Facebook experienced an outage that lasted more than five hours and impacted many of its social media platforms. In a statement issued by Facebook Engineering, the company blamed configuration changes for the incident.
In a statement, Facebook Engineering spokesperson Santosh Janardhan said:
“Our engineering teams have learned that configuration changes on the backbone routers that coordinate network traffic between our data centers caused issues that interrupted this communication. This disruption to network traffic had a cascading effect on the way our data centers communicate, bringing our services to a halt.
“Our services are now back online and we’re actively working to fully return them to regular operations. We want to make clear at this time we believe the root cause of this outage was a faulty configuration change. We also have no evidence that user data was compromised as a result of this downtime.”
Janardhan also pointed out that resolution of the incident was delayed because the “underlying cause of this outage also impacted many of the internal tools and systems we use in our day-to-day operations, complicating our attempts to quickly diagnose and resolve the problem.”