Facebook has finally released its assessment of what was responsible for yesterday’s massive outage of its Instagram, Messenger, and core Facebook service.
Contrary to the thesis circulating yesterday that it was a route leak, the company said that a server configuration change was to blame.
Yesterday, as a result of a server configuration change, many people had trouble accessing our apps and services. We've now resolved the issues and our systems are recovering. We’re very sorry for the inconvenience and appreciate everyone’s patience.
— Meta (@Meta) March 14, 2019
Millions of people were impacted by the outage yesterday, which had users taking to Twitter (and our tips inbox) to vent their frustration or share theories about what was happening inside the company’s networks.
The Facebook outage was the largest ever recorded by the service Downdectector.
Join us at TechCrunch Sessions: AI
Secure your spot for our leading AI industry event with speakers from OpenAI, Anthropic, and Cohere. For a limited time, tickets are just $292 for an entire day of expert talks, workshops, and potent networking.
Exhibit at TechCrunch Sessions: AI
Secure your spot at TC Sessions: AI and show 1,200+ decision-makers what you’ve built — without the big spend. Available through May 9 or while tables last.
Network monitoring firms first began specualting about the cause of the outage yesterday.
“The cause would appear to be internal rather than a network or Internet delivery issue–for example we saw ‘500 internal server errors’ from Facebook,” a ThousandEyes spokesperson wrote in an email. “Given the sheer scale and continuous changes that these web scale providers are constantly making to their applications and infrastructure, sometimes things break as a result of these changes, even in the most capable hands.”
Netscout, which as we reported initially claimed the outage was due to a BGP route leak, later retracted that explanation.
https://twitter.com/dangoodin001/status/1105964066105786368
Update: Facebook, Instagram and Messenger were down for many users
