[Now resolved] Several Microsoft 365 services unavailable

Incident Report for Company Alerts

Resolved

Hello Westpak team,

Early this morning (approx. 12:39am PT), we began to be notified that many of our cloud-hosted servers and services were either offline or responding with a long delay. This includes some of our servers, such as the Westpak website, the Burrito server, the Finance server, and some IT servers. This also includes Microsoft services such as email, single sign-on, Teams, SharePoint, and OneDrive (plus others) as well as Microsoft 365 apps like Word, Excel, and PowerPoint.

As of 4:45am PT, Microsoft has resolved the underlying issue that caused the outage. Everything appears stable at this time. IT will continue to monitor services as normal and provide any updates as necessary. Please submit a ticket if you are experiencing any issues.

For those interested, I have included the MS-provided root cause below:
Preliminary Root Cause: We determined that a change made to the Microsoft Wide Area Network (WAN) impacted connectivity between clients on the internet to Azure, as well as connectivity between services in different regions, as well as ExpressRoute connections.
Posted Jan 25, 2023 - 07:43 PST
This incident affected: Microsoft 365 (Microsoft 365 | Email, Microsoft 365 | OneDrive, Microsoft 365 | Teams), Azure (Burrito Application, Quickbooks, Azure VPN), Atlassian (Confluence, JIRA), Salesforce (Salesforce Production), and Company Website.