Office 365 Outage Alert
Office 365 Outage for September 4, 2018
At approximately 4a CDT, Office 365 online services went down due to severe weather causing power spikes that damaged cooling in the Microsoft San Antonio Data Center. If you try to logon at portal.office.com you will see the following message:
Our services aren’t available right now
We’re working to restore all services as soon as possible. Please check back soon.
Ref A: B0BA7A068B094A2093CB808A2E70A90D Ref B: SN1EDGE0806 Ref C: 2018-09-04T13:31:17Z
ActiveSync on smartphones appears to be working sporadically, but Outlook and Skype for Business will not accept a password. Similarly, clients running AD Connect on their network are receiving synchronization errors.
You can check status at status.office365.com to receive the latest service notifications:
Office 365 Service Health Status #1
Title: Office 365 admin center access issue
Start time: Tuesday, September 4, 2018, at 9:09 AM UTC
Next update by: Tuesday, September 4, 2018, at 2:30 PM UTC (9:30 AM CDT)
Current status: We’ve identified a problem that may be preventing customers from accessing the Office 365 admin center. We’re working to restore access to the admin center, and we’ll provide more information when we’ve isolated the root cause. As an interim solution, you can reference the list of active service incidents below to get the most recent status. If an incident shown below didn’t previously show on your organization’s SHD, you can safely ignore it.
ID: MO147606
Title: Unable to access Office365 services
User Impact: Users may be unable to authenticate or connect to the Office 365 service.
Current status: We’ve determined that a data center issue caused a subset of the Office 365 service to become degraded. We’re connecting some of the affected services to an alternate infrastructure, while remediating the underlying issue within the datacenter.
Office 365 Service Health Status #2
ID: MO147606
Title: Unable to access Office365 services
User Impact: Users may be unable to access or use some features within the Office 365 service.
More info: Users who are able to access the service may experience the following behavior:
Exchange – Some users may be unable to access Outlook on the web. Email access through other protocols may be unaffected.
Power BI – Users may receive ‘Server unavailable’ error or may be unable to log in.
SharePoint – Users may experience latency and stale search results. Further details on SharePoint mitigation can be found under the SI# SP147560.
Microsoft Teams – Users may be unable to access Office documents within Teams.
Intune – Affected users may be unable access the Intune portal or other functionality.
Current status: We’re continuing to connect the affected services to an alternate infrastructure, while remediating the underlying issue within the datacenter.
Scope of impact: This issue could potentially affect any of your users who are hosted out of the San Antonio data center. Impact is specific to a subset of users who are served through the affected infrastructure.
Start time: Tuesday, September 4, 2018, at 9:09 AM UTC
Preliminary root cause: A data center issue caused a subset of the Office 365 service to become degraded.
Next update by: Tuesday, September 4, 2018, at 4:30 PM UTC (11:30 AM CDT)
Office 365 Service Health Status #3
Title: Unable to access Office365 services
User impact: Users may be unable to access or use some features within the Office 365 service.
More info: Users who are able to access the service may experience the following behavior:
Exchange – Some users may be unable to access Outlook on the web. Email access through other protocols may be unaffected.
Power BI – Users may receive a ‘Server unavailable’ error or may be unable to log in.
SharePoint – Most impact has been mitigated, but a subset of users may be unable to make or save changes and may experience stale search results. Further details on SharePoint mitigation can be found under service incident SP147560.
Microsoft Teams – Users may be unable to access Office documents within Teams.
Intune – Affected users may be unable access the Intune portal or other functionality.
Education – Affected users may be seeing issues with services including School Data Sync.
Current status: We’re continuing to recover the impacted network components within the affected data center while we work to move dependent services to alternate, healthy infrastructure.
Scope of impact: This issue could potentially affect any of your users who are hosted out of the San Antonio data center. Impact is specific to a subset of users who are served through the affected infrastructure.
Start time: Tuesday, September 4, 2018, at 9:09 AM UTC
Preliminary root cause: Extreme weather in the San Antonio area caused a data center issue, which has affected multiple Office 365 services.
Next update by: Tuesday, September 4, 2018, at 6:00 PM UTC (1:00 PM CDT)
Office 365 Service Health Status #4
Title: Unable to access Office365 services
User Impact: Users may be unable to access or use some features within the Office 365 service.
More info: Users may be intermittently unable to access the Office 365 portal. Additionally, users who are able to access the service may experience the following behaviors:
Exchange – Some users were unable to access Outlook on the web, though service is now restored. Email access through other protocols was unaffected.
Power BI – A subset of users may receive a ‘Server unavailable’ error or may be unable to log in, though our monitoring indicates that availability has recovered. Further details on Power BI can be found under service incident PB147603.
SharePoint – Most impact has been mitigated, but a small subset of users may be unable to make or save changes to SharePoint sites and content. Further details on SharePoint mitigation can be found under service incidents SP147560 and SP147618.
Microsoft Teams – Users may be unable to authenticate or access Office documents within Teams. We’re working to verify that this issue is now resolved. Further details on Microsoft Teams can be found under service incident TM147598 and TM147626.
Intune – Affected users may be intermittently unable to access the Intune portal or other functionality. Further details on Microsoft Intune can be found under service incident IT147609.
Education – Affected users may be seeing issues with services including School Data Sync.
Current status: We’re continuing to resolve issues with degraded network components within the affected data center while we increase resiliency to ensure that the recovered services remain stable. In parallel, we’re moving some services to alternate, healthy infrastructure.
Scope of impact: This issue could potentially affect any of your users who are hosted out of the San Antonio data center. Impact is specific to a subset of users who are served through the affected infrastructure.
Start time: Tuesday, September 4, 2018, at 9:09 AM UTC
Preliminary root cause: Extreme weather in the San Antonio area caused a data center issue, which has affected multiple Office 365 services.
Next update by: Tuesday, September 4, 2018, at 10:00 PM UTC (5:00 PM CDT)
Office 365 Service Health Status #5
Title: Unable to access Office365 services
User Impact: Users may be unable to access or use some features within the Office 365 service.
More info: Users may be intermittently unable to access the Office 365 portal. Additionally, users who are able to access the service may experience the following behaviors:
Exchange – Some users were unable to access Outlook on the web, though service is now restored. Email access through other protocols was unaffected.
Power BI – A subset of users may receive a ‘Server unavailable’ error or may be unable to log in, though our monitoring indicates that availability has recovered. Further details on Power BI can be found under service incident PB147603.
SharePoint – Most impact has been mitigated, but a small subset of users may be unable to make or save changes to SharePoint sites and content. Further details on SharePoint mitigation can be found under service incidents SP147560 and SP147618.
Microsoft Teams – Users may be unable to authenticate or access Office documents within Teams. We’re working to verify that this issue is now resolved. Further details on Microsoft Teams can be found under service incident TM147626.
Intune – Affected users may be intermittently unable to access the Intune portal or other functionality. Further details on Microsoft Intune can be found under service incident IT147609.
Education – Affected users may be seeing issues with services including School Data Sync and Assignments within Teams. Further details on School Data Sync can be found under service incident OE147685.
Current status: We’re continuing to apply mitigations and our telemetry indicates that availability for the remaining impacted services is improving.
Scope of impact: This issue could potentially affect any of your users who are hosted out of the San Antonio data center. Impact is specific to a subset of users who are served through the affected infrastructure.
Start time: Tuesday, September 4, 2018, at 9:09 AM UTC
Preliminary root cause: Extreme weather in the San Antonio area caused a data center issue, which has affected multiple Office 365 services.
Next update by: Wednesday, September 5, 2018, at 1:00 AM UTC (8:00 PM CDT)
Office 365 Service Health Status #6
There are currently no known issues preventing you from signing in to your Office 365 service health dashboard. (10:00 PM CDT)
Aftermath
Microsoft reports that some Azure services are still being restored worldwide. Throughout the day starting at 11:00 AM CDT most Office 365 services were accessible intermittently until fully restored at approximately 10:00 PM CDT.
Microsoft has a 99.99% uptime (or approximately 45 minutes of downtime per month) Service Level Agreement with all cloud customers and is historically reliable as shown at the Office 365 Operations Trust Center.
Matrixforce is a direct Cloud Solution Provider with Microsoft and will publish any necessary customer action upon official notification from Microsoft.
