Postmortem Review of January 9th, 2020 Deductions Navigator Incident
On Thursday, January 9th, beginning at approximately 12:30 PM Central time, SupplyPike Deductions Navigator users began to experience issues loading Deductions and Order data in the app. The loading issues were due to a database failure that was caused by a spike in large database queries that were not properly handled. The incident resulted initially in intermittent issues loading data and then progressed where many end users experienced a full outage.
To resolve the issue, our engineers were able to quickly scale up memory. This remedied the loading issues and allowed users to access data at approximately 2:35 PM Central time. In addition, the SupplyPike team will be taking several steps to optimize queries that will prevent a similar incident from occurring in the future.
If there are any questions, our Customer Success team is available by reaching out to firstname.lastname@example.org or by using or in-app chat tool.