AM1 - Unable to print or delay in printing

Incident Report for BarTender Cloud Status Page

Postmortem

RCA #166 Summary

BarTender Cloud was temporarily unavailable in AM1 cluster due to a certificate validation issue. This impacted authentication with inbound traffic, temporarily disrupting platform services.

Upon identifying the root cause, we manually rotated the certificates to restore communication between all cluster nodes. Once the main components were reestablished, we validated platform functionality, confirming full recovery.

In order to prevent this type of incident in the future we are accelerating our infrastructure scalability plans for migration to Amazon EKS container orchestration layer, as well as implementing Amazon EKS automated certificate management services.

Posted Mar 14, 2025 - 09:49 PDT

Resolved

This incident has been resolved.
Posted Mar 13, 2025 - 01:27 PDT

Monitoring

A fix has been implemented and we are monitoring the results.
Posted Mar 12, 2025 - 23:45 PDT

Identified

The issue has been identified and a fix is being implemented.
Posted Mar 12, 2025 - 23:30 PDT

Update

We are continuing to investigate this issue.
Posted Mar 12, 2025 - 23:18 PDT

Update

We are continuing to investigate this issue.
Posted Mar 12, 2025 - 23:05 PDT

Update

We are continuing to investigate this issue.
Posted Mar 12, 2025 - 22:17 PDT

Update

We are continuing to investigate this issue. We are looking at a specific service that has errored out and working to deploy a fix.
Posted Mar 12, 2025 - 21:42 PDT

Update

We are continuing to investigate this issue.
Posted Mar 12, 2025 - 21:19 PDT

Investigating

We are currently investigating this issue.
Posted Mar 12, 2025 - 20:44 PDT
This incident affected: AM1 - BarTender Cloud (AM1 - BarTender Cloud Web Portal).