Almost a week down, with its customers' devices not working
Connected-devices (IoT) company
Almost 1 week: with the service down
-
Service restored
after comparing the deployed code with the repository, fixing resource limits and adding basic monitoring
The situation
A connected-devices (IoT) company. Its customers depend on the cloud service for the devices to work, and the service had been down for almost a week.
What hurt
Customers could not use their devices. The people who built the system were gone. There was no documentation, no infrastructure as code and no monitoring.
What changed
The service was back up and running.