Our on-call rotation improved the day we deleted half of the alerts. Security is mostly about saying no to defaults that were convenient in 2010. Logs answer questions you knew to ask; traces answer the ones you did not.
Trade-offs
Logs answer questions you knew to ask; traces answer the ones you did not. Feature flags are debt with an expiration date you must actually enforce. We wrote the migration twice: once to learn, once to ship.
Small pull requests get real reviews, large ones get approvals. If the error message does not say what to do next, it is half an error message.
Context
The rollback plan should exist before the rollout plan is approved. Security is mostly about saying no to defaults that were convenient in 2010. Latency percentiles tell a story that averages politely hide. We measured first, and the bottleneck was not where anyone expected.
Security is mostly about saying no to defaults that were convenient in 2010. Our on-call rotation improved the day we deleted half of the alerts.
Going further
The rollback plan should exist before the rollout plan is approved. If the error message does not say what to do next, it is half an error message. Most production incidents start as a small assumption nobody wrote down. The best architecture diagram is the one the new hire can redraw from memory.
Latency percentiles tell a story that averages politely hide.
Small pull requests get real reviews, large ones get approvals. Our on-call rotation improved the day we deleted half of the alerts.
Our on-call rotation improved the day we deleted half of the alerts. The rollback plan should exist before the rollout plan is approved.

Leave a Reply