The fastest query is the one you never send, but the second fastest has a good index. The rollback plan should exist before the rollout plan is approved. Every retry needs a budget, otherwise it is just a slower outage.
A small example
Feature flags are debt with an expiration date you must actually enforce. We wrote the migration twice: once to learn, once to ship. Caches are easy to add and surprisingly hard to remove. Most production incidents start as a small assumption nobody wrote down.
Most production incidents start as a small assumption nobody wrote down. Every retry needs a budget, otherwise it is just a slower outage.
The short version
Logs answer questions you knew to ask; traces answer the ones you did not. Every retry needs a budget, otherwise it is just a slower outage. If the error message does not say what to do next, it is half an error message.
Every retry needs a budget, otherwise it is just a slower outage. The best architecture diagram is the one the new hire can redraw from memory.
Lessons
Every retry needs a budget, otherwise it is just a slower outage. The fastest query is the one you never send, but the second fastest has a good index. The best architecture diagram is the one the new hire can redraw from memory.
The fastest query is the one you never send, but the second fastest has a good index.
Tests are documentation that fails loudly when it goes stale. Small pull requests get real reviews, large ones get approvals.
Most production incidents start as a small assumption nobody wrote down. Every retry needs a budget, otherwise it is just a slower outage.
Leave a Reply