Choose a Prometheus alert for duration from failure tolerance
Prometheus alert for duration: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Use Prometheus blackbox exporter to test the user-visible path
Prometheus blackbox exporter: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Set a Prometheus cardinality budget before adding labels
Prometheus cardinality budget: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Calculate latency with histogram_quantile without averaging percentiles
Prometheus histogram_quantile: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Use Prometheus recording rules for stable, expensive shared queries
Prometheus recording rules: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Test Prometheus alerting rules with promtool before loading them
Promtool test rules: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Handle Prometheus missing metrics without converting absence into zero
Prometheus missing metrics staleness: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Debug Prometheus target relabeling before samples disappear
Prometheus relabel_configs: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
PromQL rate vs irate: choose by alerting and graph resolution
PromQL rate vs irate: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.
Build SLO burn-rate alerts from good and total events
SLO burn rate alerts: inspect the effective state, interpret expected and abnormal results, make one bounded change, verify, and roll back safely.