Rules

keycloak_audit_alerts

10.385s ago

1.172ms

Rule State Error Last Evaluation Evaluation Time
alert: KeycloakAuditEventsDropped expr: keycloak_events_dropped_total > 0 for: 1m labels: invariant: INV-IAM-09 pd_ref: PD-235 severity: critical annotations: description: '{{ $value }} audit events have been dropped. This violates INV-IAM-09.' summary: Keycloak audit events dropped ok 10.385s ago 482.4us
alert: KeycloakAuditQueueHigh expr: keycloak_events_queue_depth > 1000 for: 5m labels: pd_ref: PD-235 severity: warning annotations: description: Audit event queue depth is {{ $value }}. Events may be delayed. summary: Keycloak audit queue depth high ok 10.385s ago 247.4us
alert: KeycloakAuditForwardingFailed expr: keycloak_audit_forward_failures_total > 0 for: 5m labels: invariant: INV-IAM-09 pd_ref: PD-235 severity: warning annotations: description: Log forwarding has failed {{ $value }} times. Local buffer in use. summary: Keycloak audit log forwarding failed ok 10.385s ago 179.2us
alert: KeycloakAuditReconciliationDelta expr: keycloak_audit_reconciliation_delta > 0 for: 1m labels: invariant: INV-IAM-09 pd_ref: PD-235 severity: critical annotations: description: '{{ $value }} events missing between source and collector.' summary: Keycloak audit event count mismatch ok 10.385s ago 228.1us

application

10.931s ago

2.724ms

Rule State Error Last Evaluation Evaluation Time
alert: HighErrorRate5xx expr: ((sum(increase(http_requests_total{status=~"5.."}[5m])) / sum(increase(http_requests_total[5m]))) * 100 >= 5) and sum(increase(http_requests_total[5m])) >= 20 and sum(increase(http_requests_total{status=~"5.."}[5m])) >= 5 for: 2m labels: component: api pv_alert_kind: errorrate severity: critical annotations: description: Le taux de réponses 5xx applicatives dépasse 5% sur 5 min (>= 20 requêtes, >= 5 erreurs 5xx). runbook: docs/runbooks/alerting5xx-high-5xx.md summary: High 5xx error rate (>= 5%) ok 10.931s ago 2.664ms

infrastructure

25.315s ago

2.197ms

Rule State Error Last Evaluation Evaluation Time
alert: NodeDown expr: up{job="node"} == 0 for: 2m labels: severity: critical annotations: description: '{{ $labels.instance }} is down' summary: Node exporter down ok 25.315s ago 463.4us
alert: HighCPUUsage expr: 100 - (avg by (instance) (rate(node_cpu_seconds_total{mode="idle"}[5m])) * 100) > 80 for: 10m labels: severity: warning annotations: description: CPU usage > 80% on {{ $labels.instance }} summary: High CPU usage ok 25.315s ago 566.3us
alert: HighMemoryUsage expr: (1 - (node_memory_MemAvailable_bytes / node_memory_MemTotal_bytes)) * 100 > 85 for: 5m labels: severity: warning annotations: description: Memory usage > 85% on {{ $labels.instance }} summary: High memory usage ok 25.315s ago 344.1us
alert: DiskSpaceLow expr: (node_filesystem_avail_bytes{mountpoint="/"} / node_filesystem_size_bytes{mountpoint="/"}) * 100 < 15 for: 5m labels: severity: warning annotations: description: Disk space < 15% on {{ $labels.instance }} summary: Low disk space ok 25.315s ago 472.5us
alert: DiskSpaceCritical expr: (node_filesystem_avail_bytes{mountpoint="/"} / node_filesystem_size_bytes{mountpoint="/"}) * 100 < 5 for: 2m labels: severity: critical annotations: description: Disk space < 5% on {{ $labels.instance }} summary: Critical disk space ok 25.315s ago 315us

postgresql

3.941s ago

1.612ms

Rule State Error Last Evaluation Evaluation Time
alert: PostgreSQLDown expr: pg_up == 0 for: 1m labels: severity: critical annotations: description: PostgreSQL on {{ $labels.instance }} is down summary: PostgreSQL is down ok 3.941s ago 961.2us
alert: PostgreSQLTooManyConnections expr: pg_stat_activity_count > 80 for: 5m labels: severity: warning annotations: description: '{{ $value }} connections (>80)' summary: PostgreSQL connections high ok 3.941s ago 184.8us
alert: PostgreSQLDeadlocks expr: increase(pg_stat_database_deadlocks[5m]) > 0 for: 1m labels: severity: warning annotations: description: Deadlocks detected on {{ $labels.datname }} summary: PostgreSQL deadlocks ok 3.941s ago 243.4us
alert: PostgreSQLSlowQueries expr: rate(pg_stat_statements_seconds_total[5m]) > 1 for: 10m labels: severity: warning annotations: description: High query time on {{ $labels.instance }} summary: Slow queries detected ok 3.941s ago 173.9us

services

24.509s ago

3.399ms

Rule State Error Last Evaluation Evaluation Time
alert: ServiceDown expr: probe_success == 0 for: 3m labels: severity: critical annotations: description: '{{ $labels.instance }} is not responding' summary: Service unreachable ok 24.509s ago 1.298ms
alert: APIDown expr: up{job="api"} == 0 for: 2m labels: severity: critical annotations: description: ProbatioVault API is not responding summary: API Backend down ok 24.508s ago 692.2us
alert: GrafanaDown expr: probe_success{instance=~".*grafana.*"} == 0 for: 3m labels: severity: warning annotations: description: Grafana dashboard is not responding summary: Grafana unreachable ok 24.507s ago 754.1us
alert: PrometheusDown expr: up{job="prometheus"} == 0 for: 1m labels: severity: critical annotations: description: Prometheus monitoring is down summary: Prometheus down ok 24.507s ago 273.6us
alert: SonarQubeDown expr: probe_success{instance=~".*sonar.*"} == 0 for: 5m labels: severity: warning annotations: description: SonarQube is not responding summary: SonarQube unreachable ok 24.506s ago 337.6us

ssl

2.897s ago

1.025ms

Rule State Error Last Evaluation Evaluation Time
alert: SSLCertExpiringSoon expr: probe_ssl_earliest_cert_expiry - time() < 86400 * 14 for: 1h labels: severity: warning annotations: description: Certificate for {{ $labels.instance }} expires in < 14 days summary: SSL certificate expiring soon ok 2.897s ago 729.7us
alert: SSLCertExpired expr: probe_ssl_earliest_cert_expiry - time() < 0 for: 1m labels: severity: critical annotations: description: Certificate for {{ $labels.instance }} has expired summary: SSL certificate expired ok 2.897s ago 269.6us