vmalert

Rule: TooManyRestartsok

Expr

changes(process_start_time_seconds{job=~"victoriametrics|vmselect|vminsert|vmstorage|vmagent|vmalert"}[15m]) > 2

For

0 seconds

Labels

severity=critical

Annotations

description:

Job {{ $labels.job }} (instance {{ $labels.instance }}) has restarted more than twice in the last 15 minutes. It might be crashlooping.

summary:

{{ $labels.job }} too many restarts (instance {{ $labels.instance }})

Group

1594445953246388460

Last 20 updates:

Updated at	Duration	Executed at	cURL
2026-04-29T16:26:05Z	0.001s	2026-04-29T16:26:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479960'
2026-04-29T16:25:05Z	0.001s	2026-04-29T16:25:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479900'
2026-04-29T16:24:05Z	0.002s	2026-04-29T16:24:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479840'
2026-04-29T16:23:05Z	0.001s	2026-04-29T16:23:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479780'
2026-04-29T16:22:05Z	0.001s	2026-04-29T16:22:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479720'
2026-04-29T16:21:05Z	0.002s	2026-04-29T16:21:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479660'
2026-04-29T16:20:05Z	0.001s	2026-04-29T16:20:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479600'
2026-04-29T16:19:05Z	0.001s	2026-04-29T16:19:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479540'
2026-04-29T16:18:05Z	0.001s	2026-04-29T16:18:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479480'
2026-04-29T16:17:05Z	0.001s	2026-04-29T16:17:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479420'
2026-04-29T16:16:05Z	0.001s	2026-04-29T16:16:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479360'
2026-04-29T16:15:05Z	0.001s	2026-04-29T16:15:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479300'
2026-04-29T16:14:05Z	0.001s	2026-04-29T16:14:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479240'
2026-04-29T16:13:05Z	0.001s	2026-04-29T16:13:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479180'
2026-04-29T16:12:05Z	0.001s	2026-04-29T16:12:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479120'
2026-04-29T16:11:05Z	0.001s	2026-04-29T16:11:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479060'
2026-04-29T16:10:05Z	0.002s	2026-04-29T16:10:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777479000'
2026-04-29T16:09:05Z	0.001s	2026-04-29T16:09:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777478940'
2026-04-29T16:08:05Z	0.001s	2026-04-29T16:08:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777478880'
2026-04-29T16:07:05Z	0.001s	2026-04-29T16:07:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=changes%28process_start_time_seconds%7Bjob%3D~%22victoriametrics%7Cvmselect%7Cvminsert%7Cvmstorage%7Cvmagent%7Cvmalert%22%7D%5B15m%5D%29+%3E+2&step=300s&time=1777478820'