vmalert

Rule: TooManyLogsok

Expr

sum(increase(vm_log_messages_total{level="error"}[5m])) by (job, instance) > 0

For

900 seconds

Labels

severity=warning

Annotations

description:

Logging rate for job "{{ $labels.job }}" ({{ $labels.instance }}) is {{ $value }} for last 15m. Worth to check logs for specific error messages.

summary:

Too many logs printed for job "{{ $labels.job }}" ({{ $labels.instance }})

Group

1594445953246388460

Last 20 updates:

Updated at	Duration	Executed at	cURL
2026-04-29T16:26:05Z	0.001s	2026-04-29T16:26:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479960'
2026-04-29T16:25:05Z	0.001s	2026-04-29T16:25:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479900'
2026-04-29T16:24:05Z	0.001s	2026-04-29T16:24:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479840'
2026-04-29T16:23:05Z	0.001s	2026-04-29T16:23:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479780'
2026-04-29T16:22:05Z	0.001s	2026-04-29T16:22:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479720'
2026-04-29T16:21:05Z	0.001s	2026-04-29T16:21:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479660'
2026-04-29T16:20:05Z	0.001s	2026-04-29T16:20:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479600'
2026-04-29T16:19:05Z	0.001s	2026-04-29T16:19:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479540'
2026-04-29T16:18:05Z	0.001s	2026-04-29T16:18:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479480'
2026-04-29T16:17:05Z	0.001s	2026-04-29T16:17:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479420'
2026-04-29T16:16:05Z	0.001s	2026-04-29T16:16:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479360'
2026-04-29T16:15:05Z	0.001s	2026-04-29T16:15:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479300'
2026-04-29T16:14:05Z	0.001s	2026-04-29T16:14:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479240'
2026-04-29T16:13:05Z	0.001s	2026-04-29T16:13:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479180'
2026-04-29T16:12:05Z	0.001s	2026-04-29T16:12:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479120'
2026-04-29T16:11:05Z	0.001s	2026-04-29T16:11:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479060'
2026-04-29T16:10:05Z	0.001s	2026-04-29T16:10:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479000'
2026-04-29T16:09:05Z	0.001s	2026-04-29T16:09:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777478940'
2026-04-29T16:08:05Z	0.001s	2026-04-29T16:08:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777478880'
2026-04-29T16:07:05Z	0.001s	2026-04-29T16:07:05Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vm_log_messages_total%7Blevel%3D%22error%22%7D%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777478820'