vmalert

Rule: RejectedRemoteWriteDataBlocksAreDroppedok

Expr

sum(increase(vmagent_remotewrite_packets_dropped_total[5m])) by (job, instance) > 0

For

900 seconds

Labels

severity=warning

Annotations

dashboard:

http://localhost:3000/d/G7Z9GzMGz?viewPanel=79&var-instance={{ $labels.instance }}

summary:

Job "{{ $labels.job }}" on instance {{ $labels.instance }} drops the rejected by remote-write server data blocks. Check the logs to find the reason for rejects.

Group

11604620448585840090

Last 20 updates:

Updated at	Duration	Executed at	cURL
2026-04-29T16:25:48Z	0.001s	2026-04-29T16:25:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479930'
2026-04-29T16:25:18Z	0.001s	2026-04-29T16:25:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479900'
2026-04-29T16:24:48Z	0.001s	2026-04-29T16:24:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479870'
2026-04-29T16:24:18Z	0.001s	2026-04-29T16:24:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479840'
2026-04-29T16:23:48Z	0.002s	2026-04-29T16:23:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479810'
2026-04-29T16:23:18Z	0.002s	2026-04-29T16:23:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479780'
2026-04-29T16:22:48Z	0.001s	2026-04-29T16:22:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479750'
2026-04-29T16:22:18Z	0.001s	2026-04-29T16:22:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479720'
2026-04-29T16:21:48Z	0.001s	2026-04-29T16:21:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479690'
2026-04-29T16:21:18Z	0.001s	2026-04-29T16:21:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479660'
2026-04-29T16:20:48Z	0.001s	2026-04-29T16:20:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479630'
2026-04-29T16:20:18Z	0.001s	2026-04-29T16:20:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479600'
2026-04-29T16:19:48Z	0.001s	2026-04-29T16:19:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479570'
2026-04-29T16:19:18Z	0.001s	2026-04-29T16:19:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479540'
2026-04-29T16:18:48Z	0.001s	2026-04-29T16:18:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479510'
2026-04-29T16:18:18Z	0.001s	2026-04-29T16:18:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479480'
2026-04-29T16:17:48Z	0.001s	2026-04-29T16:17:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479450'
2026-04-29T16:17:18Z	0.002s	2026-04-29T16:17:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479420'
2026-04-29T16:16:48Z	0.001s	2026-04-29T16:16:48Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479390'
2026-04-29T16:16:18Z	0.001s	2026-04-29T16:16:18Z	curl -X POST -H 'Content-Type: application/json' 'http://victoriametrics:8428/api/v1/query?query=sum%28increase%28vmagent_remotewrite_packets_dropped_total%5B5m%5D%29%29+by+%28job%2C+instance%29+%3E+0&step=300s&time=1777479360'