sum(rate(vmagent_remotewrite_send_duration_seconds_total[5m])) by(job, instance, url) 
> 0.9 * max(vmagent_remotewrite_queues) by(job, instance, url)

900 seconds

severity=warning

dashboard:

http://localhost:3000/d/G7Z9GzMGz?viewPanel=84&var-instance={{ $labels.instance }}

description:

The remote write connection between vmagent "{{ $labels.job }}" (instance {{ $labels.instance }}) and destination "{{ $labels.url }}" is saturated by more than 90% and vmagent won't be able to keep up. This usually means that `-remoteWrite.queues` command-line flag must be increased in order to increase the number of connections per each remote storage.

summary:

Remote write connection from "{{ $labels.job }}" (instance {{ $labels.instance }}) to {{ $labels.url }} is saturated

11604620448585840090