Diffusion puppet-swh-site 6657bf88897d

Add a monitoring alert when logstash is failing to send logs to ES
6657bf88897d
Actions

Tags

None

Subscribers

None

Description

Add a monitoring alert when logstash is failing to send logs to ES

Monitor errors (with_errors and non_retryable_errors) which are errors
detected when the messages should be ingested by ES.
Ignore failures because this counter is increased when an ES node
is not responding which can be a normal case during maintenance phases

Related to T3222

Details

Provenance

vsellier	Authored on May 7 2021, 12:00 PM
vsellier	Pushed on May 7 2021, 2:53 PM

Differential Revision

D5709: Add a monitoring alert when logstash is failing to send logs to ES

Parents

rSPSITE09c766391ec2: keycloak: Set SSO Session Idle to one week, Session Max to one month

Branches

Unknown

Tags

Unknown

Tasks

T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested

Event Timeline

vsellier committed rSPSITE6657bf88897d: Add a monitoring alert when logstash is failing to send logs to ES (authored by vsellier).May 7 2021, 2:44 PM

vsellier added a task: T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested.May 7 2021, 2:54 PM

vsellier added an edge: D5709: Add a monitoring alert when logstash is failing to send logs to ES.

Changes (5)

Path

Size

site-modules/

profile/

files/

icinga2/

plugins/

check_logstash_errors.sh

manifests/

icinga2/

objects/

common_checks.pp

logstash_checks.pp

static_checks.pp

rSPSITE6657bf88897d

site-modules/profile/files/icinga2/plugins/check_logstash_errors.sh

Loading...

site-modules/profile/manifests/icinga2/objects/common_checks.pp

Loading...

site-modules/profile/manifests/icinga2/objects/logstash_checks.pp

Loading...

site-modules/profile/manifests/icinga2/objects/static_checks.pp

Loading...

site-modules/profile/manifests/logstash.pp

Loading...