Page MenuHomeSoftware Heritage
Create Task
Maniphest T2591

Filebeat fails to start on moma
Closed, MigratedEdits Locked
Actions

Description

The filebeat process doesn't start in moma with this error :

Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.377Z        INFO        instance/beat.go:310        Setup Beat: filebeat; Version: 7.8.0
Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.378Z        INFO        [publisher]        pipeline/module.go:113        Beat name: moma
Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.379Z        INFO        instance/beat.go:436        filebeat stopped.
Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.379Z        ERROR        instance/beat.go:958        Exiting: 1 error: setting 'filebeat.prospectors' has been removed
Sep 15 07:35:37 moma filebeat[1747745]: Exiting: 1 error: setting 'filebeat.prospectors' has been removed
Sep 15 07:35:37 moma systemd[1]: filebeat.service: Main process exited, code=exited, status=1/FAILURE

The configuration use the keyworkd `filebeat.prospectors` which was removed in filebeat 6.3 [1]

[1] https://www.elastic.co/blog/brewing-in-beats-rename-filebeat-prospectors-to-inputs

Revisions and Commits

rSPSITE puppet-swh-site
D3961rSPSITEc56d9612ca75 Manage filebeat configuration via puppet

Event Timeline

vsellier changed the task status from Open to Work in Progress.Sep 15 2020, 10:05 AM
vsellier triaged this task as Normal priority.
vsellier created this task.
vsellier updated the task description. (Show Details)Sep 15 2020, 10:08 AM
vsellier added a comment.Sep 15 2020, 10:29 AM

The configuration was fixed on moma :

root@moma:/etc/filebeat# diff -U3 /tmp/filebeat.yml /etc/filebeat/filebeat.yml
--- /tmp/filebeat.yml	2020-09-15 08:10:20.512838905 +0000
+++ /etc/filebeat/filebeat.yml	2020-09-15 08:16:13.096135043 +0000
@@ -1,4 +1,4 @@
-filebeat.prospectors:
+filebeat.inputs:
 - type: log
   paths:
     - /var/log/apache2/archive.softwareheritage.org_non-ssl_access.log

and the logs since the last rotation correctly ingested :

the puppet scripts will be updated to manage this configuration

vsellier added a revision: D3961: Manage filebeat configuration via puppet.Sep 16 2020, 11:11 AM
vsellier added a commit: rSPSITEc56d9612ca75: Manage filebeat configuration via puppet.Sep 22 2020, 3:11 PM
vsellier closed this task as Resolved.Sep 22 2020, 3:17 PM

The configuration is now managed by puppet.

gitlab-migration changed the task status from Resolved to Migrated.Oct 19 2022, 5:58 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal