Page MenuHomeSoftware Heritage

Filebeat fails to start on moma
Closed, ResolvedPublic

Description

The filebeat process doesn't start in moma with this error :

Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.377Z        INFO        instance/beat.go:310        Setup Beat: filebeat; Version: 7.8.0
Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.378Z        INFO        [publisher]        pipeline/module.go:113        Beat name: moma
Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.379Z        INFO        instance/beat.go:436        filebeat stopped.
Sep 15 07:35:37 moma filebeat[1747745]: 2020-09-15T07:35:37.379Z        ERROR        instance/beat.go:958        Exiting: 1 error: setting 'filebeat.prospectors' has been removed
Sep 15 07:35:37 moma filebeat[1747745]: Exiting: 1 error: setting 'filebeat.prospectors' has been removed
Sep 15 07:35:37 moma systemd[1]: filebeat.service: Main process exited, code=exited, status=1/FAILURE

The configuration use the keyworkd `filebeat.prospectors` which was removed in filebeat 6.3 [1]

[1] https://www.elastic.co/blog/brewing-in-beats-rename-filebeat-prospectors-to-inputs

Event Timeline

vsellier changed the task status from Open to Work in Progress.Tue, Sep 15, 10:05 AM
vsellier triaged this task as Normal priority.
vsellier created this task.
vsellier updated the task description. (Show Details)Tue, Sep 15, 10:08 AM

The configuration was fixed on moma :

root@moma:/etc/filebeat# diff -U3 /tmp/filebeat.yml /etc/filebeat/filebeat.yml
--- /tmp/filebeat.yml	2020-09-15 08:10:20.512838905 +0000
+++ /etc/filebeat/filebeat.yml	2020-09-15 08:16:13.096135043 +0000
@@ -1,4 +1,4 @@
-filebeat.prospectors:
+filebeat.inputs:
 - type: log
   paths:
     - /var/log/apache2/archive.softwareheritage.org_non-ssl_access.log

and the logs since the last rotation correctly ingested :

the puppet scripts will be updated to manage this configuration

vsellier closed this task as Resolved.Tue, Sep 22, 3:17 PM

The configuration is now managed by puppet.