Differential D4747

Decomission kafka from esnodes
ClosedPublic
Actions

Authored by ardumont on Dec 15 2020, 6:32 PM.

Details

Reviewers

vsellier

Group Reviewers

System administrators

Maniphest Tasks

T2888: Elasticsearch cluster failure during a rolling restart

Summary

As a tryout the services got stopped [1]
And nothing seems to complain about it.

We may be able to also drop the rocquencourt_legacy setup from kafka.yaml as well.
And decomission the zookeeper* nodes [2]

[1] https://grafana.softwareheritage.org/d/swL4gbeik/kafka-overview?orgId=1&from=1608052742652&to=1608054542652&var-cluster=All&var-instance=

[2] D4757

Related to T2888

Test Plan

bin/octocatalog-diff

*** Running octocatalog-diff on host esnode1.internal.softwareheritage.org
I, [2020-12-15T18:32:10.322281 #23018]  INFO -- : Catalogs compiled for esnode1.internal.softwareheritage.org
I, [2020-12-15T18:32:11.551906 #23018]  INFO -- : Diffs computed for esnode1.internal.softwareheritage.org
diff origin/production/esnode1.internal.softwareheritage.org current/esnode1.internal.softwareheritage.org
*******************************************
- Anchor[java::begin:]
*******************************************
- Anchor[java::end]
*******************************************
- Archive[/var/tmp/kafka/kafka_2.13-2.6.0.tgz]
*******************************************
- Concat_file[profile::cron::kafka]
*******************************************
- Concat_fragment[profile::cron::kafka-purge-logs]
*******************************************
- Concat_fragment[profile::cron::kafka-zip-logs]
*******************************************
- Concat_fragment[profile::cron::kafka::_header]
*******************************************
- Exec[create /srv/kafka/logdir]
*******************************************
- Exec[update-java-alternatives]
*******************************************
- File[/etc/cron.d/puppet-kafka]
*******************************************
- File[/etc/init.d/kafka]
*******************************************
- File[/etc/systemd/system/kafka.service.d/exitcode.conf]
*******************************************
- File[/etc/systemd/system/kafka.service.d/restart.conf]
*******************************************
- File[/etc/systemd/system/kafka.service.d/stop-timeout.conf]
*******************************************
- File[/etc/systemd/system/kafka.service.d]
*******************************************
- File[/etc/systemd/system/kafka.service]
*******************************************
- File[/opt/kafka-2.13-2.6.0]
*******************************************
- File[/opt/kafka/config/server.properties]
*******************************************
- File[/opt/kafka/config]
*******************************************
- File[/opt/kafka]
*******************************************
- File[/opt/prometheus-jmx-exporter/jmx_prometheus_javaagent-0.11.0.jar]
*******************************************
- File[/opt/prometheus-jmx-exporter/kafka.yml]
*******************************************
- File[/opt/prometheus-jmx-exporter]
*******************************************
- File[/srv/kafka/logdir]
*******************************************
- File[/var/log/kafka]
*******************************************
- File[/var/tmp/kafka]
*******************************************
- File_line[java-home-environment]
*******************************************
- Group[kafka]
*******************************************
- Package[java-common]
*******************************************
- Package[java]
*******************************************
- Profile::Cron::D[kafka-purge-logs]
*******************************************
- Profile::Cron::D[kafka-zip-logs]
*******************************************
- Profile::Cron::File[kafka]
*******************************************
- Profile::Prometheus::Export_scrape_config[kafka]
*******************************************
- Service[kafka]
*******************************************
- Systemd::Dropin_file[kafka/exitcode.conf]
*******************************************
- Systemd::Dropin_file[kafka/restart.conf]
*******************************************
- Systemd::Dropin_file[kafka/stop-timeout.conf]
*******************************************
- User[kafka]
*******************************************
*** End octocatalog-diff on esnode1.internal.softwareheritage.org