Page MenuHomeSoftware Heritage
Create Task
Maniphest T1604

Improve kafka deployment
Closed, MigratedEdits Locked
Actions

Description

with

  • enough storage
  • HA
  • replication

Related Objects
Search...

Event Timeline

douardda created this task.Mar 25 2019, 11:32 AM
zack triaged this task as Normal priority.Mar 25 2019, 3:07 PM
olasd created subtask T1621: Add metrics to the currently deployed kafka cluster.Apr 2 2019, 12:56 PM
zack added a project: System administration.Apr 2 2019, 2:43 PM
olasd mentioned this in rSPSITEca01c0e02614: Add esnode1,2,3 as kafka brokers.May 14 2019, 5:34 PM
olasd closed this task as Resolved.May 14 2019, 7:49 PM
olasd claimed this task.
olasd added a subscriber: olasd.

So that took a few tries in puppet, but adding new brokers to the kafka deployment should now be seamless.

The three elasticsearch nodes have been added as brokers to the current kafka cluster.

The existing topics are being rebalanced and replicated to span the four nodes of the cluster, each with 2 replicas.

gitlab-migration changed the task status from Resolved to Migrated.Oct 19 2022, 5:55 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

gitlab-migration closed subtask T1621: Add metrics to the currently deployed kafka cluster as Migrated.Oct 19 2022, 5:55 PM
About · Developer information · Legal