Page MenuHomeSoftware Heritage

indexer: Use public brokers in production, internal ones for staging
ClosedPublic

Authored by ardumont on Thu, Sep 15, 6:28 PM.

Details

Summary

Related to T4459
Depends on D8492

Test Plan

octo-diff updates brokers for production indexer and nothing for staging:

$SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff indexer-worker04.euwest.azure.internal.softwareheritage.org
...
diff origin/production/indexer-worker04.euwest.azure.internal.softwareheritage.org current/indexer-worker04.euwest.azure.internal.softwareheritage.org
*******************************************
  File[/etc/softwareheritage/indexer/origin_intrinsic_metadata.yml] =>
   parameters =>
     content =>
      @@ -96,8 +96,8 @@
       journal:
         brokers:
      -  - kafka1.internal.softwareheritage.org
      -  - kafka2.internal.softwareheritage.org
      -  - kafka3.internal.softwareheritage.org
      -  - kafka4.internal.softwareheritage.org
      +  - broker1.journal.softwareheritage.org:9093
      +  - broker2.journal.softwareheritage.org:9093
      +  - broker3.journal.softwareheritage.org:9093
      +  - broker4.journal.softwareheritage.org:9093
         group_id: swh::deploy::indexer_journal_client::journal::username-swh.indexer.journal_client.origin_intrinsic_metadata
         prefix: swh.journal.objects
*******************************************
*** End octocatalog-diff on indexer-worker04.euwest.azure.internal.softwareheritage.org
$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff worker0.internal.staging.swh.network
...
*** Running octocatalog-diff on host worker0.internal.staging.swh.network
I, [2022-09-15T18:27:54.044770 #3504618]  INFO -- : Catalogs compiled for worker0.internal.staging.swh.network
I, [2022-09-15T18:27:54.420873 #3504618]  INFO -- : Diffs computed for worker0.internal.staging.swh.network
I, [2022-09-15T18:27:54.420907 #3504618]  INFO -- : No differences
*** End octocatalog-diff on worker0.internal.staging.swh.network

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Explicit the 9093 port for public access to broker through tls

This revision is now accepted and ready to land.Fri, Sep 16, 4:42 PM