Page MenuHomeSoftware Heritage

swh-search: use the index with the last mapping version
ClosedPublic

Authored by vsellier on Jun 18 2021, 12:52 PM.

Details

Summary

Related to T3391

Test Plan
  • production: no changes
~/src/swh/puppet-environment master* ❯ bin/octocatalog-diff search1
Found host search1.internal.softwareheritage.org
Cloning into '/tmp/swh-ocd.LFaxmJ4p/environments/production/data/private'...
done.
Cloning into '/tmp/swh-ocd.LFaxmJ4p/environments/staging/data/private'...
done.
*** Running octocatalog-diff on host search1.internal.softwareheritage.org
I, [2021-06-18T12:48:32.246643 #15728]  INFO -- : Catalogs compiled for search1.internal.softwareheritage.org
I, [2021-06-18T12:48:33.212732 #15728]  INFO -- : Diffs computed for search1.internal.softwareheritage.org
I, [2021-06-18T12:48:33.212769 #15728]  INFO -- : No differences
*** End octocatalog-diff on search1.internal.softwareheritage.org
  • staging: index changed
~/src/swh/puppet-environment master* ❯ bin/octocatalog-diff search0.internal.staging.swh.network 
Found host search0.internal.staging.swh.network
Cloning into '/tmp/swh-ocd.HbvmzyGB/environments/production/data/private'...
done.
Cloning into '/tmp/swh-ocd.HbvmzyGB/environments/staging/data/private'...
done.
*** Running octocatalog-diff on host search0.internal.staging.swh.network
*******************************************
  File[/etc/softwareheritage/search/journal_client_indexed.yml] =>
   parameters =>
     content =>
      @@ -8,5 +8,5 @@
         brokers:
         - journal0.internal.staging.swh.network
      -  group_id: swh.search.journal_client.indexed
      +  group_id: swh.search.journal_client.indexed-v0.9.0
         prefix: swh.journal.indexed
         object_types:
*******************************************
  File[/etc/softwareheritage/search/journal_client_objects.yml] =>
   parameters =>
     content =>
      @@ -8,5 +8,5 @@
         brokers:
         - journal0.internal.staging.swh.network
      -  group_id: swh.search.journal_client
      +  group_id: swh.search.journal_client-v0.9.0
         prefix: swh.journal.objects
         object_types:
*******************************************
  File[/etc/softwareheritage/search/server.yml] =>
   parameters =>
     content =>
      @@ -7,5 +7,5 @@
         indexes:
           origin:
      -      index: origin
      +      index: origin-v0.9.0
             read_alias: origin-read
             write_alias: origin-write
*******************************************
*** End octocatalog-diff on search0.internal.staging.swh.network

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

vsellier created this revision.

Also change the consumer group of the journal clients to keep the current position
of the backfill

check T3391#66418

This revision is now accepted and ready to land.Jun 18 2021, 2:35 PM