Change Details

Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:rdflib:RDFLib Version: 4.2.2 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.OriginMetadataIndexer object at 0x7fa2af90da90>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5007 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5007 "POST /indexer_configuration/add HTTP/1.1" 200 77 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.DirectoryMetadataIndexer object at 0x7fa2ad31e2e8>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Consumer settings: {'debug': 'consumer', 'bootstrap.servers': 'journal1.internal.staging.swh.network', 'auto.offset.reset': 'earliest', 'group.id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'on_commit': <function _on_commit at 0x7fa2b0637b70>, 'error_cb': <function _error_cb at 0x7fa2b0637ae8>, 'enable.auto.commit': False, 'logger': <Logger swh.journal.client.rdkafka (DEBUG)>} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Upstream topics: ['swh.journal.objects.extid', 'swh.journal.objects.origin', 'swh.journal.objects.snapshot', 'swh.journal.objects.origin_visit_status', 'swh.journal.objects.metadata_authority', 'swh.journal.objects.revision', 'swh.journal.objects.origin_visit', 'swh.journal.objects.raw_extrinsic_metadata', 'swh.journal.objects.skipped_content', 'swh.journal.objects.metadata_fetcher', 'swh.journal.objects.directory', 'swh.journal.objects.content', 'swh.journal.objects.release'] Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Subscribing to: ['swh.journal.objects.origin_visit_status'] Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:INIT [rdkafka#consumer-1] [thrd:app]: librdkafka v1.5.2 (0x10502ff) rdkafka#consumer-1 initialized (builtin.features gzip,snappy,ssl,sasl,regex,lz4,sasl_gssapi,sasl_plain,sasl_scram,plugins,zstd,sasl_oauthbearer, GCC GXX INSTALL GNULD LDS C11THREADS LIBDL PLUGINS ZLIB SSL SASL_CYRUS ZSTD HDRHISTOGRAM LZ4_EXT SYSLOG SNAPPY SOCKEM SASL_SCRAM SASL_OAUTHBEARER CRC32C_HW, debug 0x2000) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:SUBSCRIBE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": subscribe to new subscription of 1 topics (join state init) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:REBALANCE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata" is rebalancing in state up (join-state init) without assignment: unsubscribe Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGNOR [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": "range" assignor run for 2 member(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGN [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": new assignment of 32 partition(s) in join state wait-assign-rebalance_cb Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:OFFSET [rdkafka#consumer-1] [thrd:main]: GroupCoordinator/2: Fetch committed offsets for 32/32 partition(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [32] start fetching at offset 200 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [33] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [34] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [35] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [36] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [37] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [38] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [39] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [40] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [41] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [42] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [43] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [44] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [45] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [46] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [47] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [48] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [49] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [50] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [51] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [52] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [53] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [54] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [55] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [56] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [57] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [58] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [59] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [60] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [61] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [62] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [63] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002 Aug 31 14:49:31 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 121 Aug 31 14:49:32 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 180 Aug 31 14:49:34 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 690 Aug 31 14:49:35 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 Aug 31 14:49:37 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177 Aug 31 14:49:38 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:49:40 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 130 Aug 31 14:49:43 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 189 Aug 31 14:49:44 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 360 Aug 31 14:49:46 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113 Aug 31 14:49:47 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172 Aug 31 14:49:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 250 Aug 31 14:49:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123 Aug 31 14:49:57 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182 Aug 31 14:50:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 1130 Aug 31 14:50:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 126 Aug 31 14:50:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 185 Aug 31 14:50:09 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 9379 Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 112 Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 171 Aug 31 14:50:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 580 Aug 31 14:50:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118

Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:rdflib:RDFLib Version: 4.2.2 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.OriginMetadataIndexer object at 0x7fa2af90da90>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5007 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5007 "POST /indexer_configuration/add HTTP/1.1" 200 77 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.DirectoryMetadataIndexer object at 0x7fa2ad31e2e8>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Consumer settings: {'debug': 'consumer', 'bootstrap.servers': 'journal1.internal.staging.swh.network', 'auto.offset.reset': 'earliest', 'group.id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'on_commit': <function _on_commit at 0x7fa2b0637b70>, 'error_cb': <function _error_cb at 0x7fa2b0637ae8>, 'enable.auto.commit': False, 'logger': <Logger swh.journal.client.rdkafka (DEBUG)>} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Upstream topics: ['swh.journal.objects.extid', 'swh.journal.objects.origin', 'swh.journal.objects.snapshot', 'swh.journal.objects.origin_visit_status', 'swh.journal.objects.metadata_authority', 'swh.journal.objects.revision', 'swh.journal.objects.origin_visit', 'swh.journal.objects.raw_extrinsic_metadata', 'swh.journal.objects.skipped_content', 'swh.journal.objects.metadata_fetcher', 'swh.journal.objects.directory', 'swh.journal.objects.content', 'swh.journal.objects.release'] Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Subscribing to: ['swh.journal.objects.origin_visit_status'] Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:INIT [rdkafka#consumer-1] [thrd:app]: librdkafka v1.5.2 (0x10502ff) rdkafka#consumer-1 initialized (builtin.features gzip,snappy,ssl,sasl,regex,lz4,sasl_gssapi,sasl_plain,sasl_scram,plugins,zstd,sasl_oauthbearer, GCC GXX INSTALL GNULD LDS C11THREADS LIBDL PLUGINS ZLIB SSL SASL_CYRUS ZSTD HDRHISTOGRAM LZ4_EXT SYSLOG SNAPPY SOCKEM SASL_SCRAM SASL_OAUTHBEARER CRC32C_HW, debug 0x2000) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:SUBSCRIBE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": subscribe to new subscription of 1 topics (join state init) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:REBALANCE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata" is rebalancing in state up (join-state init) without assignment: unsubscribe Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGNOR [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": "range" assignor run for 2 member(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGN [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": new assignment of 32 partition(s) in join state wait-assign-rebalance_cb Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:OFFSET [rdkafka#consumer-1] [thrd:main]: GroupCoordinator/2: Fetch committed offsets for 32/32 partition(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [32] start fetching at offset 200 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [33] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [34] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [35] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [36] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [37] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [38] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [39] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [40] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [41] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [42] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [43] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [44] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [45] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [46] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [47] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [48] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [49] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [50] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [51] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [52] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [53] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [54] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [55] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [56] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [57] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [58] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [59] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [60] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [61] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [62] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [63] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002 Aug 31 14:49:31 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 121 Aug 31 14:49:32 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 180 Aug 31 14:49:34 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 690 Aug 31 14:49:35 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 Aug 31 14:49:37 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177 Aug 31 14:49:38 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:49:40 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 130 Aug 31 14:49:43 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 189 Aug 31 14:49:44 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 360 Aug 31 14:49:46 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113 Aug 31 14:49:47 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172 Aug 31 14:49:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 250 Aug 31 14:49:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123 Aug 31 14:49:57 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182 Aug 31 14:50:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 1130 Aug 31 14:50:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 126 Aug 31 14:50:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 185 Aug 31 14:50:09 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 9379 Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 112 Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 171 Aug 31 14:50:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 580 Aug 31 14:50:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 ... Aug 31 14:54:48 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113 Aug 31 14:54:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172 Aug 31 14:54:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 2344 Aug 31 14:54:51 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123 Aug 31 14:54:51 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182 Aug 31 14:54:52 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 576 Aug 31 14:54:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 Aug 31 14:54:54 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177 Aug 31 14:54:55 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 2126 Aug 31 14:54:55 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 120 Aug 31 14:54:56 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 179 Aug 31 14:54:58 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 246 Aug 31 14:54:58 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 133 Aug 31 14:54:59 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 192 Aug 31 14:55:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:55:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Resetting dropped connection: storage1.internal.staging.swh.network Aug 31 14:55:01 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 136 Aug 31 14:55:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 195 Aug 31 14:55:03 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:55:03 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 29799 Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 41391 Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 47147 Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 35046 Aug 31 14:55:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 34859 Aug 31 14:55:07 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 31553 Aug 31 14:55:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 39934 Aug 31 14:55:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /release HTTP/1.1" 200 3679 Aug 31 14:55:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /release HTTP/1.1" 200 2942 Aug 31 14:55:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002 Aug 31 14:55:13 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 143 Aug 31 14:55:14 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2116 Aug 31 14:55:15 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 152 Aug 31 14:55:18 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1154 Aug 31 14:55:21 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 136 Aug 31 14:55:21 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1137 Aug 31 14:55:24 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 145 Aug 31 14:55:24 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1154 Aug 31 14:55:26 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 149

Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:rdflib:RDFLib Version: 4.2.2 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.OriginMetadataIndexer object at 0x7fa2af90da90>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5007 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5007 "POST /indexer_configuration/add HTTP/1.1" 200 77 Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.DirectoryMetadataIndexer object at 0x7fa2ad31e2e8>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Consumer settings: {'debug': 'consumer', 'bootstrap.servers': 'journal1.internal.staging.swh.network', 'auto.offset.reset': 'earliest', 'group.id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'on_commit': <function _on_commit at 0x7fa2b0637b70>, 'error_cb': <function _error_cb at 0x7fa2b0637ae8>, 'enable.auto.commit': False, 'logger': <Logger swh.journal.client.rdkafka (DEBUG)>} Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Upstream topics: ['swh.journal.objects.extid', 'swh.journal.objects.origin', 'swh.journal.objects.snapshot', 'swh.journal.objects.origin_visit_status', 'swh.journal.objects.metadata_authority', 'swh.journal.objects.revision', 'swh.journal.objects.origin_visit', 'swh.journal.objects.raw_extrinsic_metadata', 'swh.journal.objects.skipped_content', 'swh.journal.objects.metadata_fetcher', 'swh.journal.objects.directory', 'swh.journal.objects.content', 'swh.journal.objects.release'] Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Subscribing to: ['swh.journal.objects.origin_visit_status'] Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:INIT [rdkafka#consumer-1] [thrd:app]: librdkafka v1.5.2 (0x10502ff) rdkafka#consumer-1 initialized (builtin.features gzip,snappy,ssl,sasl,regex,lz4,sasl_gssapi,sasl_plain,sasl_scram,plugins,zstd,sasl_oauthbearer, GCC GXX INSTALL GNULD LDS C11THREADS LIBDL PLUGINS ZLIB SSL SASL_CYRUS ZSTD HDRHISTOGRAM LZ4_EXT SYSLOG SNAPPY SOCKEM SASL_SCRAM SASL_OAUTHBEARER CRC32C_HW, debug 0x2000) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:SUBSCRIBE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": subscribe to new subscription of 1 topics (join state init) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:REBALANCE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata" is rebalancing in state up (join-state init) without assignment: unsubscribe Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s) Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGNOR [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": "range" assignor run for 2 member(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGN [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": new assignment of 32 partition(s) in join state wait-assign-rebalance_cb Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:OFFSET [rdkafka#consumer-1] [thrd:main]: GroupCoordinator/2: Fetch committed offsets for 32/32 partition(s) Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [32] start fetching at offset 200 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [33] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [34] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [35] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [36] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [37] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [38] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [39] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [40] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [41] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [42] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [43] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [44] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [45] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [46] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [47] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [48] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [49] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [50] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [51] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [52] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [53] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [54] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [55] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [56] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [57] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [58] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [59] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [60] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [61] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [62] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [63] start fetching at offset 0 Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002 Aug 31 14:49:31 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 121 Aug 31 14:49:32 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 180 Aug 31 14:49:34 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 690 Aug 31 14:49:35 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 Aug 31 14:49:37 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177 Aug 31 14:49:38 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:49:40 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 130 Aug 31 14:49:43 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 189 Aug 31 14:49:44 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 360 Aug 31 14:49:46 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113 Aug 31 14:49:47 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172 Aug 31 14:49:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 250 Aug 31 14:49:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123 Aug 31 14:49:57 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182 Aug 31 14:50:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 1130 Aug 31 14:50:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 126 Aug 31 14:50:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 185 Aug 31 14:50:09 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 9379 Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 112 Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 171 Aug 31 14:50:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 580 Aug 31 14:50:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 ... Aug 31 14:54:48 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113 Aug 31 14:54:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172 Aug 31 14:54:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 2344 Aug 31 14:54:51 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123 Aug 31 14:54:51 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182 Aug 31 14:54:52 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 576 Aug 31 14:54:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118 Aug 31 14:54:54 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177 Aug 31 14:54:55 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 2126 Aug 31 14:54:55 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 120 Aug 31 14:54:56 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 179 Aug 31 14:54:58 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 246 Aug 31 14:54:58 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 133 Aug 31 14:54:59 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 192 Aug 31 14:55:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:55:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Resetting dropped connection: storage1.internal.staging.swh.network Aug 31 14:55:01 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 136 Aug 31 14:55:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 195 Aug 31 14:55:03 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49 Aug 31 14:55:03 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 29799 Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 41391 Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 47147 Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 35046 Aug 31 14:55:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 34859 Aug 31 14:55:07 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 31553 Aug 31 14:55:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 39934 Aug 31 14:55:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /release HTTP/1.1" 200 3679 Aug 31 14:55:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /release HTTP/1.1" 200 2942 Aug 31 14:55:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002 Aug 31 14:55:13 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 143 Aug 31 14:55:14 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2116 Aug 31 14:55:15 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 152 Aug 31 14:55:18 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1154 Aug 31 14:55:21 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 136 Aug 31 14:55:21 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1137 Aug 31 14:55:24 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 145 Aug 31 14:55:24 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1154 Aug 31 14:55:26 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 149