Page MenuHomeSoftware Heritage
Paste P1441

staging indexer origin intrinsic metadata journal client with debug
ActivePublic
Actions

Authored by ardumont on Aug 31 2022, 4:50 PM.
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:rdflib:RDFLib Version: 4.2.2
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.OriginMetadataIndexer object at 0x7fa2af90da90>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}}
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.core.config:Loading config file /etc/softwareheritage/indexer/origin_intrinsic_metadata.yml
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5007
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5007 "POST /indexer_configuration/add HTTP/1.1" 200 77
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.indexer:<swh.indexer.metadata.DirectoryMetadataIndexer object at 0x7fa2ad31e2e8>: config={'tools': {'name': 'swh-metadata-detector', 'configuration': {}, 'version': '0.0.2'}, 'indexer_storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5007/'}, 'storage': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5002/'}, 'journal': {'brokers': ['journal1.internal.staging.swh.network'], 'group_id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'prefix': 'swh.journal.objects'}, 'scheduler': {'cls': 'remote', 'url': 'http://scheduler0.internal.staging.swh.network:5008/'}, 'objstorage': {'cls': 'filtered', 'storage_conf': {'cls': 'remote', 'url': 'http://storage1.internal.staging.swh.network:5003/'}, 'filters_conf': [{'type': 'readonly'}]}}
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Consumer settings: {'debug': 'consumer', 'bootstrap.servers': 'journal1.internal.staging.swh.network', 'auto.offset.reset': 'earliest', 'group.id': 'swh.indexer.journal_client.origin_intrinsic_metadata', 'on_commit': <function _on_commit at 0x7fa2b0637b70>, 'error_cb': <function _error_cb at 0x7fa2b0637ae8>, 'enable.auto.commit': False, 'logger': <Logger swh.journal.client.rdkafka (DEBUG)>}
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Upstream topics: ['swh.journal.objects.extid', 'swh.journal.objects.origin', 'swh.journal.objects.snapshot', 'swh.journal.objects.origin_visit_status', 'swh.journal.objects.metadata_authority', 'swh.journal.objects.revision', 'swh.journal.objects.origin_visit', 'swh.journal.objects.raw_extrinsic_metadata', 'swh.journal.objects.skipped_content', 'swh.journal.objects.metadata_fetcher', 'swh.journal.objects.directory', 'swh.journal.objects.content', 'swh.journal.objects.release']
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client:Subscribing to: ['swh.journal.objects.origin_visit_status']
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:INIT [rdkafka#consumer-1] [thrd:app]: librdkafka v1.5.2 (0x10502ff) rdkafka#consumer-1 initialized (builtin.features gzip,snappy,ssl,sasl,regex,lz4,sasl_gssapi,sasl_plain,sasl_scram,plugins,zstd,sasl_oauthbearer, GCC GXX INSTALL GNULD LDS C11THREADS LIBDL PLUGINS ZLIB SSL SASL_CYRUS ZSTD HDRHISTOGRAM LZ4_EXT SYSLOG SNAPPY SOCKEM SASL_SCRAM SASL_OAUTHBEARER CRC32C_HW, debug 0x2000)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:SUBSCRIBE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": subscribe to new subscription of 1 topics (join state init)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:REBALANCE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata" is rebalancing in state up (join-state init) without assignment: unsubscribe
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s)
Aug 31 14:49:20 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s)
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGNOR [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": "range" assignor run for 2 member(s)
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGN [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": new assignment of 32 partition(s) in join state wait-assign-rebalance_cb
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:OFFSET [rdkafka#consumer-1] [thrd:main]: GroupCoordinator/2: Fetch committed offsets for 32/32 partition(s)
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [32] start fetching at offset 200
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [33] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [34] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [35] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [36] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [37] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [38] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [39] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [40] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [41] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [42] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [43] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [44] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [45] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [46] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [47] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [48] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [49] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [50] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [51] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [52] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [53] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [54] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [55] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [56] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [57] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [58] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [59] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [60] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [61] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [62] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:FETCH [rdkafka#consumer-1] [thrd:main]: Partition swh.journal.objects.origin_visit_status [63] start fetching at offset 0
Aug 31 14:49:30 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002
Aug 31 14:49:31 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 121
Aug 31 14:49:32 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 180
Aug 31 14:49:34 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 690
Aug 31 14:49:35 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118
Aug 31 14:49:37 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177
Aug 31 14:49:38 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49
Aug 31 14:49:40 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 130
Aug 31 14:49:43 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 189
Aug 31 14:49:44 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 360
Aug 31 14:49:46 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113
Aug 31 14:49:47 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172
Aug 31 14:49:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 250
Aug 31 14:49:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123
Aug 31 14:49:57 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182
Aug 31 14:50:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 1130
Aug 31 14:50:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 126
Aug 31 14:50:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 185
Aug 31 14:50:09 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 9379
Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 112
Aug 31 14:50:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 171
Aug 31 14:50:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 580
Aug 31 14:50:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118
...
Aug 31 14:54:48 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 113
Aug 31 14:54:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 172
Aug 31 14:54:49 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 2344
Aug 31 14:54:51 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 123
Aug 31 14:54:51 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 182
Aug 31 14:54:52 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 576
Aug 31 14:54:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 118
Aug 31 14:54:54 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 177
Aug 31 14:54:55 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 2126
Aug 31 14:54:55 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 120
Aug 31 14:54:56 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 179
Aug 31 14:54:58 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 246
Aug 31 14:54:58 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 133
Aug 31 14:54:59 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 192
Aug 31 14:55:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49
Aug 31 14:55:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Resetting dropped connection: storage1.internal.staging.swh.network
Aug 31 14:55:01 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 136
Aug 31 14:55:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 195
Aug 31 14:55:03 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /snapshot/get_branches HTTP/1.1" 200 49
Aug 31 14:55:03 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 29799
Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 41391
Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 47147
Aug 31 14:55:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 35046
Aug 31 14:55:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 34859
Aug 31 14:55:07 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 31553
Aug 31 14:55:10 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /revision HTTP/1.1" 200 39934
Aug 31 14:55:11 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /release HTTP/1.1" 200 3679
Aug 31 14:55:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /release HTTP/1.1" 200 2942
Aug 31 14:55:12 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002
Aug 31 14:55:13 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 143
Aug 31 14:55:14 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2116
Aug 31 14:55:15 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 152
Aug 31 14:55:18 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1154
Aug 31 14:55:21 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 136
Aug 31 14:55:21 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1137
Aug 31 14:55:24 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 145
Aug 31 14:55:24 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1154
Aug 31 14:55:26 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 149
...
Aug 31 14:57:52 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1712
Aug 31 14:57:53 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 161
Aug 31 14:57:54 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2224
Aug 31 14:57:57 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 136
Aug 31 14:58:00 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1431
Aug 31 14:58:02 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 138
Aug 31 14:58:04 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1229
Aug 31 14:58:06 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 146
Aug 31 14:58:19 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1140
Aug 31 14:58:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 135
Aug 31 14:58:20 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2149
Aug 31 14:58:22 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 158
Aug 31 14:58:26 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1865
Aug 31 14:58:27 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 136
Aug 31 14:58:27 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2443
Aug 31 14:58:29 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 136
Aug 31 14:58:31 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1355
Aug 31 14:58:32 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 145
Aug 31 14:58:33 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 2236
Aug 31 14:58:34 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 140
Aug 31 14:58:35 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 1142
Aug 31 14:58:35 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 140
Aug 31 14:58:36 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /directory/ls HTTP/1.1" 200 930
Aug 31 14:58:36 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5007
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5007 "POST /directory_intrinsic_metadata/add HTTP/1.1" 200 36
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5007 "POST /origin_intrinsic_metadata/add HTTP/1.1" 200 32
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:REBALANCE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata" is rebalancing in state up (join-state started) with assignment: group is rebalancing
Aug 31 14:58:37 worker1 swh[2752560]: WARNING:swh.journal.client.rdkafka:MAXPOLL [rdkafka#consumer-1] [thrd:main]: Application maximum poll interval (300000ms) exceeded by 404ms (adjust max.poll.interval.ms for long-running message processing): leaving group
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:LEAVE [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Leaving group
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:REBALANCE [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata" is rebalancing in state up (join-state wait-revoke-rebalance_cb) with assignment: max.poll.interval.ms exceeded
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:COMMIT [rdkafka#consumer-1] [thrd:main]: GroupCoordinator/2: Committing offsets for 1 partition(s): manual
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:ASSIGN [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": new assignment of 0 partition(s) in join state wait-revoke-rebalance_cb
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:UNASSIGN [rdkafka#consumer-1] [thrd:main]: Group "swh.indexer.journal_client.origin_intrinsic_metadata": unassigning 32 partition(s) (v6)
Aug 31 14:58:37 worker1 swh[2752560]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=UNKNOWN_MEMBER_ID,val=25,str="Broker: Unknown member"}
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s)
Aug 31 14:58:37 worker1 swh[2752560]: DEBUG:swh.journal.client.rdkafka:JOIN [rdkafka#consumer-1] [thrd:main]: storage1.internal.staging.swh.network:9092/2: Joining group "swh.indexer.journal_client.origin_intrinsic_metadata" with 1 subscribed topic(s)
Aug 31 14:58:38 worker1 swh[2752560]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_MAX_POLL_EXCEEDED,val=-147,str="Application maximum poll interval (300000ms) exceeded by 404ms"}
Aug 31 14:58:38 worker1 swh[2752560]: DEBUG:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_NO_OFFSET,val=-168,str="Local: No offset stored"}

Event Timeline

ardumont created this paste.Aug 31 2022, 4:50 PM
ardumont changed the title of this paste from go figure to staging indexer origin intrinsic metadata journal client with debug.Aug 31 2022, 4:55 PM
ardumont edited the content of this paste. (Show Details)
ardumont edited the content of this paste. (Show Details)Aug 31 2022, 4:59 PM
ardumont mentioned this in T4477: staging origin intrinsic metadata indexer are stuck.Aug 31 2022, 5:18 PM
About · Developer information · Legal