Page MenuHomeSoftware Heritage
Paste P110

remains some noise left in archiver db
ActivePublic
Actions

Authored by ardumont on Sep 23 2016, 4:39 PM.
Sep 23 16:33:28 uffizi python3[6770]: [2016-09-23 16:33:28,159: ERROR/MainProcess] Task swh.storage.archiver.tasks.SWHArchiverToBackendTask[f3d55225-cd8b-4bae-bba8-5dc43a05e6cb] raised unexpected: KeyError('<swh.objstorage.api.client.RemoteObjStorage object at 0x7fb0b3f7bfd0>',)
Sep 23 16:33:28 uffizi python3[6770]: Traceback (most recent call last):
Sep 23 16:33:28 uffizi python3[6770]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 240, in trace_task
Sep 23 16:33:28 uffizi python3[6770]: R = retval = fun(*args, **kwargs)
Sep 23 16:33:28 uffizi python3[6770]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 437, in __protected_call__
Sep 23 16:33:28 uffizi python3[6770]: return self.run(*args, **kwargs)
Sep 23 16:33:28 uffizi python3[6770]: File "/usr/lib/python3/dist-packages/swh/storage/archiver/tasks.py", line 26, in run
Sep 23 16:33:28 uffizi python3[6770]: ArchiverToBackendWorker(*args, **kwargs).run()
Sep 23 16:33:28 uffizi python3[6770]: File "/usr/lib/python3/dist-packages/swh/storage/archiver/worker.py", line 107, in run
Sep 23 16:33:28 uffizi python3[6770]: self.run_copier(src, dest, content_ids)
Sep 23 16:33:28 uffizi python3[6770]: File "/usr/lib/python3/dist-packages/swh/storage/archiver/worker.py", line 154, in run_copier
Sep 23 16:33:28 uffizi python3[6770]: content_status = self.get_contents_error(content_ids, source)
Sep 23 16:33:28 uffizi python3[6770]: File "/usr/lib/python3/dist-packages/swh/storage/archiver/worker.py", line 195, in get_contents_error
Sep 23 16:33:28 uffizi python3[6770]: storage = self.objstorages[source_storage]
Sep 23 16:33:28 uffizi python3[6770]: KeyError: '<swh.objstorage.api.client.RemoteObjStorage object at 0x7fb0b3f7bfd0>'
Sep 23 16:33:28 uffizi python3[6770]: [2016-09-23 16:33:28,242: INFO/MainProcess] Received task: swh.storage.archiver.tasks.SWHArchiverToBackendTask[49f712fb-7b7c-4f9a-a752-42eb47a75cf0]
--
softwareheritage-archiver=> select copies from content_archive where content_id='\x07417b8feb1880a3db0a41820a767c3b6779e383';
copies
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"banco": {"status": "missing"}, "uffizi": {"mtime": 1454595599, "status": "present"}, "<swh.objstorage.api.client.RemoteObjStorage object at 0x7fb0b3f7add8>": {"mtime": 1473194654, "status": "present"}}
(1 row)
softwareheritage-archiver=> select copies from content_archive where content_id='\x073d9ef77db493632f1ad42a7000edd0d9165156';
copies
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"banco": {"status": "missing"}, "uffizi": {"mtime": 1454595599, "status": "present"}, "<swh.objstorage.api.client.RemoteObjStorage object at 0x7fb0b3f7fe80>": {"mtime": 1473194653, "status": "present"}}
(1 row)

Event Timeline

ardumont created this paste.Sep 23 2016, 4:39 PM
ardumont added a comment.Sep 23 2016, 4:42 PM

T564

ardumont changed the title of this paste from maybe some noise left in archiver db to remains some noise left in archiver db.Sep 26 2016, 3:46 PM
ardumont edited the content of this paste. (Show Details)
ardumont edited the content of this paste. (Show Details)Sep 26 2016, 6:53 PM
About · Developer information · Legal