Page MenuHomeSoftware Heritage
Paste P1169

Large repository rounds 1st is long, 2nd is failing faster (because the error is blocking)
ActivePublic
Actions

Authored by ardumont on Sep 17 2021, 11:13 AM.
```
swhworker@worker17:~$ time SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_oneshot.yml swh loader run mercurial_from_disk https://foss.heptapod.net/heptapod/heptapod
INFO:swh.loader.mercurial.LoaderFromDisk:Load origin 'https://foss.heptapod.net/heptapod/heptapod' with type 'hg'
applying clone bundle from https://cellar-c2.services.clever-cloud.com/heptapod-foss-clonebundles/heptapod/heptapod-2020-07-22-zstd-v2.hg
adding changesets
adding manifests
adding file changes
added 109492 changesets with 376110 changes to 53159 files (+32 heads)
finished applying clone bundle
searching for changes
adding changesets
adding manifests
adding file changes
added 2064 changesets with 97109 changes to 39701 files (+14 heads)
new changesets 5e816f27eabf:90db70e0dede (61 drafts)
109175 local changesets published
ERROR:swh.loader.mercurial.LoaderFromDisk:Loading failure, updating to `failed` status
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/swh/loader/core/loader.py", line 339, in load
self.store_data()
File "/usr/lib/python3/dist-packages/swh/loader/mercurial/from_disk.py", line 397, in store_data
target = self.get_revision_id_from_hg_nodeid(node_id)
File "/usr/lib/python3/dist-packages/swh/loader/mercurial/from_disk.py", line 471, in get_revision_id_from_hg_nodeid
assert len(from_storage) == 1, msg % (hg_nodeid.hex(), len(from_storage))
AssertionError: Expected 1 match from storage for hg node '64353138623066626536626164656565336638303062663664343638313639343833643838626338', got 0
{'status': 'failed'}
real 1030m32.795s
user 806m16.498s
swhworker@worker17:~$ time SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_oneshot.yml swh loader run mercurial_from_dswhworker@worker17:~$ time SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_oneshot.yml swh loader run mercurial_from_disk https://foss.heptapod.net/heptapod/heptapod
INFO:swh.loader.mercurial.LoaderFromDisk:Load origin 'https://foss.heptapod.net/heptapod/heptapod' with type 'hg'
applying clone bundle from https://cellar-c2.services.clever-cloud.com/heptapod-foss-clonebundles/heptapod/heptapod-2020-07-22-zstd-v2.hg
adding changesets
adding manifests
adding file changes
added 109492 changesets with 376110 changes to 53159 files (+32 heads)
finished applying clone bundle
searching for changes
adding changesets
adding manifests
adding file changes
added 2064 changesets with 97109 changes to 39701 files (+14 heads)
new changesets 5e816f27eabf:90db70e0dede (61 drafts)
109175 local changesets published
ERROR:swh.loader.mercurial.LoaderFromDisk:Loading failure, updating to `failed` status
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/swh/loader/core/loader.py", line 339, in load
self.store_data()
File "/usr/lib/python3/dist-packages/swh/loader/mercurial/from_disk.py", line 452, in store_data
target = self.get_revision_id_from_hg_nodeid(node_id)
File "/usr/lib/python3/dist-packages/swh/loader/mercurial/from_disk.py", line 526, in get_revision_id_from_hg_nodeid
assert len(from_storage) == 1, msg % (hg_nodeid.hex(), len(from_storage))
AssertionError: Expected 1 match from storage for hg node '64353138623066626536626164656565336638303062663664343638313639343833643838626338', got 0
{'status': 'failed'}
real 12m35.640s
user 9m31.071s
sys 0m34.876s
```
About · Developer information · Legal