Page MenuHomeSoftware Heritage
Paste P1470

sources-unstable-full.json still raises issue (current expected to work with sources-unstable.json but still...)
ActivePublic
Actions

Authored by ardumont on Oct 4 2022, 11:46 AM.
swh-lister_1 | [2022-10-04 09:44:12,739: INFO/MainProcess] Task swh.lister.nixguix.tasks.NixGuixListerTask[b5b9956d-8eb6-4e1a-9ac5-b1e89774cba9] received
swh-lister_1 | [2022-10-04 09:44:13,983: WARNING/ForkPoolWorker-1] Cannot detect extension for 'http://tarballs.nixos.org/sha256/1j1y3cq6ys30m734axc0brdm2q9n2as4h32jws15r7w5fwr991km'. Fallback to http head query
swh-lister_1 | [2022-10-04 09:44:14,019: WARNING/ForkPoolWorker-1] Still cannot detect extension through location 'http://tarballs.nixos.org/sha256/1j1y3cq6ys30m734axc0brdm2q9n2as4h32jws15r7w5fwr991km'...
swh-lister_1 | [2022-10-04 09:44:14,019: WARNING/ForkPoolWorker-1] Skipping url 'http://tarballs.nixos.org/sha256/1j1y3cq6ys30m734axc0brdm2q9n2as4h32jws15r7w5fwr991km': undetected remote artifact type
swh-lister_1 | [2022-10-04 09:44:15,038: WARNING/ForkPoolWorker-1] Skipping url 'https://web.archive.org/web/20210609022835/https://timesnewerroman.com/assets/TimesNewerRoman.zip': missing integrity field
swh-lister_1 | [2022-10-04 09:44:15,227: WARNING/ForkPoolWorker-1] Cannot detect extension for 'https://github.com/tianocore/edk2'. Fallback to http head query
swh-lister_1 | [2022-10-04 09:44:16,005: WARNING/ForkPoolWorker-1] Skipping url 'https://github.com/4ti2/4ti2/archive/Release_1_6_9.tar.gz': missing integrity field
swh-lister_1 | [2022-10-04 09:44:16,227: WARNING/ForkPoolWorker-1] Cannot detect extension for 'svn://svn.code.sf.net/p/acme-crossass/code-0/trunk'. Fallback to http head query
swh-lister_1 | [2022-10-04 09:44:16,229: ERROR/ForkPoolWorker-1] Task swh.lister.nixguix.tasks.NixGuixListerTask[b5b9956d-8eb6-4e1a-9ac5-b1e89774cba9] raised unexpected: InvalidSchema("No connection adapters were found for 'svn://svn.code.sf.net/p/acme-crossass/code-0/trunk'")
swh-lister_1 | Traceback (most recent call last):
swh-lister_1 | File "/src/swh-lister/swh/lister/nixguix/lister.py", line 132, in is_tarball
swh-lister_1 | is_tar = _is_tarball(url)
swh-lister_1 | File "/src/swh-lister/swh/lister/nixguix/lister.py", line 127, in _is_tarball
swh-lister_1 | return Path(urlparse(url).path).suffixes[-1].lstrip(".") in TARBALL_EXTENSIONS
swh-lister_1 | IndexError: list index out of range
swh-lister_1 |
swh-lister_1 | During handling of the above exception, another exception occurred:
swh-lister_1 |
swh-lister_1 | Traceback (most recent call last):
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/celery/app/trace.py", line 451, in trace_task
swh-lister_1 | R = retval = fun(*args, **kwargs)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/scheduler/task.py", line 61, in __call__
swh-lister_1 | result = super().__call__(*args, **kwargs)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/celery/app/trace.py", line 734, in __protected_call__
swh-lister_1 | return self.run(*args, **kwargs)
swh-lister_1 | File "/src/swh-lister/swh/lister/nixguix/tasks.py", line 14, in list_nixguix
swh-lister_1 | return NixGuixLister.from_configfile(**lister_args).run().dict()
swh-lister_1 | File "/src/swh-lister/swh/lister/pattern.py", line 162, in run
swh-lister_1 | for page in self.get_pages():
swh-lister_1 | File "/src/swh-lister/swh/lister/nixguix/lister.py", line 301, in get_pages
swh-lister_1 | continue
swh-lister_1 | File "/src/swh-lister/swh/lister/nixguix/lister.py", line 143, in is_tarball
swh-lister_1 | response = request.head(url)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/requests/sessions.py", line 622, in head
swh-lister_1 | return self.request("HEAD", url, **kwargs)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/requests/sessions.py", line 587, in request
swh-lister_1 | resp = self.send(prep, **send_kwargs)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/requests/sessions.py", line 695, in send
swh-lister_1 | adapter = self.get_adapter(url=request.url)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/requests/sessions.py", line 792, in get_adapter
swh-lister_1 | raise InvalidSchema(f"No connection adapters were found for {url!r}")
swh-lister_1 | requests.exceptions.InvalidSchema: No connection adapters were found for 'svn://svn.code.sf.net/p/acme-crossass/code-0/trunk'
from https://nix-community.github.io/nixpkgs-swh/sources-unstable-full.json

Event Timeline

ardumont created this paste.Oct 4 2022, 11:46 AM
ardumont added a comment.Oct 4 2022, 11:50 AM

Wrong stuff again...:

cat /var/tmp/sources-unstable-full.json | jq . | grep -C3 "svn://svn.code.sf.net/p/acme-crossass/code-0/trunk"
      "outputHashMode": "recursive",
      "type": "url",
      "urls": [
        "svn://svn.code.sf.net/p/acme-crossass/code-0/trunk"
      ],
      "integrity": "sha256-VifIQ+UEVMKJ+cNS+Xxusazinr5Cgu1lmGuhqj/5Mpk=",
      "inferredFetcher": "unclassified"
ardumont mentioned this in T3781: Replace the Nixguix loader with a lister.Oct 4 2022, 11:51 AM
ardumont mentioned this in D8606: nixguix: Deal with mistyped origins.Oct 4 2022, 1:02 PM
ardumont mentioned this in rDLSa94b75f366be: nixguix: Deal with mistyped origins.Oct 4 2022, 2:37 PM
About · Developer information · Legal