Page MenuHomeSoftware Heritage

debian: Add missing file URIs in lister output
ClosedPublic

Authored by anlambert on Dec 2 2021, 5:31 PM.

Details

Summary

For a given package, the debian lister generates a dictionary mapping
distribution and version to a list of files to be processed by the
debian loader.

For each file to process, the debian loader expects to find an URI
in order to download it and then use its content to ingest package
source code into the archive.

However, it turns out these URIs were not computed by the lister
in its current implementation making any debian loading task fail
due to these missing info.

So add the computation of these URIS and ensure they will be provided
in the debian loader input parameters.

Related to T2400

Diff Detail

Repository
rDLS Listers
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Build is green

Patch application report for D6735 (id=24462)

Rebasing onto 5f567b3c34...

Current branch diff-target is up to date.
Changes applied before test
commit 46425917c25e4d58cff6ab8870eaddc13180bf92
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Thu Dec 2 17:19:08 2021 +0100

    debian: Add missing file URIs in lister output
    
    For a given package, the debian lister generates a dictionary mapping
    distribution and version to a list of files to be processed by the
    debian loader.
    
    For each file to process, the debian loader expects to find an URI
    in order to download it and then use its content to ingest package
    source code into the archive.
    
    However, it turns out these URIs were not computed by the lister
    in its current implementation making any debian loading task fail
    due to these missing info.
    
    So add the computation of these URIS and ensure they will be provided
    in the debian loader input parameters.
    
    Related to T2400

See https://jenkins.softwareheritage.org/job/DLS/job/tests-on-diff/425/ for more details.

This revision is now accepted and ready to land.Dec 2 2021, 6:18 PM