Differential D7897

[WIP] Add arch lister module (origins from archives).
AbandonedPublicDraft
Actions

Authored by franckbret on May 25 2022, 3:31 PM.

Details

Reviewers

None

Group Reviewers

Reviewers

Summary

After a first attempt with D7812 this one use a different strategy to
retrieve origins.

Fetch and extract "core.files.tar.gz", "extra.files.tar.gz" and "community.files.tar.gz" from archives.archlinux.org. That step ensure that we have a list of "official" packages.
Parse metadata from 'desc' file to build origins url.
Scrap the origin url to get artifacts metadata that list all versions of a package.

Related: T4233

Diff Detail

Repository

rDLS Listers

Branch

archlinuxfromarchives

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 29570
Build 46209: Phabricator diff pipeline on jenkins	Jenkins console · Jenkins
Build 46208: arc lint + arc unit

Event Timeline

franckbret created this revision.May 25 2022, 3:31 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptMay 25 2022, 3:31 PM

Sorry, made a mistake that creates a new differential. Ignore it.

Build is green

Patch application report for D7897 (id=28480)

Rebasing onto 263db667d0...

Current branch diff-target is up to date.

Changes applied before test

commit baa9dc5c10f8b2ca52922ee8842b7fa68becd44c
Author: Franck Bret <franck.bret@octobus.net>
Date:   Wed May 25 14:43:38 2022 +0200

    [WIP] Add arch lister module (origins from archives).
    
    After a first attempt with D7812 this one use a different strategy to
    retrieve origins.
    
    Fetch and extract "core.files.tar.gz", "extra.files.tar.gz" and "community.files.tar.gz" from archives.archlinux.org. That step ensure that we have a list of "official" packages.
    Parse metadata from 'desc' file to build origins url.
    Scrap the origin url to get artifacts metadata that list all versions of a package.
    
    Related: T4233

See https://jenkins.softwareheritage.org/job/DLS/job/tests-on-diff/534/ for more details.

Harbormaster completed remote builds in B29570: Diff 28480.May 25 2022, 3:36 PM