HomeSoftware Heritage

cgit: rewrite the CGit lister

Description

cgit: rewrite the CGit lister

Simplify the code:

  • do only inherit from ListerBase
  • implement HTTP queries directly using requests
  • get rid of convoluted code

Make the origin_url gathered from the git repo's "project" page instead of
building it from the 'url_prefix' hack. Now, the lister WILL make substancially
more requests, since it will make one request per listed git repo, but
the provided origin_url should be pretty reliable now.

When several url are provided as clonable URLs, choose the http/https one first,
otherwise, choose the first one of the list.

Add proper tests for the cgit lister.

Also, get rid of the 'time_updated' column in the model.

Details

Provenance
douarddaAuthored on Aug 30 2019, 4:48 PM
douarddaPushed on Sep 2 2019, 1:14 PM
Differential Revision
D1929: cgit: rewrite the CGit lister
Parents
rDLSe0ce68377de0: bitbucket: simplify a bit BitBucketLister's constructor
Branches
Unknown
Tags
Unknown
Build Status
Buildable 7569
Build 10833: test-and-buildJenkins