Differential D6743

debian: Provide last_update to produced ListedOrigin models
ClosedPublic
Actions

Authored by anlambert on Dec 3 2021, 4:14 PM.

Details

Reviewers

ardumont

Group Reviewers

Reviewers

Maniphest Tasks

T2400: Ingest current and historical Ubuntu releases

Commits

rDLS93f17d4d9cb1: debian: Provide last_update to produced ListedOrigin models

Summary

Use the value of the "Last-Modified" header from the HTTP response
resulting of the debian sources index HTTP request.

It will prevent to create loading tasks for debian packages with no
changes since last listing.

Related to T2400

Diff Detail

Repository

rDLS Listers

Lint

Automatic diff as part of commit; lint not applicable.

Unit

Automatic diff as part of commit; unit tests not applicable.

Event Timeline

anlambert created this revision.Dec 3 2021, 4:14 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptDec 3 2021, 4:14 PM

Awesome!

ardumont accepted this revision.Dec 3 2021, 4:16 PM

This revision is now accepted and ready to land.Dec 3 2021, 4:16 PM

Build is green

Patch application report for D6743 (id=24484)

Rebasing onto 605b13a676...

Current branch diff-target is up to date.

Changes applied before test

commit 93f17d4d9cb103d39448d4eed2031a825e3c0125
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Fri Dec 3 16:09:36 2021 +0100

    debian: Provide last_update to produced ListedOrigin models
    
    Use the value of the "Last-Modified" header from the HTTP response
    resulting of the debian sources index HTTP request.
    
    It will prevent to create loading tasks for debian packages with no
    changes since last listing.
    
    Related to T2400

See https://jenkins.softwareheritage.org/job/DLS/job/tests-on-diff/428/ for more details.

Harbormaster completed remote builds in B25357: Diff 24484.Dec 3 2021, 4:17 PM

Closed by commit rDLS93f17d4d9cb1: debian: Provide last_update to produced ListedOrigin models (authored by anlambert). · Explain WhyDec 3 2021, 4:18 PM

This revision was automatically updated to reflect the committed changes.

anlambert added a commit: rDLS93f17d4d9cb1: debian: Provide last_update to produced ListedOrigin models.

ardumont mentioned this in T2400: Ingest current and historical Ubuntu releases.Dec 8 2021, 3:31 PM