Page MenuHomeSoftware Heritage
Differential D7971

common/archive: Ensure backward compatibility with swh-indexer 1.x
ClosedPublic
Actions

Authored by anlambert on Jun 8 2022, 1:44 PM.

Details

Reviewers
vlorentz
Group Reviewers
Reviewers
Commits
rDWAPPS284e0d9857b2: common/archive: Ensure backward compatibility with swh-indexer 1.x
Summary

idx_storage.origin_intrinsic_metadata_get does not return the same
dict fields according to the swh-indexer version used.

As swh-indexer 2.0.0 is not yet deployed in production, we must ensure
backward compatibility with swh-indexer 1.x or the Web API endpoint
/origin/metadata-search/ will break.

Diff Detail

Repository
rDWAPPS Web applications
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

anlambert created this revision.Jun 8 2022, 1:44 PM
Herald added a reviewer: Reviewers. · View Herald TranscriptJun 8 2022, 1:44 PM
swh-public-ci added a comment.Jun 8 2022, 2:05 PM

Build is green

Patch application report for D7971 (id=28719)

Rebasing onto 66ded032dc...

Current branch diff-target is up to date.
Changes applied before test
commit caedd83a5998b288a08bd18df47ba9a8ee00bcc5
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Wed Jun 8 13:39:48 2022 +0200

    common/archive: Ensure backward compatibility with swh-indexer 1.x
    
    idx_storage.origin_intrinsic_metadata_get does not return the same
    dict fields according to the swh-indexer version used.
    
    As swh-indexer 2.0.0 is not yet deployed in production, we must ensure
    backward compatibility with swh-indexer 1.x or the Web API endpoint
    /origin/metadata-search/ will break.

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/1888/ for more details.

Harbormaster completed remote builds in B29800: Diff 28719.Jun 8 2022, 2:05 PM
anlambert requested review of this revision.Jun 8 2022, 2:05 PM
vlorentz added a subscriber: vlorentz.EditedJun 8 2022, 2:39 PM

Why bother with swh-indexer 1.x? updating prod should be good enough

and I don't think you meant to stage debian/

anlambert added a comment.Jun 8 2022, 2:47 PM
In D7971#207146, @vlorentz wrote:

Why bother with swh-indexer 1.x? updating prod should be good enough

and I don't think you meant to stage debian/

Because if we deploy swh-web before swh-indexer (which is likely to happen), this would break the origin metadata search endpoint.

and I don't think you meant to stage debian/

Oops, classic mistake from myself.

anlambert updated this revision to Diff 28723.Jun 8 2022, 2:49 PM

Remove debian folder staged by mistake.

ardumont added a subscriber: ardumont.Jun 8 2022, 3:00 PM

updating prod should be good enough

@vlorentz I'm lost as to when deploying the new indexer v2.0 should happen by the way, any clues?

swh-public-ci added a comment.Jun 8 2022, 3:10 PM

Build is green

Patch application report for D7971 (id=28723)

Rebasing onto 66ded032dc...

Current branch diff-target is up to date.
Changes applied before test
commit 051d59325b99931b67c8dfe52eb01766f24e3973
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Wed Jun 8 13:39:48 2022 +0200

    common/archive: Ensure backward compatibility with swh-indexer 1.x
    
    idx_storage.origin_intrinsic_metadata_get does not return the same
    dict fields according to the swh-indexer version used.
    
    As swh-indexer 2.0.0 is not yet deployed in production, we must ensure
    backward compatibility with swh-indexer 1.x or the Web API endpoint
    /origin/metadata-search/ will break.

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/1890/ for more details.

Harbormaster completed remote builds in B29804: Diff 28723.Jun 8 2022, 3:10 PM
vlorentz added a comment.Jun 9 2022, 3:08 PM

Sorry for the late reply. I thought swh-indexer v2 was already deployed; but @ardumont is working on it now

ardumont added a comment.Jun 9 2022, 6:38 PM

Sorry for the late reply. I thought swh-indexer v2 was already deployed; but @ardumont is working on it now

Well not now now ¯\_(ツ)_/¯ but i've opened [1] to address it soonishly.

[1] T4319

vlorentz accepted this revision.Jun 10 2022, 9:10 AM

"ok then"

This revision is now accepted and ready to land.Jun 10 2022, 9:10 AM
anlambert updated this revision to Diff 28751.Jun 13 2022, 11:24 AM

Rebase

This revision was landed with ongoing or failed builds.Jun 13 2022, 11:42 AM
Closed by commit rDWAPPS284e0d9857b2: common/archive: Ensure backward compatibility with swh-indexer 1.x (authored by anlambert). · Explain Why
This revision was automatically updated to reflect the committed changes.
anlambert added a commit: rDWAPPS284e0d9857b2: common/archive: Ensure backward compatibility with swh-indexer 1.x.
swh-public-ci added a comment.Jun 13 2022, 11:52 AM

Build has FAILED

Patch application report for D7971 (id=28751)

Rebasing onto de50f0b449...

Current branch diff-target is up to date.
Changes applied before test
commit 284e0d9857b26674b258be17b08352ed7c68d0ad
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Wed Jun 8 13:39:48 2022 +0200

    common/archive: Ensure backward compatibility with swh-indexer 1.x
    
    idx_storage.origin_intrinsic_metadata_get does not return the same
    dict fields according to the swh-indexer version used.
    
    As swh-indexer 2.0.0 is not yet deployed in production, we must ensure
    backward compatibility with swh-indexer 1.x or the Web API endpoint
    /origin/metadata-search/ will break.

Link to build: https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/1898/
See console output for more information: https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/1898/console

Harbormaster failed remote builds in B29833: Diff 28751!Jun 13 2022, 11:52 AM

Revision Contents
Changeset List

PathSize
swh/
web/
common/
5 lines

Diff 28753

View Options

swh/web/common/archive.py

Loading...
About · Developer information · Legal