HomeSoftware Heritage

Deduplicate origin-metadata when they have the same authority + discovery_date…

Description

Deduplicate origin-metadata when they have the same authority + discovery_date + fetcher.

By replacing the old value with the new one.

This will allow an easy implementation of pagination, using the fetcher
id as an opaque page_token.

Plus, it did not make sense logically to have different metadata from
the same authority at the same time (especially with the same fetcher).

Details

Provenance
vlorentzAuthored on Jun 4 2020, 12:33 PM
vlorentzPushed on Jun 8 2020, 4:59 PM
Differential Revision
D3240: Add pagination to origin_metadata_get.
Parents
rDSTOdcef916e5edb: Open `origin_visit_status_add` endpoint to add origin visit statuses
Branches
Unknown
Tags
Unknown
Build Status
Buildable 12705
Build 19319: test-and-buildJenkins console · Jenkins