Make loaders use ExtId to find what artifacts are already loaded, in addition to revision.metadata
Closed, MigratedEdits Locked
Actions

Assigned To

Authored By

	vlorentz
	Mar 16 2021, 12:19 PM

Description

We want to stop using revision.metadata.

Using ExtId first, then revision.metadata for what couldn't be found, is a transitional state between the two mechanisms.

Revisions and Commits

rDLDHG Mercurial loader
		D5371	rDLDHGf5e96a7e3f37 HgLoaderFromDisk: Read and write ExtIDs to find revisions already loaded
rDLDBASE Generic VCS/Package Loader
	Closed		D5345 package.loader: Unnest loops in PackageLoader.load()
		D5349	rDLDBASEa32f68715102 package.loader: Lookup packages from the ExtID storage

Related Objects
Search...

Status	Assigned	Task
Migrated	gitlab-migration	T3197 Mirror: fix common issues of a replayer session
Migrated	gitlab-migration	T3201 Mirror: unsupported Unicode escape sequence
Migrated	gitlab-migration	T1258 Synthesize release objects for all upstream things that match the concept of a release
Migrated	gitlab-migration	T2059 Generate (swh) releases from all git tags
Migrated	gitlab-migration	T3089 Remove the 'metadata' column of the 'revision' table
Migrated	gitlab-migration	T3090 Make loaders not rely on the 'metadata' column of the 'revision' table
Migrated	gitlab-migration	T2471 NPM package angular-ts-manage fails to be properly loaded
Migrated	gitlab-migration	T3138 Make loaders stop writing in the 'metadata' column of the 'revision' table
Migrated	gitlab-migration	T3139 Make loaders stop reading from the 'metadata' column of the 'revision' table
Migrated	gitlab-migration	T3140 Make loaders use ExtId to find what artifacts are already loaded, in addition to revision.metadata
Migrated	gitlab-migration	T3141 Make loaders pass ExtId objects between functions instead of "known_artifact"

Event Timeline

vlorentz triaged this task as Normal priority.Mar 16 2021, 12:19 PM

vlorentz created this task.

vlorentz renamed this task from Make loaders use ExtId to find what artefacts are already loaded, in addition to revision.metadata to Make loaders use ExtId to find what artifacts are already loaded, in addition to revision.metadata.Mar 16 2021, 12:27 PM

vlorentz mentioned this in T3090: Make loaders not rely on the 'metadata' column of the 'revision' table.

vlorentz closed subtask T3141: Make loaders pass ExtId objects between functions instead of "known_artifact" as Resolved.Mar 25 2021, 7:22 PM

vlorentz removed a subtask: T3142: Make loaders write to the ExtId storage.

vlorentz added a revision: D5349: package.loader: Lookup packages from the ExtID storage.Mar 25 2021, 7:22 PM

ardumont mentioned this in D5349: package.loader: Lookup packages from the ExtID storage.Mar 25 2021, 7:49 PM

vlorentz added a commit: rDLDBASEa32f68715102: package.loader: Lookup packages from the ExtID storage.Mar 26 2021, 11:44 AM

vlorentz reopened subtask T3141: Make loaders pass ExtId objects between functions instead of "known_artifact" as Open.Mar 29 2021, 10:54 AM

vlorentz added a revision: D5345: package.loader: Unnest loops in PackageLoader.load().Mar 29 2021, 10:58 AM

vlorentz mentioned this in D5369: HgLoaderFromDisk: Don't query revision_get with release ids.Mar 29 2021, 2:09 PM

vlorentz added a revision: D5371: HgLoaderFromDisk: Read and write ExtIDs to find revisions already loaded.

vlorentz added a commit: rDLDHGf5e96a7e3f37: HgLoaderFromDisk: Read and write ExtIDs to find revisions already loaded.Mar 30 2021, 9:46 AM

vlorentz closed subtask T3141: Make loaders pass ExtId objects between functions instead of "known_artifact" as Resolved.Mar 30 2021, 4:56 PM