Maniphest T2686

Use hashes for all kafka keys
Open, NormalPublic
Actions

Tags

Subscribers

Assigned To

Authored By

	vlorentz
	Mon, Oct 12, 1:04 PM

Description

including origins, visits, visit statuses, and extrinsic metadata

currently we are using a mix of hashes, and dicts of bytes and str, so it's less than ideal.

It would also solve the issue we have to implement T2668.

Related Objects
Search...

		Status	Assigned	Task
		Work in Progress	olasd	T2520 Setup dedicated kafka cluster on new rocquencourt hardware
		Open	olasd	T2686 Use hashes for all kafka keys
		Open	olasd	T2703 Use intrinsic identifiers/hashes for RawExtrinsicMetadata objects
		Open	olasd	T2704 Use a hash as id/ unicity key for MetadataFetcher and MetadataAuthority

Event Timeline

vlorentz triaged this task as Normal priority.Mon, Oct 12, 1:04 PM

vlorentz created this task.

vlorentz added a parent task: T2520: Setup dedicated kafka cluster on new rocquencourt hardware.

vlorentz mentioned this in T2672: Inconsistent keys between visits and origin visits in the journal.

vlorentz updated the task description. (Show Details)

vlorentz added a parent task: T2668: Package loaders should write extrinsic metadata on directories instead of revisions/releases.

vlorentz updated the task description. (Show Details)Mon, Oct 12, 1:06 PM

vlorentz updated the task description. (Show Details)

vlorentz mentioned this in D4194: model: use visit ids in the unique key, instead of their date..Mon, Oct 12, 1:56 PM

ardumont updated the task description. (Show Details)Tue, Oct 13, 8:51 AM

vlorentz mentioned this in T2704: Use a hash as id/ unicity key for MetadataFetcher and MetadataAuthority.Wed, Oct 14, 2:07 PM

vlorentz added subtasks: T2703: Use intrinsic identifiers/hashes for RawExtrinsicMetadata objects, T2704: Use a hash as id/ unicity key for MetadataFetcher and MetadataAuthority.

vlorentz removed a parent task: T2668: Package loaders should write extrinsic metadata on directories instead of revisions/releases.