Maniphest T3085

Complete and updated copy of the archive on S3 (objects+graph)
Closed, MigratedEdits Locked
Actions

Description

Keep an updated copy of the archive on S3:

live replication of the objects T1954
regular dump of the (anonymized) Merkle graph
have alerting and monitoring on these T3477

Related Objects
Search...

		Status	Assigned	Task
		Migrated	gitlab-migration	T3085 Complete and updated copy of the archive on S3 (objects+graph)
		Migrated	gitlab-migration	T1848 refresh graph dataset export
		Migrated	gitlab-migration	T1847 fully automate export of the graph dataset
		Migrated	gitlab-migration	T3178 document how to export the graph dataset automatically
		Migrated	gitlab-migration	T2431 Document how to export the graph edge dataset
		Migrated	gitlab-migration	T1741 graph dataset: update to use persistent identifiers everywhere
		Migrated	gitlab-migration	T1743 create a nice landing web page for exported dataset
		Migrated	gitlab-migration	T3477 Add alerting when the copy to S3 starts lagging
		Migrated	gitlab-migration	T1954 Up-to-date objstorage mirror on S3
		Migrated	gitlab-migration	T2003 Content replayer may try to copy objects before they are available from an objstorage

Event Timeline

rdicosmo created this task.Mar 4 2021, 5:50 PM

rdicosmo added a subtask: T1954: Up-to-date objstorage mirror on S3.

vlorentz triaged this task as High priority.Mar 5 2021, 2:49 PM

rdicosmo added a subtask: T1848: refresh graph dataset export.Mar 8 2021, 9:45 AM

rdicosmo added a subtask: T1743: create a nice landing web page for exported dataset.Mar 8 2021, 9:49 AM

rdicosmo added a project: Roadmap 2021.

rdicosmo moved this task from Backlog to Done on the Roadmap 2021 board.Mar 8 2021, 9:56 AM

rdicosmo moved this task from Done to Backlog on the Roadmap 2021 board.

rdicosmo moved this task from Backlog to Work in progress on the Roadmap 2021 board.

rdicosmo added a project: meta-task.Mar 8 2021, 10:13 AM

olasd claimed this task.Apr 12 2021, 5:04 PM

douardda updated the task description. (Show Details)Aug 10 2021, 3:56 PM

douardda updated the task description. (Show Details)Aug 10 2021, 4:00 PM

olasd closed subtask T1954: Up-to-date objstorage mirror on S3 as Resolved.Dec 16 2021, 3:12 PM

bchauvet added a project: Roadmap 2022.Mar 23 2022, 4:39 PM

bchauvet lowered the priority of this task from High to Low.Mar 25 2022, 5:28 PM

zack changed the status of subtask T1743: create a nice landing web page for exported dataset from Open to Work in Progress.Apr 5 2022, 1:39 PM

seirl closed subtask T1743: create a nice landing web page for exported dataset as Resolved.Apr 29 2022, 6:14 PM

seirl changed the status of subtask T1848: refresh graph dataset export from Open to Work in Progress.Apr 29 2022, 6:23 PM

seirl closed subtask T1848: refresh graph dataset export as Resolved.May 1 2022, 12:08 PM

gitlab-migration changed the status of subtask T1954: Up-to-date objstorage mirror on S3 from Resolved to Migrated.Oct 19 2022, 5:56 PM

This task has been migrated to GitLab.

gitlab-migration closed subtask T3477: Add alerting when the copy to S3 starts lagging as Migrated.Oct 19 2022, 6:03 PM

gitlab-migration changed the status of subtask T1743: create a nice landing web page for exported dataset from Resolved to Migrated.Jan 8 2023, 4:27 PM

gitlab-migration changed the status of subtask T1848: refresh graph dataset export from Resolved to Migrated.