Page MenuHomeSoftware Heritage
Create Task
Maniphest T1848

refresh graph dataset export
Closed, MigratedEdits Locked
Actions

Description

we want to update the graph dataset export, which is now dating back to January 2019 https://annex.softwareheritage.org/public/dataset/graph/2019-01-28/

ideally, doing so could be the test bed for a first fully automated export (T1847)

Related Objects
Search...

Event Timeline

zack triaged this task as Low priority.Jun 23 2019, 10:21 PM
zack created this task.
zack added a subtask: T1847: fully automate export of the graph dataset.
zack added a subtask: T1741: graph dataset: update to use persistent identifiers everywhere.
zack added a parent task: T1868: refresh compressed representation of the archive.Jun 30 2019, 1:58 PM
zack raised the priority of this task from Low to Normal.Nov 18 2019, 2:50 PM
seirl closed subtask T1741: graph dataset: update to use persistent identifiers everywhere as Resolved.Jun 3 2020, 4:08 PM
zack added a comment.Sep 16 2020, 8:42 PM
This comment was removed by zack.
zack raised the priority of this task from Normal to High.Sep 16 2020, 8:42 PM
zack removed a parent task: T1868: refresh compressed representation of the archive.
zack changed the status of subtask T1847: fully automate export of the graph dataset from Open to Work in Progress.Sep 17 2020, 9:04 AM
rdicosmo added a parent task: T3085: Complete and updated copy of the archive on S3 (objects+graph).Mar 8 2021, 9:45 AM
seirl closed subtask T1847: fully automate export of the graph dataset as Resolved.Mar 26 2021, 12:04 PM
zack reopened subtask T1847: fully automate export of the graph dataset as Open.Mar 26 2021, 12:25 PM
seirl closed subtask T1847: fully automate export of the graph dataset as Resolved.Apr 29 2022, 5:57 PM
seirl changed the task status from Open to Work in Progress.Apr 29 2022, 6:23 PM
seirl moved this task from Backlog to In progress on the Datasets board.
seirl closed this task as Resolved.May 1 2022, 12:08 PM

Now that there is both a columnar+compressed graph from 2021 and a columnar graph from 2022 that is pending compression, this task about "refreshing the export from January 2019" is resolved.

gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:27 PM
gitlab-migration claimed this task.
gitlab-migration changed the status of subtask T1741: graph dataset: update to use persistent identifiers everywhere from Resolved to Migrated.
gitlab-migration added subscribers: seirl, gitlab-migration.

This task has been migrated to GitLab.

gitlab-migration changed the status of subtask T1847: fully automate export of the graph dataset from Resolved to Migrated.Jan 8 2023, 9:59 PM
About · Developer information · Legal