Page MenuHomeSoftware Heritage
Create Task
Maniphest T2793

add notable past events to the archive changelog
Closed, MigratedEdits Locked
Actions

Description

We want to add to the archive changelog a list of notable changes in archival.
This is potentially endless, but here are some big ones that should be there:

Revisions and Commits

rDDOC Development documentation
rDDOCde792f8fd73a archive changelog: remove WIP mark
rDDOC86f8b213e239 archive changelog: add IPOL, Bitbucket, CRAN, Save Code Now, PyPI, HAL

Related Objects
Search...

Event Timeline

zack triaged this task as Normal priority.Nov 18 2020, 10:19 AM
zack created this task.
zack mentioned this in rDDOC2af5c3ae9a30: archive journal: add first archival date, gitorious, google code.Nov 25 2020, 1:52 PM
zack changed the task status from Open to Work in Progress.Nov 25 2020, 1:55 PM
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)Nov 25 2020, 1:58 PM
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)
anlambert updated the task description. (Show Details)Dec 9 2020, 3:04 PM
ardumont updated the task description. (Show Details)Dec 9 2020, 3:17 PM
ardumont added a subscriber: ardumont.Dec 9 2020, 3:49 PM

what happened on 2020-03-01, explaining why archive started growing much faster (related to github listing/loading)

i recall something like:

  • listers starvation, only github listing stuff
  • around late january 2020, modified the listing to actually have 1 lister listing incremental github only
  • other workers then started listing other forges
  • then around march some other modifications happened which i forgot... but still that ^ could have helped also
ardumont added a comment.Dec 9 2020, 4:20 PM

Also [1] (period 20/01/2020 up to 01/04/2020) might come in handy...

I've started tagging in grafana new deployment (tag "deployment") done around february 2020 and I tried being consistent ever since.

[1] https://grafana.softwareheritage.org/d/b_xh3f9ik/worker-task-processing?orgId=1&from=1579474800000&to=1585778399000&var-environment=production&var-interval=$__auto_interval_interval&var-task=All&var-worker=All

ardumont updated the task description. (Show Details)Dec 9 2020, 4:23 PM
ardumont updated the task description. (Show Details)Dec 9 2020, 4:26 PM
zack updated the task description. (Show Details)Dec 10 2020, 10:54 AM
zack updated the task description. (Show Details)Dec 10 2020, 10:58 AM
zack updated the task description. (Show Details)Dec 10 2020, 11:01 AM
zack updated the task description. (Show Details)Dec 10 2020, 11:03 AM
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)Dec 10 2020, 11:07 AM
zack updated the task description. (Show Details)Dec 10 2020, 11:10 AM
zack updated the task description. (Show Details)Dec 10 2020, 11:12 AM
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)Dec 10 2020, 11:17 AM
zack updated the task description. (Show Details)Dec 10 2020, 11:28 AM
zack updated the task description. (Show Details)Dec 10 2020, 11:30 AM
zack updated the task description. (Show Details)Dec 10 2020, 4:21 PM
zack updated the task description. (Show Details)Dec 10 2020, 4:54 PM

I've completed a bunch of these in 86f8b213e23970feb9f9bda8ab87fc7d6851abf0

zack added a commit: rDDOC86f8b213e239: archive changelog: add IPOL, Bitbucket, CRAN, Save Code Now, PyPI, HAL.Dec 10 2020, 4:56 PM
zack mentioned this in rDDOCfc4f1b16010b: archive changelog: document GitLab(s), GNU, and NPM ingestion.Dec 11 2020, 3:06 PM
zack updated the task description. (Show Details)Dec 11 2020, 3:07 PM
zack mentioned this in rDDOCfee11b54747d: archive changelog: document Guix and NixOS archival.Dec 11 2020, 3:57 PM
zack updated the task description. (Show Details)Dec 11 2020, 3:57 PM
zack updated the task description. (Show Details)Dec 11 2020, 4:21 PM
zack closed this task as Resolved by committing rDDOCde792f8fd73a: archive changelog: remove WIP mark.Dec 11 2020, 4:23 PM
zack added a commit: rDDOCde792f8fd73a: archive changelog: remove WIP mark.
zack renamed this task from add to the journal of archive changes notable past events to add notable past events to the archive changelog.Dec 11 2020, 4:24 PM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:32 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal