Page MenuHomeSoftware Heritage

add notable past events to the archive changelog
Closed, ResolvedPublic

Description

We want to add to the archive changelog a list of notable changes in archival.
This is potentially endless, but here are some big ones that should be there:

Event Timeline

zack triaged this task as Normal priority.Nov 18 2020, 10:19 AM
zack created this task.
zack changed the task status from Open to Work in Progress.Nov 25 2020, 1:55 PM
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)
zack updated the task description. (Show Details)

what happened on 2020-03-01, explaining why archive started growing much faster (related to github listing/loading)

i recall something like:

  • listers starvation, only github listing stuff
  • around late january 2020, modified the listing to actually have 1 lister listing incremental github only
  • other workers then started listing other forges
  • then around march some other modifications happened which i forgot... but still that ^ could have helped also

Also [1] (period 20/01/2020 up to 01/04/2020) might come in handy...

I've started tagging in grafana new deployment (tag "deployment") done around february 2020 and I tried being consistent ever since.

[1] https://grafana.softwareheritage.org/d/b_xh3f9ik/worker-task-processing?orgId=1&from=1579474800000&to=1585778399000&var-environment=production&var-interval=$__auto_interval_interval&var-task=All&var-worker=All

zack updated the task description. (Show Details)
zack updated the task description. (Show Details)
zack renamed this task from add to the journal of archive changes notable past events to add notable past events to the archive changelog.Dec 11 2020, 4:24 PM