Page MenuHomeSoftware Heritage
Create Task
Maniphest T595

Read sha1s from git repositories and send them for archive in azure
Closed, MigratedEdits Locked
Actions

Description

To properly send sha1s to archive in azure, we are working from the result of the provenance cache.
It's working slowly.

Loading sha1s from known repositories (we already have) and send that result directly to the archiver queue should bypass that temporary setback.

Related Objects
Search...

Event Timeline

ardumont created this task.Oct 25 2016, 6:51 PM

Related:

  • 86928fa8ff8c491ce830387080ab47e668204f4f
  • 50754523e84b4bff4e1a9c6765302cc3796d70b0
ardumont raised the priority of this task from Low to Normal.Oct 25 2016, 6:52 PM
ardumont edited parent tasks, added: Unknown Object (Maniphest Task); removed: T594: Properly package universal-ctags.Oct 25 2016, 6:55 PM
ardumont edited parent tasks, added: Unknown Object (Maniphest Task); removed: T594: Properly package universal-ctags.
ardumont mentioned this in rSPPROF96eaa32ebe60: swh::deploy::worker::swh_reader_git: Add reader git queue.Oct 25 2016, 6:58 PM
ardumont mentioned this in rSPSITE0444c5d5eb31: data/defaults: Add reader git configuration.
ardumont mentioned this in rSPSITEaea733ae4dbd: data/uffizi: Add new swh_reader_git.
ardumont mentioned this in rSPPROF80b8333f4662: swh::deploy::worker::swh_reader_git: Fix extra ;;.Oct 25 2016, 7:19 PM
ardumont mentioned this in rSPSITE0938eb6f869e: uffizi/worker01: Swap the reader git from uffizi to worker01.Oct 26 2016, 4:30 PM
ardumont mentioned this in rSPPROFf06f15a75acc: deploy::worker::(loader|reader)_git: Fix conflict.Oct 26 2016, 6:42 PM
ardumont mentioned this in rSPSITE5762c5689460: worker01: Only 1 archiver to azure worker.Oct 26 2016, 7:01 PM
ardumont mentioned this in rDLDGf9a750474866: git-remote-reader: Returns the sha1 and not the sha1_git.Oct 26 2016, 8:50 PM
ardumont mentioned this in rDLDGd222d5e2b1f4: Add a basic producer to send urls to git-reader queue.
ardumont added a comment.Oct 27 2016, 3:48 PM

reader git is currently running from worker01.

1000 stars repositories have been queued in the swh_reader_git queue.
List is stored in /srv/storage/space/lists/1000-stars-repositories.txt.gz in uffizi.

ardumont changed the task status from Open to Work in Progress.Oct 27 2016, 3:48 PM
ardumont closed this task as Resolved.Nov 4 2016, 3:10 PM
ardumont created subtask T597: Check reader git did its job.Nov 4 2016, 3:13 PM
ardumont changed the status of subtask T597: Check reader git did its job from Open to Work in Progress.
ardumont closed subtask T597: Check reader git did its job as Resolved.Nov 5 2016, 6:46 PM
ardumont mentioned this in rSPSITE96eaa32ebe60: swh::deploy::worker::swh_reader_git: Add reader git queue.Jun 15 2018, 2:29 PM
ardumont mentioned this in rSPSITE80b8333f4662: swh::deploy::worker::swh_reader_git: Fix extra ;;.
ardumont mentioned this in rSPSITEf06f15a75acc: deploy::worker::(loader|reader)_git: Fix conflict.
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:20 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

gitlab-migration changed the status of subtask T597: Check reader git did its job from Resolved to Migrated.Jan 8 2023, 4:20 PM
About · Developer information · Legal