Page MenuHomeSoftware Heritage
Create Task
Maniphest T90

swh-loader-tar - Load gnu tarballs in swh-storage
Closed, ResolvedPublic
Actions

Related Objects
Search...

StatusAssignedTask
 ResolvedardumontT90 swh-loader-tar - Load gnu tarballs in swh-storage
 ResolvedardumontT104 release swh-loader-dir
 ResolvedardumontT105 make worker01 stop consuming swh_loader_git messages
 ResolvedNoneT106 Test on worker01: producing and consuming one swh_loader_tar message
 ResolvedardumontT107 Load an actual tarball in swh
 ResolvedardumontT123 Tryouts run on old-gnu to complete the tarball listing exhaustiveness
 ResolvedardumontT124 Tryouts run on gnu to complete the tarball listing exhaustiveness
 ResolvedardumontT125 Permits loading of tarball subsets from a file
 ResolvedardumontT126 release swh-core
 ResolvedardumontT127 release swh-loader-tar
 ResolvedardumontT136 Load tarballs in a production-like swh-storage instance on worker01
 ResolvedardumontT140 analysis errors on first loading batch
 ResolvedardumontT141 compute missing tarballs list for reloading the ones missing
 InvalidardumontT142 reload missing tarballs
 ResolvedardumontT143 understand why errors does not appear in log db
 InvalidardumontT147 Migrate code to use latest schema improvments from T3
 ResolvedNoneT149 Populate fetch_history table
 ResolvedNoneT148 Populate fetch_history
 ResolvedardumontT22 DB schema: add metadata field to revision table
 ResolvedardumontT154 Send tarball checksums along the revision
 ResolvedardumontT155 Deploy and load tarballs from worker01
 ResolvedardumontT156 Package latest swh-storage
 ResolvedardumontT157 Package latest swh-loader-dir
 ResolvedardumontT158 Package latest swh-loader-tar
 ResolvedardumontT170 Random order in tarball messages computation
 ResolvedardumontT171 Fix content loading only when needed
 ResolvedardumontT174 Analyse and fix last errors
 ResolvedardumontT175 Redeploy and trigger sublist of tarballs impacted by errors
 ResolvedardumontT176 Fix `Permission denied: write to /usr/local/lib/gcl-3...`
ResolvedardumontT178 Replay loading mirror gnu and old-gnu from scratch
 ResolvedardumontT183 gnu/old-gnu injection to production

Event Timeline

ardumont created this task.Oct 13 2015, 3:38 PM
ardumont raised the priority of this task from to High.
ardumont updated the task description. (Show Details)
ardumont added a subscriber: ardumont.
Herald added a project: Staff. · View Herald TranscriptOct 13 2015, 3:38 PM
zack added a project: Developers.Oct 14 2015, 10:14 AM
ardumont claimed this task.Oct 16 2015, 12:46 PM
ardumont added a project: Directory loader.
ardumont closed subtask T107: Load an actual tarball in swh as Resolved.
ardumont lowered the priority of this task from High to Normal.Oct 16 2015, 2:16 PM
ardumont closed subtask T123: Tryouts run on old-gnu to complete the tarball listing exhaustiveness as Resolved.Oct 23 2015, 10:52 AM
ardumont closed subtask T124: Tryouts run on gnu to complete the tarball listing exhaustiveness as Resolved.
ardumont closed subtask T125: Permits loading of tarball subsets from a file as Resolved.
ardumont closed subtask T126: release swh-core as Resolved.Oct 23 2015, 11:20 AM
ardumont closed subtask T104: release swh-loader-dir as Resolved.Oct 23 2015, 11:44 AM
ardumont added a project: Tarball loader.Oct 23 2015, 12:00 PM
ardumont closed subtask T127: release swh-loader-tar as Resolved.
ardumont closed subtask T105: make worker01 stop consuming swh_loader_git messages as Resolved.Oct 23 2015, 12:07 PM
ardumont renamed this task from swh-loader-tar - Load a tarball in swh-storage to swh-loader-tar - Load tarballs in swh-storage.Oct 23 2015, 5:21 PM
ardumont closed subtask T106: Test on worker01: producing and consuming one swh_loader_tar message as Resolved.
ardumont closed subtask T136: Load tarballs in a production-like swh-storage instance on worker01 as Resolved.Oct 26 2015, 12:33 PM
ardumont closed subtask T143: understand why errors does not appear in log db as Resolved.Oct 26 2015, 3:19 PM
ardumont closed subtask T141: compute missing tarballs list for reloading the ones missing as Resolved.
ardumont closed subtask T140: analysis errors on first loading batch as Resolved.
ardumont added a subtask: T62: DB schema: add directory→tarball provenance information.Oct 26 2015, 3:25 PM
ardumont closed subtask T147: Migrate code to use latest schema improvments from T3 as Invalid.Oct 26 2015, 4:59 PM
ardumont added subtasks: T149: Populate fetch_history table, T148: Populate fetch_history, T22: DB schema: add metadata field to revision table.Oct 27 2015, 4:03 PM
ardumont closed subtask T22: DB schema: add metadata field to revision table as Resolved.Oct 28 2015, 11:29 AM
ardumont closed subtask T154: Send tarball checksums along the revision as Resolved.Oct 28 2015, 12:04 PM
ardumont closed subtask T142: reload missing tarballs as Invalid.
ardumont removed a subtask: T62: DB schema: add directory→tarball provenance information.Oct 28 2015, 4:58 PM
ardumont closed subtask T171: Fix content loading only when needed as Resolved.Oct 30 2015, 12:06 PM
ardumont closed subtask T170: Random order in tarball messages computation as Resolved.
ardumont closed subtask T155: Deploy and load tarballs from worker01 as Resolved.Nov 2 2015, 10:42 AM
ardumont closed subtask T174: Analyse and fix last errors as Resolved.Nov 2 2015, 11:34 AM
ardumont closed subtask T176: Fix `Permission denied: write to /usr/local/lib/gcl-3...` as Resolved.Nov 2 2015, 4:17 PM
ardumont closed subtask T175: Redeploy and trigger sublist of tarballs impacted by errors as Resolved.Nov 2 2015, 5:03 PM
ardumont removed a subtask: T177: Investigate `Not implemented 'compression type 6 implode'`.
ardumont closed subtask T178: Replay loading mirror gnu and old-gnu from scratch as Resolved.Nov 3 2015, 12:02 PM
ardumont removed a subtask: T182: investigate gnu.org tarball ingestion failures.Nov 3 2015, 1:52 PM
ardumont changed the status of subtask T183: gnu/old-gnu injection to production from Open to Work in Progress.Nov 5 2015, 10:56 AM
ardumont changed the status of subtask T183: gnu/old-gnu injection to production from Work in Progress to Open.
ardumont changed the status of subtask T183: gnu/old-gnu injection to production from Open to Work in Progress.
ardumont renamed this task from swh-loader-tar - Load tarballs in swh-storage to swh-loader-tar - Load gnu tarballs in swh-storage.Nov 6 2015, 12:09 PM
ardumont closed this task as Resolved.
ardumont closed subtask T183: gnu/old-gnu injection to production as Resolved.
zack removed projects: Developers, Staff.Mar 10 2016, 5:52 PM
olasd changed the visibility from "All Users" to "Public (No Login Required)".May 13 2016, 5:06 PM
zack mentioned this in T2793: add notable past events to the archive changelog.Dec 10 2020, 11:17 AM
About · Developer information · Legal