Page MenuHomeSoftware Heritage
Feed Advanced Search

Feb 26 2016

ardumont added a comment to T302: swh-loader-tar origin validities are the current time instead of the mirroring time.

There are also duplicates that need to be removed.
There should only be one origin_visit.
So the 187 number here should be 1.

Feb 26 2016, 10:55 AM · Tarball loader

Feb 25 2016

ardumont added a comment to T302: swh-loader-tar origin validities are the current time instead of the mirroring time.

The gnu urls are of the form 'rsync://', that's the way to have hold on the origins to update.

Feb 25 2016, 1:48 PM · Tarball loader
ardumont added a comment to T302: swh-loader-tar origin validities are the current time instead of the mirroring time.

swh-loader-tar should use the time of mirroring instead of the current time to create the occurrences

Feb 25 2016, 1:43 PM · Tarball loader
ardumont closed T324: Check loader-tar's storage compatibility as Resolved.
Feb 25 2016, 1:37 PM · Tarball loader

Feb 24 2016

ardumont claimed T324: Check loader-tar's storage compatibility.
Feb 24 2016, 5:23 PM · Tarball loader
ardumont created T324: Check loader-tar's storage compatibility.
Feb 24 2016, 4:06 PM · Tarball loader
Herald added a project to T302: swh-loader-tar origin validities are the current time instead of the mirroring time: Developers.

Hint: Use the TIMESTAMP file which holds the date of the last rsync.

Feb 24 2016, 4:02 PM · Tarball loader

Feb 22 2016

olasd set the image for Tarball loader to Unknown Object (File).
Feb 22 2016, 8:18 PM

Jan 28 2016

olasd created T302: swh-loader-tar origin validities are the current time instead of the mirroring time.
Jan 28 2016, 5:31 PM · Tarball loader

Nov 9 2015

ardumont placed T177: Investigate `Not implemented 'compression type 6 implode'` up for grabs.
Nov 9 2015, 10:19 AM · Directory loader, Tarball loader
ardumont placed T182: investigate gnu.org tarball ingestion failures up for grabs.
Nov 9 2015, 10:19 AM · Origin-GNU, Directory loader, Tarball loader

Nov 6 2015

ardumont closed T184: Create a tarball from swh storage as Resolved.
Nov 6 2015, 6:10 PM · Tarball loader
ardumont claimed T184: Create a tarball from swh storage.
Nov 6 2015, 1:55 PM · Tarball loader
ardumont closed T90: swh-loader-tar - Load gnu tarballs in swh-storage as Resolved.
Nov 6 2015, 12:09 PM · Tarball loader, Directory loader
ardumont renamed T90: swh-loader-tar - Load gnu tarballs in swh-storage from swh-loader-tar - Load tarballs in swh-storage to swh-loader-tar - Load gnu tarballs in swh-storage.
Nov 6 2015, 12:09 PM · Tarball loader, Directory loader
ardumont closed T183: gnu/old-gnu injection to production as Resolved.
Nov 6 2015, 12:09 PM · Directory loader, Tarball loader
ardumont closed T183: gnu/old-gnu injection to production, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Nov 6 2015, 12:09 PM · Tarball loader, Directory loader

Nov 5 2015

ardumont changed the status of T183: gnu/old-gnu injection to production from Open to Work in Progress.
Nov 5 2015, 10:57 AM · Directory loader, Tarball loader
ardumont changed the status of T183: gnu/old-gnu injection to production, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, from Open to Work in Progress.
Nov 5 2015, 10:57 AM · Tarball loader, Directory loader
ardumont changed the status of T183: gnu/old-gnu injection to production from Work in Progress to Open.
Nov 5 2015, 10:57 AM · Directory loader, Tarball loader
ardumont changed the status of T183: gnu/old-gnu injection to production, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, from Work in Progress to Open.
Nov 5 2015, 10:57 AM · Tarball loader, Directory loader
ardumont changed the status of T183: gnu/old-gnu injection to production from Open to Work in Progress.
Nov 5 2015, 10:56 AM · Directory loader, Tarball loader
ardumont changed the status of T183: gnu/old-gnu injection to production, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, from Open to Work in Progress.
Nov 5 2015, 10:56 AM · Tarball loader, Directory loader
ardumont added a comment to T183: gnu/old-gnu injection to production.
  • old-gnu tarball messages sent to queue
  • gnu tarball messages sent to queue
Nov 5 2015, 10:48 AM · Directory loader, Tarball loader

Nov 4 2015

ardumont triaged T184: Create a tarball from swh storage as Normal priority.
Nov 4 2015, 11:03 AM · Tarball loader

Nov 3 2015

olasd added a comment to T184: Create a tarball from swh storage.

Related : T75

Nov 3 2015, 7:12 PM · Tarball loader
ardumont renamed T183: gnu/old-gnu injection to production from Go to production to gnu/old-gnu injection to production.
Nov 3 2015, 3:02 PM · Directory loader, Tarball loader
ardumont added a project to T184: Create a tarball from swh storage: Tarball loader.
Nov 3 2015, 2:11 PM · Tarball loader
ardumont raised the priority of T183: gnu/old-gnu injection to production from Normal to High.
Nov 3 2015, 1:53 PM · Directory loader, Tarball loader
ardumont created T183: gnu/old-gnu injection to production.
Nov 3 2015, 1:53 PM · Directory loader, Tarball loader
ardumont removed a parent task for T182: investigate gnu.org tarball ingestion failures: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Nov 3 2015, 1:52 PM · Origin-GNU, Directory loader, Tarball loader
ardumont removed a subtask for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T182: investigate gnu.org tarball ingestion failures.
Nov 3 2015, 1:52 PM · Tarball loader, Directory loader
ardumont lowered the priority of T177: Investigate `Not implemented 'compression type 6 implode'` from Normal to Low.
Nov 3 2015, 1:52 PM · Directory loader, Tarball loader
ardumont lowered the priority of T182: investigate gnu.org tarball ingestion failures from Normal to Low.
Nov 3 2015, 1:51 PM · Origin-GNU, Directory loader, Tarball loader
ardumont lowered the priority of T182: investigate gnu.org tarball ingestion failures from High to Normal.
Nov 3 2015, 12:24 PM · Origin-GNU, Directory loader, Tarball loader
ardumont created T182: investigate gnu.org tarball ingestion failures.
Nov 3 2015, 12:03 PM · Origin-GNU, Directory loader, Tarball loader
ardumont closed T178: Replay loading mirror gnu and old-gnu from scratch, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Nov 3 2015, 12:02 PM · Tarball loader, Directory loader
ardumont closed T178: Replay loading mirror gnu and old-gnu from scratch as Resolved.
Nov 3 2015, 12:02 PM · Directory loader, Tarball loader

Nov 2 2015

ardumont added a comment to T178: Replay loading mirror gnu and old-gnu from scratch.
  • db cleanup
  • old gnu messages sent to broker (started: Mon Nov 2 17:10:36 CET 2015)
  • gnu messages sent to broker (started: Mon Nov 2 17:17:12 CET 2015)
  • loading all gnu tarballs
Nov 2 2015, 5:18 PM · Directory loader, Tarball loader
ardumont created T178: Replay loading mirror gnu and old-gnu from scratch.
Nov 2 2015, 5:06 PM · Directory loader, Tarball loader
ardumont removed a parent task for T177: Investigate `Not implemented 'compression type 6 implode'`: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Nov 2 2015, 5:04 PM · Directory loader, Tarball loader
ardumont removed a subtask for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T177: Investigate `Not implemented 'compression type 6 implode'`.
Nov 2 2015, 5:04 PM · Tarball loader, Directory loader
ardumont closed T175: Redeploy and trigger sublist of tarballs impacted by errors as Resolved.
Nov 2 2015, 5:03 PM · Directory loader, Tarball loader
ardumont closed T175: Redeploy and trigger sublist of tarballs impacted by errors, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Nov 2 2015, 5:03 PM · Tarball loader, Directory loader
ardumont closed T176: Fix `Permission denied: write to /usr/local/lib/gcl-3...` as Resolved.
Nov 2 2015, 4:17 PM · Directory loader, Tarball loader
ardumont closed T176: Fix `Permission denied: write to /usr/local/lib/gcl-3...` , a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Nov 2 2015, 4:17 PM · Tarball loader, Directory loader
ardumont added a comment to T176: Fix `Permission denied: write to /usr/local/lib/gcl-3...` .

9a3349e fixes it

Nov 2 2015, 4:17 PM · Directory loader, Tarball loader
ardumont created T177: Investigate `Not implemented 'compression type 6 implode'`.
Nov 2 2015, 11:36 AM · Directory loader, Tarball loader
ardumont created T176: Fix `Permission denied: write to /usr/local/lib/gcl-3...` .
Nov 2 2015, 11:34 AM · Directory loader, Tarball loader
ardumont closed T174: Analyse and fix last errors as Resolved.
Nov 2 2015, 11:34 AM · Directory loader, Tarball loader
ardumont closed T174: Analyse and fix last errors, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Nov 2 2015, 11:34 AM · Tarball loader, Directory loader
ardumont added a comment to T174: Analyse and fix last errors.
  • Do not skip tarball containing empty upper root directory
  • Fix broken link size and data computation
Nov 2 2015, 11:21 AM · Directory loader, Tarball loader
ardumont raised the priority of T174: Analyse and fix last errors from Normal to High.
Nov 2 2015, 10:48 AM · Directory loader, Tarball loader
ardumont created T175: Redeploy and trigger sublist of tarballs impacted by errors.
Nov 2 2015, 10:43 AM · Directory loader, Tarball loader
ardumont created T174: Analyse and fix last errors.
Nov 2 2015, 10:43 AM · Directory loader, Tarball loader
ardumont closed T155: Deploy and load tarballs from worker01 as Resolved.
Nov 2 2015, 10:42 AM · Directory loader, Tarball loader
ardumont closed T155: Deploy and load tarballs from worker01, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Nov 2 2015, 10:42 AM · Tarball loader, Directory loader

Oct 30 2015

ardumont added a comment to T155: Deploy and load tarballs from worker01.
  • random archive message generation from producer
  • reading content optimization on swh-loader-dir
  • db cleaned up
Oct 30 2015, 2:47 PM · Directory loader, Tarball loader
ardumont closed T170: Random order in tarball messages computation as Resolved.
Oct 30 2015, 12:07 PM · Directory loader, Tarball loader
ardumont closed T170: Random order in tarball messages computation, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 30 2015, 12:07 PM · Tarball loader, Directory loader
ardumont closed T171: Fix content loading only when needed, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 30 2015, 12:06 PM · Tarball loader, Directory loader
ardumont created T170: Random order in tarball messages computation.
Oct 30 2015, 12:02 PM · Directory loader, Tarball loader

Oct 29 2015

ardumont added a comment to T155: Deploy and load tarballs from worker01.

messages sent:

  • old-gnu
  • gnu sent
Oct 29 2015, 3:48 PM · Directory loader, Tarball loader
ardumont closed T156: Package latest swh-storage as Resolved.
Oct 29 2015, 2:10 PM · Tarball loader, Directory loader
ardumont closed T156: Package latest swh-storage, a subtask of T155: Deploy and load tarballs from worker01, as Resolved.
Oct 29 2015, 2:10 PM · Directory loader, Tarball loader
ardumont closed T157: Package latest swh-loader-dir as Resolved.
Oct 29 2015, 10:51 AM · Directory loader, Tarball loader
ardumont closed T157: Package latest swh-loader-dir, a subtask of T155: Deploy and load tarballs from worker01, as Resolved.
Oct 29 2015, 10:51 AM · Directory loader, Tarball loader
ardumont closed T158: Package latest swh-loader-tar, a subtask of T155: Deploy and load tarballs from worker01, as Resolved.
Oct 29 2015, 10:46 AM · Directory loader, Tarball loader
ardumont closed T158: Package latest swh-loader-tar as Resolved.
Oct 29 2015, 10:46 AM · Tarball loader, Directory loader
zack renamed Tarball loader from Tarball Loader to Tarball loader.
Oct 29 2015, 9:59 AM

Oct 28 2015

ardumont removed a subtask for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T62: DB schema: add directory→tarball provenance information.
Oct 28 2015, 4:58 PM · Tarball loader, Directory loader
ardumont created T158: Package latest swh-loader-tar.
Oct 28 2015, 12:07 PM · Tarball loader, Directory loader
ardumont added a parent task for T157: Package latest swh-loader-dir: T155: Deploy and load tarballs from worker01.
Oct 28 2015, 12:07 PM · Directory loader, Tarball loader
ardumont added a subtask for T155: Deploy and load tarballs from worker01: T157: Package latest swh-loader-dir.
Oct 28 2015, 12:07 PM · Directory loader, Tarball loader
ardumont removed a parent task for T157: Package latest swh-loader-dir: T156: Package latest swh-storage.
Oct 28 2015, 12:07 PM · Directory loader, Tarball loader
ardumont removed a subtask for T156: Package latest swh-storage: T157: Package latest swh-loader-dir.
Oct 28 2015, 12:07 PM · Tarball loader, Directory loader
ardumont created T157: Package latest swh-loader-dir.
Oct 28 2015, 12:06 PM · Directory loader, Tarball loader
ardumont created T156: Package latest swh-storage.
Oct 28 2015, 12:06 PM · Tarball loader, Directory loader
ardumont created T155: Deploy and load tarballs from worker01.
Oct 28 2015, 12:06 PM · Directory loader, Tarball loader
ardumont closed T142: reload missing tarballs, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Invalid.
Oct 28 2015, 12:05 PM · Tarball loader, Directory loader
ardumont closed T142: reload missing tarballs as Invalid.
Oct 28 2015, 12:05 PM · Directory loader, Tarball loader
ardumont closed T154: Send tarball checksums along the revision, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 28 2015, 12:04 PM · Tarball loader, Directory loader
ardumont closed T154: Send tarball checksums along the revision as Resolved.
Oct 28 2015, 12:04 PM · Directory loader, Tarball loader
ardumont created T154: Send tarball checksums along the revision.
Oct 28 2015, 11:30 AM · Directory loader, Tarball loader
ardumont closed T22: DB schema: add metadata field to revision table, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 28 2015, 11:29 AM · Tarball loader, Directory loader

Oct 27 2015

ardumont added a parent task for T148: Populate fetch_history: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 27 2015, 4:03 PM · Tarball loader
ardumont added subtasks for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T149: Populate fetch_history table, T148: Populate fetch_history, T22: DB schema: add metadata field to revision table.
Oct 27 2015, 4:03 PM · Tarball loader, Directory loader
ardumont closed T148: Populate fetch_history as Resolved by committing rDLDTARa370bb45254a: Refactor - Create an actual tarloader.
Oct 27 2015, 2:47 PM · Tarball loader
ardumont removed a subtask for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:38 AM · Tarball loader
ardumont added a subtask for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:11 AM · Tarball loader
ardumont removed a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:11 AM · Tarball loader
ardumont added a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:11 AM · Tarball loader
ardumont removed a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:10 AM · Tarball loader
ardumont added a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:08 AM · Tarball loader
ardumont renamed T148: Populate fetch_history from Use fetch_history table to Populate fetch_history.
Oct 27 2015, 10:06 AM · Tarball loader
ardumont renamed T148: Populate fetch_history from swh-loader-tar - Use fetch history to Use fetch_history table.
Oct 27 2015, 10:05 AM · Tarball loader

Oct 26 2015

ardumont closed T147: Migrate code to use latest schema improvments from T3 as Invalid.
Oct 26 2015, 4:59 PM · Directory loader, Tarball loader
ardumont closed T147: Migrate code to use latest schema improvments from T3, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Invalid.
Oct 26 2015, 4:59 PM · Tarball loader, Directory loader
ardumont created T147: Migrate code to use latest schema improvments from T3.
Oct 26 2015, 4:56 PM · Directory loader, Tarball loader
ardumont added a subtask for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T62: DB schema: add directory→tarball provenance information.
Oct 26 2015, 3:25 PM · Tarball loader, Directory loader