Page MenuHomeSoftware Heritage

Directory loaderFolder
ActivePublic

Members

  • This project does not have any members.

Watchers

  • This project does not have any watchers.

Details

Recent Activity

Jul 25 2018

zack added a comment to T960: draft specs for deposit with incomplete tarball .

Regarding implementation, no plans of implementing it are on the horizon, it is something to consider for the priority/yearly planning.
I can also open a review documentation subtask.

Jul 25 2018, 10:29 AM · SWORD deposit, Directory loader

Jul 24 2018

moranegg added a comment to T960: draft specs for deposit with incomplete tarball .

It is not yet deployed on the docs web pages, but I'll put a link here when it is.
Also I'm planing some modifications on the swh xml schema for the swh-id properties (mentioned in T1152).

Jul 24 2018, 10:52 AM · SWORD deposit, Directory loader

Jul 23 2018

zack added a comment to T960: draft specs for deposit with incomplete tarball .

I'll be AFK for a while, so I can't check the diff, but if you (@moranegg ) can point me to the current version (on docs.s.o?, if it's deployed), I'll be happy to have a look before it's implemented

Jul 23 2018, 9:01 PM · SWORD deposit, Directory loader
moranegg closed T960: draft specs for deposit with incomplete tarball as Resolved.
Jul 23 2018, 4:36 PM · SWORD deposit, Directory loader
moranegg closed T960: draft specs for deposit with incomplete tarball , a subtask of T855: support directory entries pointing to revisions when loading directories, as Resolved.
Jul 23 2018, 4:36 PM · Directory loader

Jul 18 2018

moranegg moved T960: draft specs for deposit with incomplete tarball from In progress to done (almost) on the SWORD deposit board.
Jul 18 2018, 2:50 PM · SWORD deposit, Directory loader

Jun 18 2018

moranegg added a comment to T960: draft specs for deposit with incomplete tarball .


Board discussion with zack and ardumont

Jun 18 2018, 1:53 PM · SWORD deposit, Directory loader

Apr 23 2018

moranegg added a comment to T960: draft specs for deposit with incomplete tarball .

Goal: deposit a tarball for which part or all the content is already in the SWH archive
the paths to the missing directories/content must be provided as empty paths in the tarball
the list linking each path to the object in the archive will be provided with the metadata

Apr 23 2018, 5:00 PM · SWORD deposit, Directory loader

Apr 11 2018

rdicosmo added a parent task for T960: draft specs for deposit with incomplete tarball : T1021: SWORD deposit of metadata about an existing SWH object.
Apr 11 2018, 7:01 PM · SWORD deposit, Directory loader

Feb 13 2018

moranegg moved T960: draft specs for deposit with incomplete tarball from Backlog to In progress on the SWORD deposit board.
Feb 13 2018, 4:53 PM · SWORD deposit, Directory loader
moranegg created T960: draft specs for deposit with incomplete tarball .
Feb 13 2018, 4:53 PM · SWORD deposit, Directory loader

Nov 15 2017

zack created T855: support directory entries pointing to revisions when loading directories.
Nov 15 2017, 9:53 PM · Directory loader

Oct 6 2017

zack closed T89: refactor common behavior between git loader and dir loader as Resolved.

(since quite a while, thanks to swh.loader.core)

Oct 6 2017, 2:59 PM · Git loader, Directory loader

Feb 23 2017

ardumont closed T255: Don't let swh.loader.dir block on special files (block devices, fifos) as Resolved by committing rDMODc40ab0368de4: Consider special files as empty ones when computing content hashes.
Feb 23 2017, 3:49 PM · Data Model, Restricted Project, Directory loader
ardumont added a project to T255: Don't let swh.loader.dir block on special files (block devices, fifos): Data Model.
Feb 23 2017, 2:43 PM · Data Model, Restricted Project, Directory loader

Feb 12 2017

zack moved T255: Don't let swh.loader.dir block on special files (block devices, fifos) from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Feb 12 2017, 6:40 PM · Data Model, Restricted Project, Directory loader
zack added a project to T255: Don't let swh.loader.dir block on special files (block devices, fifos): Restricted Project.
Feb 12 2017, 6:34 PM · Data Model, Restricted Project, Directory loader
zack added a project to T182: investigate gnu.org tarball ingestion failures: Origin-GNU.
Feb 12 2017, 6:16 PM · Origin-GNU, Directory loader, Tarball loader
zack renamed T182: investigate gnu.org tarball ingestion failures from Investigate the failure in tarball ingestion to investigate gnu.org tarball ingestion failures.
Feb 12 2017, 6:16 PM · Origin-GNU, Directory loader, Tarball loader

Feb 9 2017

ardumont added a comment to T182: investigate gnu.org tarball ingestion failures.

Related T175

Feb 9 2017, 5:15 PM · Origin-GNU, Directory loader, Tarball loader
ardumont renamed T182: investigate gnu.org tarball ingestion failures from logging replay error limitation investigation to Investigate the failure in tarball ingestion.
Feb 9 2017, 5:11 PM · Origin-GNU, Directory loader, Tarball loader
ardumont added a comment to T182: investigate gnu.org tarball ingestion failures.

I've no idea what this task means.

Feb 9 2017, 5:10 PM · Origin-GNU, Directory loader, Tarball loader
zack added a comment to T182: investigate gnu.org tarball ingestion failures.

I've no idea what this task means. @ardumont: can you clarify or close it if not relevant anymore?

Feb 9 2017, 12:58 PM · Origin-GNU, Directory loader, Tarball loader

Aug 29 2016

ardumont closed T539: Update loaders to register origin_visit's state as Resolved.
Aug 29 2016, 3:31 PM · Directory loader, Tarball loader, Git loader, SVN Loader
ardumont added a comment to T539: Update loaders to register origin_visit's state.

This tasks takes care of:

  • loader-core
  • loader-dir (depends on loader-core)
  • loader-tar (depends on loader-dir and loader-core)
  • loader-git
  • loader-svn
Aug 29 2016, 3:31 PM · Directory loader, Tarball loader, Git loader, SVN Loader

Aug 23 2016

ardumont updated the task description for T539: Update loaders to register origin_visit's state.
Aug 23 2016, 11:46 AM · Directory loader, Tarball loader, Git loader, SVN Loader

May 13 2016

olasd changed the visibility for Directory loader.
May 13 2016, 5:23 PM
olasd changed the visibility for T323: Check loader-dir's storage compatibility.
May 13 2016, 5:09 PM · Directory loader
olasd changed the visibility for T271: Update clients on impacts + upgrade respective package dependencies.
May 13 2016, 5:08 PM · Git loader, Directory loader, Data Model, Web app
olasd changed the visibility for T255: Don't let swh.loader.dir block on special files (block devices, fifos).
May 13 2016, 5:08 PM · Data Model, Restricted Project, Directory loader
olasd changed the visibility for T182: investigate gnu.org tarball ingestion failures.
May 13 2016, 5:07 PM · Origin-GNU, Directory loader, Tarball loader
olasd changed the visibility for T183: gnu/old-gnu injection to production.
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T178: Replay loading mirror gnu and old-gnu from scratch.
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T177: Investigate `Not implemented 'compression type 6 implode'`.
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T176: Fix `Permission denied: write to /usr/local/lib/gcl-3...` .
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T174: Analyse and fix last errors.
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T175: Redeploy and trigger sublist of tarballs impacted by errors.
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T171: Fix content loading only when needed.
May 13 2016, 5:07 PM · Directory loader
olasd changed the visibility for T170: Random order in tarball messages computation.
May 13 2016, 5:07 PM · Directory loader, Tarball loader
olasd changed the visibility for T158: Package latest swh-loader-tar.
May 13 2016, 5:06 PM · Tarball loader, Directory loader
olasd changed the visibility for T157: Package latest swh-loader-dir.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T156: Package latest swh-storage.
May 13 2016, 5:06 PM · Tarball loader, Directory loader
olasd changed the visibility for T155: Deploy and load tarballs from worker01.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T154: Send tarball checksums along the revision.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T149: Populate fetch_history table.
May 13 2016, 5:06 PM · Directory loader
olasd changed the visibility for T143: understand why errors does not appear in log db.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T147: Migrate code to use latest schema improvments from T3.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T142: reload missing tarballs.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T141: compute missing tarballs list for reloading the ones missing.
May 13 2016, 5:06 PM · Directory loader, Tarball loader
olasd changed the visibility for T140: analysis errors on first loading batch.
May 13 2016, 5:06 PM · Directory loader, Tarball loader