Page MenuHomeSoftware Heritage

SWORD deposit (2018-09-25-HAL-opening)Milestone
ArchivedPublic

Watchers

  • This project does not have any watchers.
  • View All

Recent Activity

Jan 8 2023

gitlab-migration closed T1171: Modify deposit workflow to check duplicated POST requests as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:21 PM · SWORD deposit (2018-09-25-HAL-opening)
gitlab-migration changed the status of T1154: Fix metadata reading when a deposit is a multiple metadata requests instance from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · SWORD deposit (2018-09-25-HAL-opening)
gitlab-migration changed the status of T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · SWORD deposit (2018-09-25-HAL-opening)
gitlab-migration changed the status of T1153: deposit: Keep raw metadata received from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · SWORD deposit (2018-09-25-HAL-opening)
gitlab-migration changed the status of T912: integration with HAL for SWORD-based deposit (meta task) from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · SWORD deposit (2018-09-25-HAL-opening)
gitlab-migration changed the status of T820: HAL-SWH - connectivity tests, a subtask of T912: integration with HAL for SWORD-based deposit (meta task), from Resolved to Migrated.
Jan 8 2023, 4:23 PM · SWORD deposit (2018-09-25-HAL-opening)

Jul 3 2019

ardumont placed T1009: Create email notifications for deposit errors up for grabs.
Jul 3 2019, 3:26 PM · Metrics/monitoring, SWORD deposit

Apr 15 2019

moranegg archived SWORD deposit (2018-09-25-HAL-opening).
Apr 15 2019, 3:05 PM
ardumont closed T912: integration with HAL for SWORD-based deposit (meta task) as Resolved.
Apr 15 2019, 2:36 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg added a comment to T912: integration with HAL for SWORD-based deposit (meta task).

I think we can close this one :-)

Apr 15 2019, 2:10 PM · SWORD deposit (2018-09-25-HAL-opening)

Feb 20 2019

ardumont updated the summary of D1160: swh-deposit: Adapt swh.deposit.wsgi starting point.
Feb 20 2019, 2:38 PM · SWORD deposit, Development environment
ardumont added projects to D1160: swh-deposit: Adapt swh.deposit.wsgi starting point: Development environment, SWORD deposit (2018-09-25-HAL-opening).
Feb 20 2019, 2:10 PM · SWORD deposit, Development environment

Sep 3 2018

moranegg added a comment to T1171: Modify deposit workflow to check duplicated POST requests .

A possible problem to check with this workflow:

hal-prod and hal-preprod uses the same identifiers for different objects
Sep 3 2018, 4:44 PM · SWORD deposit (2018-09-25-HAL-opening)

Aug 29 2018

ardumont added a comment to T1171: Modify deposit workflow to check duplicated POST requests .

After the session with Bruno this week, we saw that multiple request of the same deposit that are waiting for the workers create a corner case where each is treated as a different deposit and each is loaded into the archive separately. For example this deposit -https://archive.softwareheritage.org/browse/origin/https://hal.archives-ouvertes.fr/hal-01862659/visits/ with 9 visits but not related through the parent history.

Aug 29 2018, 4:21 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg updated the task description for T1009: Create email notifications for deposit errors.
Aug 29 2018, 4:21 PM · Metrics/monitoring, SWORD deposit
moranegg triaged T1171: Modify deposit workflow to check duplicated POST requests as Normal priority.
Aug 29 2018, 4:08 PM · SWORD deposit (2018-09-25-HAL-opening)

Jul 24 2018

ardumont closed T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information as Resolved.
Jul 24 2018, 2:24 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont moved T1154: Fix metadata reading when a deposit is a multiple metadata requests instance from Pending review to Done (needs rechecking) on the SWORD deposit (2018-09-25-HAL-opening) board.
Jul 24 2018, 2:24 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont moved T1154: Fix metadata reading when a deposit is a multiple metadata requests instance from Backlog to Pending review on the SWORD deposit (2018-09-25-HAL-opening) board.
Jul 24 2018, 2:24 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont closed T1154: Fix metadata reading when a deposit is a multiple metadata requests instance as Resolved by committing rDDEP19ca52e605ab: deposit.utils: Fix the potential metadata information loss.
Jul 24 2018, 2:14 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont added a revision to T1154: Fix metadata reading when a deposit is a multiple metadata requests instance: D400: Fix metadata reading when a deposit is a multiple metadata requests instance.
Jul 24 2018, 12:25 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont updated the task description for T1154: Fix metadata reading when a deposit is a multiple metadata requests instance.
Jul 24 2018, 12:18 PM · SWORD deposit (2018-09-25-HAL-opening)

Jul 23 2018

ardumont moved T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information from Pending review to Done (needs rechecking) on the SWORD deposit (2018-09-25-HAL-opening) board.
Jul 23 2018, 4:03 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont moved T1153: deposit: Keep raw metadata received from Pending review to Done (needs rechecking) on the SWORD deposit (2018-09-25-HAL-opening) board.
Jul 23 2018, 4:02 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont closed T1153: deposit: Keep raw metadata received as Resolved by committing rDDEP17f471149eb8: swh.deposit.models: Keep deposit request's raw metadata.
Jul 23 2018, 11:31 AM · SWORD deposit (2018-09-25-HAL-opening)

Jul 20 2018

ardumont moved T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information from Backlog to Pending review on the SWORD deposit (2018-09-25-HAL-opening) board.
Jul 20 2018, 5:11 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont moved T1153: deposit: Keep raw metadata received from Backlog to Pending review on the SWORD deposit (2018-09-25-HAL-opening) board.
Jul 20 2018, 5:10 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont updated the task description for T1154: Fix metadata reading when a deposit is a multiple metadata requests instance.
Jul 20 2018, 1:20 PM · SWORD deposit (2018-09-25-HAL-opening)

Jul 19 2018

rdicosmo added a comment to T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information.

We want to return in the SWORD response all the information (including context), but structured, so the receiver does not need to do parsing:

Jul 19 2018, 4:42 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont added a revision to T1153: deposit: Keep raw metadata received: D394: swh.deposit.models: Keep deposit request's raw metadata.
Jul 19 2018, 3:12 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg added a comment to T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information.

Just to be clear about this:

  1. the property swh-id returned to the client is the directory, with or without context?
  2. How should we call the new property added for the revision ID ?
  3. And will it be a revision ID with or without context?
Jul 19 2018, 2:40 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont edited projects for T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information, added: SWORD deposit (2018-09-25-HAL-opening); removed SWORD deposit.
Jul 19 2018, 2:35 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont claimed T1153: deposit: Keep raw metadata received.
Jul 19 2018, 2:32 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont triaged T1154: Fix metadata reading when a deposit is a multiple metadata requests instance as Normal priority.
Jul 19 2018, 2:32 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont added a comment to T1153: deposit: Keep raw metadata received.

Similarly to what we do for the loaders (e.g., with the Git pack files), we should just keep everything (metadata + tarball) received from a deposit in raw format somewhere, to allow further re-processing. So I think this issue should not only be about keeping raw metadata, but rather the entire (raw) deposit.

Jul 19 2018, 2:03 PM · SWORD deposit (2018-09-25-HAL-opening)
zack added a comment to T1153: deposit: Keep raw metadata received.

Good idea!

Jul 19 2018, 1:25 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont triaged T1153: deposit: Keep raw metadata received as Normal priority.
Jul 19 2018, 12:04 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont created T1153: deposit: Keep raw metadata received.
Jul 19 2018, 12:04 PM · SWORD deposit (2018-09-25-HAL-opening)
ardumont added a comment to T1009: Create email notifications for deposit errors.

Like i said orally, this task makes me edgy:

Jul 19 2018, 10:55 AM · Metrics/monitoring, SWORD deposit

Jul 18 2018

moranegg added a comment to T912: integration with HAL for SWORD-based deposit (meta task).

I'm adding this meta-task to the grand HAL-opening thinking it can (and should) be resolved after accomplishing this milestone.

Jul 18 2018, 3:09 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg edited projects for T912: integration with HAL for SWORD-based deposit (meta task), added: SWORD deposit (2018-09-25-HAL-opening); removed SWORD deposit.
Jul 18 2018, 2:52 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg edited projects for T1009: Create email notifications for deposit errors, added: SWORD deposit (2018-09-25-HAL-opening); removed SWORD deposit.
Jul 18 2018, 2:52 PM · Metrics/monitoring, SWORD deposit
moranegg created SWORD deposit (2018-09-25-HAL-opening).
Jul 18 2018, 12:37 PM