Page MenuHomeSoftware Heritage
Create Task
Maniphest T533

Allow loaders to register partial state (meta task)
Closed, MigratedEdits Locked
Actions

Description

Loaders performing long-running tasks should be able to record a partial state when they encounter a transient failure (for instance, for SVN loaders, a connection reset or the temporary unavailability of the target server).

This tasks records the refactorings needed to allow this.

Related swh-devel conversation : https://sympa.inria.fr/sympa/arc/swh-devel/2016-06/msg00010.html

Related Objects
Search...

Event Timeline

olasd created this task.Aug 18 2016, 1:46 PM
olasd updated the task description. (Show Details)
ardumont created subtask T534: Add completion information to softwareheritage.origin_visit table.Aug 18 2016, 1:54 PM
olasd created subtask T535: Register partial task state in scheduler database.Aug 18 2016, 2:05 PM
olasd created subtask T536: Enrich task return status to register partial completions.Aug 18 2016, 2:09 PM
olasd created subtask T537: Update the task scheduler and the task event listener to use the new partial status.Aug 18 2016, 2:18 PM
ardumont created subtask T538: Add origin_visit API entry points to permit creation/update.Aug 18 2016, 2:24 PM
ardumont removed a subtask: T538: Add origin_visit API entry points to permit creation/update.Aug 18 2016, 2:29 PM
ardumont created subtask T539: Update loaders to register origin_visit's state.Aug 18 2016, 2:34 PM
ardumont removed a subtask: T539: Update loaders to register origin_visit's state.
ardumont added a subtask: T466: Test - Ingest XXL svn repository.Aug 18 2016, 2:38 PM
ardumont closed subtask T534: Add completion information to softwareheritage.origin_visit table as Resolved.Aug 22 2016, 3:52 PM
jbertran mentioned this in T541: Make the origin visit '/api/1/stat/visits/<int:origin_id>/' consistent with other api endpoints.Aug 22 2016, 3:55 PM
jbertran added a subtask: T541: Make the origin visit '/api/1/stat/visits/<int:origin_id>/' consistent with other api endpoints.
ardumont closed subtask T541: Make the origin visit '/api/1/stat/visits/<int:origin_id>/' consistent with other api endpoints as Resolved.Sep 2 2016, 3:24 PM
zack removed a subtask: T466: Test - Ingest XXL svn repository.Feb 10 2017, 8:40 AM
zack added a project: General.Feb 10 2017, 8:44 AM
olasd closed subtask T536: Enrich task return status to register partial completions as Resolved.Jun 12 2017, 3:32 PM
olasd closed subtask T537: Update the task scheduler and the task event listener to use the new partial status as Resolved.Mar 7 2018, 4:43 PM
olasd closed subtask T535: Register partial task state in scheduler database as Resolved.Jan 23 2020, 1:57 PM
olasd closed this task as Resolved.Jan 23 2020, 2:12 PM

This is done in all loaders by now.

gitlab-migration changed the status of subtask T534: Add completion information to softwareheritage.origin_visit table from Resolved to Migrated.Jan 8 2023, 4:19 PM
gitlab-migration changed the status of subtask T535: Register partial task state in scheduler database from Resolved to Migrated.
gitlab-migration changed the status of subtask T536: Enrich task return status to register partial completions from Resolved to Migrated.
gitlab-migration changed the status of subtask T537: Update the task scheduler and the task event listener to use the new partial status from Resolved to Migrated.
gitlab-migration changed the status of subtask T541: Make the origin visit '/api/1/stat/visits/<int:origin_id>/' consistent with other api endpoints from Resolved to Migrated.
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 9:56 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal