Page MenuHomeSoftware Heritage

Add function to get task execution info for a 'Save code now' request

Authored by anlambert on Sep 2 2019, 5:54 PM.



Last week, @rdicosmo asked me if we could get more details regarding the execution
of a loading task associated to a 'Save code now' request.

As the 'Save code now' feature starts to get more and more advertised in the
scientific community, we need to ensure it is reliable (especially for the
saving of git origins). So, we should be able to quickly get relevant task
execution details in order to analyze issues for those who failed.

So, in order to provide some feedback to users regarding the loading task execution
associated to a save code now request, add a dedicated function in related module.

This function will notably try to extract relevant task execution info (log message,
worker name, ...) by querying the elasticsearch cluster of Software Heritage.

Related T1976

Diff Detail

rDWAPPS Web applications
Automatic diff as part of commit; lint not applicable.
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

anlambert created this revision.Sep 2 2019, 5:54 PM
ardumont added inline comments.

its associated...


is archived and removed from..., returns an empty dictionary.


loading task type?

(Same sentence rephrasing below?)


Logging a warning exception should exist here, should'nt it?
At least to have some grasp on possible elasticsearch communication issues.

anlambert added inline comments.Sep 3 2019, 5:19 PM

Ack, shorter indeed


Ack, will log a warning here

anlambert updated this revision to Diff 6538.Sep 3 2019, 5:25 PM

Update: Rebase and address @ardumont comments

ardumont accepted this revision.Sep 3 2019, 5:31 PM

Looks good ;)

This revision is now accepted and ready to land.Sep 3 2019, 5:31 PM
This revision was automatically updated to reflect the committed changes.