Page MenuHomeSoftware Heritage

Unstuck failing loaders in staging
Closed, ResolvedPublic

Description

Loaders (mostly package ones) currently fail to load [1]

[1] https://sentry.softwareheritage.org/share/issue/4eb69ea2cc314c4ab811809ff60c358f/

Event Timeline

ardumont triaged this task as Normal priority.May 28 2020, 4:35 PM
ardumont created this task.
ardumont updated the task description. (Show Details)May 28 2020, 5:12 PM

In the end, it's not necessarily data [1] which is obsolete. It's more having
partial production dump mounted on staging. We have dangling data.

For example, recently a dumps with origin/origin-visits was mounted. This means
we reference snapshot which do not exist right now.

That's making the npm/pypi/etc... loaders blow up. I'm fixing that in the
loader for now. It's a technical path which could happen in production anyway
(because the storage api used in the loader allows it)...

[1] I was referring to scheduling data

ardumont updated the task description. (Show Details)May 29 2020, 12:23 PM
ardumont renamed this task from refresh staging loading data in scheduler to Unstuck failing loaders in staging.May 29 2020, 12:27 PM
ardumont updated the task description. (Show Details)
ardumont changed the task status from Open to Work in Progress.May 29 2020, 12:40 PM
ardumont closed this task as Resolved.May 29 2020, 5:38 PM