Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 23 2021

ardumont triaged T3285: Dynamize webapp save code now status listing page update as Normal priority.
Apr 23 2021, 1:43 PM · Easy hack, Save Code Now
ardumont added a revision to T3280: Separate save code now request updates from the save code now ui: D5583: Separate save code now status refresh routine from the listing ui.
Apr 23 2021, 10:28 AM · Monitoring, Save Code Now

Apr 22 2021

ardumont updated the task description for T3280: Separate save code now request updates from the save code now ui.
Apr 22 2021, 5:10 PM · Monitoring, Save Code Now
ardumont claimed T3280: Separate save code now request updates from the save code now ui.
Apr 22 2021, 5:07 PM · Monitoring, Save Code Now
ardumont moved T3266: Improve save code now failed/uneventful status reporting from Pending validation to Done on the Roadmap 2021 board.
Apr 22 2021, 4:21 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont closed T3266: Improve save code now failed/uneventful status reporting, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Apr 22 2021, 4:21 PM · Save Code Now, meta-task, Roadmap 2021, Web app
ardumont closed T3266: Improve save code now failed/uneventful status reporting as Resolved.

Deployed.

Apr 22 2021, 4:20 PM · Save Code Now, Roadmap 2021, System administrators, Web app
anlambert added a revision to T3266: Improve save code now failed/uneventful status reporting: D5575: tests/api/origin_save: Explicitely populate SaveAuthorizedOrigin table.
Apr 22 2021, 3:32 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

Trying to bisect the issue and failed (multiple dimensions got the best of me, master ok, debian build in stable ko... i need to improve my tooling there).

Apr 22 2021, 12:37 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

So, the debian/unstable broke which is fixed now [1] (it wasd missing one new deps to
test the migration part).

Apr 22 2021, 10:19 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont moved T3266: Improve save code now failed/uneventful status reporting from Backlog to Pending validation on the Roadmap 2021 board.
Apr 22 2021, 9:20 AM · Save Code Now, Roadmap 2021, System administrators, Web app

Apr 21 2021

ardumont changed the status of T3266: Improve save code now failed/uneventful status reporting, a subtask of T3082: Improve Save Code Now handling, from Open to Work in Progress.
Apr 21 2021, 7:08 PM · Save Code Now, meta-task, Roadmap 2021, Web app
ardumont changed the status of T3266: Improve save code now failed/uneventful status reporting from Open to Work in Progress.
Apr 21 2021, 7:08 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

Landed. Remains to deploy. I'll attend to that tomorrow.

Apr 21 2021, 7:08 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont moved T3278: Check older pending save code now requests apparently stuck and reschedule those from deployed/landed/monitoring to done on the System administration board.
Apr 21 2021, 6:57 PM · System administration, Save Code Now
ardumont closed T2117: Save Code Now: End to End monitoring, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Apr 21 2021, 6:57 PM · Save Code Now, meta-task, Roadmap 2021, Web app
ardumont updated the task description for T3266: Improve save code now failed/uneventful status reporting.
Apr 21 2021, 6:42 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5570: Display visit status information in the save request information.
Apr 21 2021, 3:27 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5569: Populate the visit status value in save code now request.
Apr 21 2021, 2:02 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont closed T3278: Check older pending save code now requests apparently stuck and reschedule those as Resolved.
Apr 21 2021, 11:40 AM · System administration, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

Pushed and tag swh.web.client v0.3.0 with the new endpoint ^
(ideally we could want at least 2 other endpoints, one to check the status
on one save code now request, another to possibly list in a paginated way
the status of the save code now, a-la ui to be symmetric with that new
endpoint, tasks to open ;)

Apr 21 2021, 11:40 AM · System administration, Save Code Now
ardumont claimed T3266: Improve save code now failed/uneventful status reporting.
Apr 21 2021, 10:17 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3263: Save code now report error for svn type.

Nevertheless, that error should have been detected on the first loading so some adaptation is needed in the svn loader.

Apr 21 2021, 10:08 AM · Save Code Now, Monitoring, SVN Loader
ardumont added a comment to T3263: Save code now report error for svn type.

In any case, independently from this, for the monitoring, I was set on modifying the
actual svn origin used to something else not hosted on github.

Apr 21 2021, 10:08 AM · Save Code Now, Monitoring, SVN Loader
ardumont closed D5568: Update save code now monitoring checks.
Apr 21 2021, 9:37 AM · Save Code Now
ardumont updated the summary of D5568: Update save code now monitoring checks.
Apr 21 2021, 9:34 AM · Save Code Now
vsellier accepted D5568: Update save code now monitoring checks.

lgtm

Apr 21 2021, 9:34 AM · Save Code Now
ardumont retitled D5568: Update save code now monitoring checks from Remove tenma's access to Update save code now monitoring checks.
Apr 21 2021, 9:31 AM · Save Code Now
ardumont added a revision to T3263: Save code now report error for svn type: D5568: Update save code now monitoring checks.
Apr 21 2021, 9:28 AM · Save Code Now, Monitoring, SVN Loader

Apr 20 2021

rdicosmo added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

Thanks, this is quite useful indeed.

Apr 20 2021, 7:28 PM · System administration, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

So the cli opened in D5559 has now been rewritten slightly (the diff is now fully tested though). See the diff for details.

Apr 20 2021, 6:36 PM · System administration, Save Code Now
ardumont set the color for Save Code Now to Violet.
Apr 20 2021, 4:42 PM
ardumont added a project to T3082: Improve Save Code Now handling: Save Code Now.
Apr 20 2021, 4:42 PM · Save Code Now, meta-task, Roadmap 2021, Web app
ardumont added a project to T1481: add metric to monitor "save code now" efficiency: Save Code Now.
Apr 20 2021, 4:42 PM · Save Code Now, System administration, Metrics/monitoring
ardumont moved T3278: Check older pending save code now requests apparently stuck and reschedule those from in-progress to deployed/landed/monitoring on the System administration board.
Apr 20 2021, 3:59 PM · System administration, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

Browsing though the save code now ui with increment of 100 per page.

Apr 20 2021, 3:11 PM · System administration, Save Code Now
ardumont renamed T3280: Separate save code now request updates from the save code now ui from Uncorellate save code now request updates from the save code now ui to Separate save code now request updates from the save code now ui.
Apr 20 2021, 3:10 PM · Monitoring, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

Rescheduled the ones not yet scheduled.
As expected, some worked, some failed but tl; dr the status are updated...
No more not yet scheduled... But...

Apr 20 2021, 2:57 PM · System administration, Save Code Now
ardumont triaged T3280: Separate save code now request updates from the save code now ui as Normal priority.
Apr 20 2021, 2:54 PM · Monitoring, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

ok so the 'not created' ones are apparently failing origins so the issue is about the report
of the state which is somehow wong. [1] There is a task for that (or something near
enough) [2]

Apr 20 2021, 1:04 PM · System administration, Save Code Now
ardumont changed the status of T3278: Check older pending save code now requests apparently stuck and reschedule those from Open to Work in Progress.
Apr 20 2021, 11:42 AM · System administration, Save Code Now
ardumont added a project to T3278: Check older pending save code now requests apparently stuck and reschedule those: System administration.
Apr 20 2021, 11:41 AM · System administration, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

Most probably yes.

Apr 20 2021, 11:41 AM · System administration, Save Code Now
rdicosmo added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

Thanks for looking into this. If I look at https://grafana.softwareheritage.org/d/WXRVVc_Mz/save-code-now?viewPanel=4&orgId=1&from=1617954242247&to=1617975842247&var-environment=production&var-instance=moma.internal.softwareheritage.org&var-status=All&var-load_task_status=All&var-visit_type=All it seems there are also some 255 requests "not yet scheduled". Maybe it's the same issue?

Apr 20 2021, 11:00 AM · System administration, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

With [1], the following has been rescheduled [2]

Apr 20 2021, 10:58 AM · System administration, Save Code Now
ardumont added a revision to T3278: Check older pending save code now requests apparently stuck and reschedule those: D5559: Add new `swh save submit-request` cli to batch save code now requests.
Apr 20 2021, 10:58 AM · System administration, Save Code Now
ardumont added a comment to T3278: Check older pending save code now requests apparently stuck and reschedule those.

We could reschedule the origins through:
psql ... | xargs swh scheduler task respawn {} \;

Apr 20 2021, 9:44 AM · System administration, Save Code Now
ardumont edited P1008 Pending running save code now requests.
Apr 20 2021, 9:14 AM · Save Code Now
ardumont updated the task description for T3278: Check older pending save code now requests apparently stuck and reschedule those.
Apr 20 2021, 9:13 AM · System administration, Save Code Now
ardumont created P1008 Pending running save code now requests.
Apr 20 2021, 9:11 AM · Save Code Now

Apr 19 2021

ardumont renamed T3278: Check older pending save code now requests apparently stuck and reschedule those from Make a pass at potential save code now pending and apparently stuck save code now queries to Check older pending save code now requests apparently stuck and reschedule those.
Apr 19 2021, 7:07 PM · System administration, Save Code Now
ardumont updated subscribers of T3278: Check older pending save code now requests apparently stuck and reschedule those.
Apr 19 2021, 6:44 PM · System administration, Save Code Now
ardumont triaged T3278: Check older pending save code now requests apparently stuck and reschedule those as Normal priority.
Apr 19 2021, 6:43 PM · System administration, Save Code Now
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5555: Add visit_status to SaveOriginRequest model.
Apr 19 2021, 6:27 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

It'd be best if we distinguish directly from the listing view such details.

Apr 19 2021, 6:19 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont updated the task description for T3266: Improve save code now failed/uneventful status reporting.
Apr 19 2021, 6:17 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5554: origin_save: Add docstring and some test scenarios.
Apr 19 2021, 6:00 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3263: Save code now report error for svn type.

Thanks for the heads up ;)

Apr 19 2021, 12:32 PM · Save Code Now, Monitoring, SVN Loader
anlambert added a comment to T3263: Save code now report error for svn type.

The error is related to that github origin erroneously submitted with a svn visit type.

Apr 19 2021, 12:12 PM · Save Code Now, Monitoring, SVN Loader
ardumont updated the task description for T3266: Improve save code now failed/uneventful status reporting.
Apr 19 2021, 9:56 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont renamed T3266: Improve save code now failed/uneventful status reporting from Cannot distinguish failed visits from uneventful one to Improve save code now failed/uneventful status reporting.
Apr 19 2021, 9:53 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont triaged T3266: Improve save code now failed/uneventful status reporting as Normal priority.
Apr 19 2021, 9:42 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a project to T3263: Save code now report error for svn type: Save Code Now.
Apr 19 2021, 9:37 AM · Save Code Now, Monitoring, SVN Loader
ardumont edited Description on Save Code Now.
Apr 19 2021, 9:36 AM
ardumont created Save Code Now.
Apr 19 2021, 9:35 AM