Page MenuHomeSoftware Heritage

Scheduling utilitiesFolder
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Recent Activity

Fri, Oct 15

ardumont added a comment to T3632: Investigate the ContentDisallowed exception.

No difference.

Fri, Oct 15, 11:52 AM · Scheduling utilities

Mon, Oct 11

douardda added a comment to T3632: Investigate the ContentDisallowed exception.

What's the difference in deployed dependencies versions (staging vs. prod)?

Mon, Oct 11, 12:15 PM · Scheduling utilities

Fri, Oct 8

ardumont added a comment to T3632: Investigate the ContentDisallowed exception.

It still appears in sentry.
Although it seems specific to staging (which is a hint of a divergence of some sort).

Fri, Oct 8, 4:20 PM · Scheduling utilities
ardumont added a project to T3632: Investigate the ContentDisallowed exception: Scheduling utilities.
Fri, Oct 8, 4:08 PM · Scheduling utilities

Fri, Oct 1

ardumont closed T3583: check icinga alert for svn save-code-now as Resolved.

It resolved itself, it's green again.

Fri, Oct 1, 6:04 PM · Scheduling utilities, Save Code Now, Monitoring

Sep 17 2021

ardumont added a parent task for T3583: check icinga alert for svn save-code-now: T3458: save code now: Requests are not getting updated from time to time.
Sep 17 2021, 9:34 AM · Scheduling utilities, Save Code Now, Monitoring
ardumont updated the task description for T3583: check icinga alert for svn save-code-now.
Sep 17 2021, 9:33 AM · Scheduling utilities, Save Code Now, Monitoring

Sep 14 2021

ardumont closed T3538: Send scheduler metrics to prometheus, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, as Resolved.
Sep 14 2021, 11:00 AM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont closed T3538: Send scheduler metrics to prometheus as Resolved.
Sep 14 2021, 11:00 AM · System administration, Monitoring, Scheduling utilities
ardumont moved T3538: Send scheduler metrics to prometheus from in-progress to deployed/landed on the System administration board.
Sep 14 2021, 11:00 AM · System administration, Monitoring, Scheduling utilities

Sep 3 2021

ardumont added a subtask for T2345: Improve handling of recurrent loading tasks in scheduler: T3538: Send scheduler metrics to prometheus.
Sep 3 2021, 5:17 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont added a parent task for T3538: Send scheduler metrics to prometheus: T2345: Improve handling of recurrent loading tasks in scheduler.
Sep 3 2021, 5:17 PM · System administration, Monitoring, Scheduling utilities
ardumont changed the status of T3538: Send scheduler metrics to prometheus from Open to Work in Progress.
Sep 3 2021, 5:16 PM · System administration, Monitoring, Scheduling utilities
vlorentz renamed T3550: Compute and show ETA for vault tasks from Compute and show ETA for to vault tasks to Compute and show ETA for vault tasks.
Sep 3 2021, 3:33 PM · Scheduling utilities, Web app, Vault
vlorentz renamed T3550: Compute and show ETA for vault tasks from Add ETA for to vault tasks to Compute and show ETA for to vault tasks.
Sep 3 2021, 3:33 PM · Scheduling utilities, Web app, Vault
vlorentz updated the task description for T3550: Compute and show ETA for vault tasks.
Sep 3 2021, 3:32 PM · Scheduling utilities, Web app, Vault
vlorentz triaged T3550: Compute and show ETA for vault tasks as Normal priority.
Sep 3 2021, 3:32 PM · Scheduling utilities, Web app, Vault
ardumont added a revision to T3538: Send scheduler metrics to prometheus: D6177: Send scheduler metrics to prometheus.
Sep 3 2021, 9:34 AM · System administration, Monitoring, Scheduling utilities
ardumont moved T3538: Send scheduler metrics to prometheus from Backlog to Weekly backlog on the System administration board.
Sep 3 2021, 9:02 AM · System administration, Monitoring, Scheduling utilities
ardumont added a project to T3538: Send scheduler metrics to prometheus: System administration.
Sep 3 2021, 9:02 AM · System administration, Monitoring, Scheduling utilities

Sep 1 2021

ardumont closed T3502: Date overflow error in scheduler journal client as Resolved.

The monitoring icinga alerts have been deployed:

Sep 1 2021, 10:03 AM · System administration, Scheduling utilities

Aug 31 2021

ardumont added a revision to T3502: Date overflow error in scheduler journal client: D6166: swh-scheduler-journal-client: Delay the restart of failing service.
Aug 31 2021, 4:33 PM · System administration, Scheduling utilities

Aug 30 2021

ardumont added a revision to T3502: Date overflow error in scheduler journal client: D6163: Ensure icinga alerts are raised if scheduler journal client service is down.
Aug 30 2021, 5:42 PM · System administration, Scheduling utilities
ardumont triaged T3538: Send scheduler metrics to prometheus as Normal priority.
Aug 30 2021, 10:48 AM · System administration, Monitoring, Scheduling utilities

Aug 27 2021

ardumont added a comment to T3502: Date overflow error in scheduler journal client.

Gist of it is deployed.
I'll close it when it's monitored by at least that diff ^.

Aug 27 2021, 5:56 PM · System administration, Scheduling utilities
ardumont added a revision to T3502: Date overflow error in scheduler journal client: D6156: Ensure icinga alerts are raised if the scheduler journal client is down.
Aug 27 2021, 5:28 PM · System administration, Scheduling utilities

Aug 26 2021

ardumont added a comment to T2345: Improve handling of recurrent loading tasks in scheduler.

What's next, as a summary, subsequent subtasks should be created later:

Aug 26 2021, 5:45 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont moved T3502: Date overflow error in scheduler journal client from Backlog to code-review/monitoring on the System administration board.
Aug 26 2021, 11:26 AM · System administration, Scheduling utilities
ardumont added a comment to T3502: Date overflow error in scheduler journal client.

status:

  • scheduler v0.17.1 deployed on production [1] (db migrated) and staging.
  • then swh-scheduler-journal-client service restarted.
Aug 26 2021, 11:26 AM · System administration, Scheduling utilities
ardumont added a comment to T3502: Date overflow error in scheduler journal client.

I bumped the priority since scheduler runners (next-gen) are depending on the results of journal client (scheduler metrics as well).

Aug 26 2021, 10:10 AM · System administration, Scheduling utilities
ardumont changed the status of T3502: Date overflow error in scheduler journal client from Open to Work in Progress.
Aug 26 2021, 9:57 AM · System administration, Scheduling utilities

Aug 25 2021

ardumont added a revision to T3502: Date overflow error in scheduler journal client: D6136: journal_client: Ensure queue position does not overflow.
Aug 25 2021, 6:19 PM · System administration, Scheduling utilities
vsellier triaged T3502: Date overflow error in scheduler journal client as High priority.
Aug 25 2021, 6:10 PM · System administration, Scheduling utilities
olasd added a comment to T3403: Use forge URL network location as default lister instance name.

I've duplicated the credentials for the relevant forges, and updated the following instance names:

Aug 25 2021, 2:38 PM · Scheduling utilities, Lister

Aug 13 2021

ardumont added a comment to T2345: Improve handling of recurrent loading tasks in scheduler.
  • Refactor a bit the journal client to update a docstring and inline one function (done, that'd be the 2 previous commits mentioned here just below that comment ^).
  • Deactivate failing visits (delegating to listers the act of activating back those origins which gets live again). I have diffs which deal with this that needs some rebase and work according to latest change (I need to get back to it) [1].
  • Deploy the current scheduler implementation (master) when that previous point is done. (That's gonna be my goal to reach prior to some vacation break).
Aug 13 2021, 4:44 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont moved T3471: production: Deploy swh.scheduler v0.17 from deployed/landed to done on the System administration board.
Aug 13 2021, 3:49 PM · System administration, Archive coverage, Scheduling utilities
ardumont closed T3471: production: Deploy swh.scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, as Resolved.
Aug 13 2021, 3:48 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont closed T3471: production: Deploy swh.scheduler v0.17 as Resolved.
Aug 13 2021, 3:48 PM · System administration, Archive coverage, Scheduling utilities
ardumont updated subscribers of T3471: production: Deploy swh.scheduler v0.17.

including the next-gen scheduler runner not yet puppetized [4]

All got done except this part ^.
This needs first the following:

  • D5809 to be rebased on latest master branch (v0.17)
  • the saatchi venv (in swhscheduler home) to be updated with it
Aug 13 2021, 3:48 PM · System administration, Archive coverage, Scheduling utilities
ardumont moved T3471: production: Deploy swh.scheduler v0.17 from code-review/monitoring to in-progress on the System administration board.
Aug 13 2021, 10:33 AM · System administration, Archive coverage, Scheduling utilities
ardumont moved T3471: production: Deploy swh.scheduler v0.17 from in-progress to code-review/monitoring on the System administration board.
Aug 13 2021, 10:33 AM · System administration, Archive coverage, Scheduling utilities
ardumont changed the status of T3471: production: Deploy swh.scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Open to Work in Progress.
Aug 13 2021, 10:33 AM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont changed the status of T3471: production: Deploy swh.scheduler v0.17 from Open to Work in Progress.
Aug 13 2021, 10:33 AM · System administration, Archive coverage, Scheduling utilities
ardumont edited projects for T3471: production: Deploy swh.scheduler v0.17, added: System administration; removed Sprint 2021 01.
Aug 13 2021, 10:33 AM · System administration, Archive coverage, Scheduling utilities
ardumont added a comment to T3471: production: Deploy swh.scheduler v0.17.

including the next-gen scheduler runner not yet puppetized [4]

Aug 13 2021, 10:32 AM · System administration, Archive coverage, Scheduling utilities

Aug 12 2021

ardumont moved T3471: production: Deploy swh.scheduler v0.17 from Backlog to in-progress on the Sprint 2021 01 board.
Aug 12 2021, 8:41 AM · System administration, Archive coverage, Scheduling utilities
ardumont added a comment to T3471: production: Deploy swh.scheduler v0.17.

Following actions in order:

Aug 12 2021, 8:41 AM · System administration, Archive coverage, Scheduling utilities

Aug 9 2021

ardumont closed T3456: staging: Deploy scheduler v0.17 as Resolved.
Aug 9 2021, 11:07 AM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont closed T3456: staging: Deploy scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, as Resolved.
Aug 9 2021, 11:07 AM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont moved T3456: staging: Deploy scheduler v0.17 from code-review/monitoring to deployed/landed on the System administration board.
Aug 9 2021, 11:07 AM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities