- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jan 8 2023
Jan 8 2023
gitlab-migration changed the status of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler from Resolved to Migrated.
gitlab-migration changed the status of T2442: Provide a unified API for listers to interact with the scheduler, a subtask of T2444: Implement the scheduling policy for the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2442: Provide a unified API for listers to interact with the scheduler from Resolved to Migrated.
gitlab-migration changed the status of T2133: Scheduler listener/runner: add statsd probes from Resolved to Migrated.
gitlab-migration changed the status of T1947: Unsupported locale 'en_IN' in arrow lib from Wontfix to Migrated.
gitlab-migration changed the status of T1931: scheduler's cron cleanup error when filtering tasks to archive from Resolved to Migrated.
gitlab-migration changed the status of T1631: Add new scheduler task types for npm ingestion from Resolved to Migrated.
gitlab-migration changed the status of T1539: Investigate strange behavior seen in the rabbitmq admin web page from Resolved to Migrated.
gitlab-migration changed the status of T1536: Add a CLI tool to run a task on all origins from Resolved to Migrated.
gitlab-migration changed the status of T1508: Rationalize task type names from Resolved to Migrated.
gitlab-migration changed the status of T1494: swh-scheduler API does not really support concurrency from Resolved to Migrated.
gitlab-migration changed the status of T1479: Factorize the debug logging of a task in the SWHTask class from Resolved to Migrated.
gitlab-migration changed the status of T1469: clean up stale status="ongoing" visits from Resolved to Migrated.
gitlab-migration changed the status of T1460: Add task related metrics to swh-scheduler from Resolved to Migrated.
gitlab-migration changed the status of T1401: Make celery workers print the content of their stack when logging an exception from Resolved to Migrated.
gitlab-migration changed the status of T1400: Make celery workers print their arguments in the logs when they crash from Resolved to Migrated.
gitlab-migration changed the status of T1324: Deploy metadata indexers in production, a subtask of T1227: General improvments of the indexer: Schedule indexer tasks, from Resolved to Migrated.
gitlab-migration changed the status of T1157: Generic scheduler task creation according to task type from Wontfix to Migrated.
gitlab-migration changed the status of T1071: Scheduler: Archive existing completed oneshot and disabled recurring tasks, a subtask of T986: Scheduler: Automate completed oneshot or disabled recurring tasks archival, from Resolved to Migrated.
gitlab-migration changed the status of T1071: Scheduler: Archive existing completed oneshot and disabled recurring tasks from Resolved to Migrated.
gitlab-migration changed the status of T1051: Consume ghtorrent events as oneshot tasks with priority normal from Resolved to Migrated.
gitlab-migration changed the status of T1051: Consume ghtorrent events as oneshot tasks with priority normal, a subtask of T1031: Speed up updates - meta task, from Resolved to Migrated.
gitlab-migration changed the status of T1036: testing: Move remote api testing fixture to swh.core from Resolved to Migrated.
gitlab-migration changed the status of T1036: testing: Move remote api testing fixture to swh.core, a subtask of T1034: scheduler: Expose remote api, from Resolved to Migrated.
gitlab-migration changed the status of T1034: scheduler: Expose remote api, a subtask of T1031: Speed up updates - meta task, from Resolved to Migrated.
gitlab-migration changed the status of T1035: scheduler: Schedule tasks with priorities from Resolved to Migrated.
gitlab-migration changed the status of T1034: scheduler: Expose remote api from Resolved to Migrated.
gitlab-migration changed the status of T1035: scheduler: Schedule tasks with priorities, a subtask of T1031: Speed up updates - meta task, from Resolved to Migrated.
gitlab-migration changed the status of T1023: scheduler: tasks archival: Test run on test elasticsearch cluster, a subtask of T986: Scheduler: Automate completed oneshot or disabled recurring tasks archival, from Resolved to Migrated.
gitlab-migration changed the status of T1023: scheduler: tasks archival: Test run on test elasticsearch cluster from Resolved to Migrated.
gitlab-migration changed the status of T991: Indexers: Send range of ids instead of list of ids, a subtask of T1310: Simplify indexer design: move away from the pipeline approach, from Resolved to Migrated.
gitlab-migration changed the status of T986: Scheduler: Automate completed oneshot or disabled recurring tasks archival, a subtask of T724: Move scheduler task run logging to a more permanent location, from Resolved to Migrated.
gitlab-migration changed the status of T986: Scheduler: Automate completed oneshot or disabled recurring tasks archival from Resolved to Migrated.
gitlab-migration changed the status of T726: Add "queue shaping" to the scheduler from Resolved to Migrated.
gitlab-migration changed the status of T726: Add "queue shaping" to the scheduler, a subtask of T723: General improvements to the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T724: Move scheduler task run logging to a more permanent location, a subtask of T723: General improvements to the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T724: Move scheduler task run logging to a more permanent location from Resolved to Migrated.
gitlab-migration changed the status of T725: Scheduler API server, a subtask of T723: General improvements to the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T723: General improvements to the scheduler from Resolved to Migrated.
gitlab-migration changed the status of T720: (Re)Scheduling oneshot tasks automatically from Resolved to Migrated.
gitlab-migration changed the status of T720: (Re)Scheduling oneshot tasks automatically, a subtask of T723: General improvements to the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T537: Update the task scheduler and the task event listener to use the new partial status, a subtask of T723: General improvements to the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T537: Update the task scheduler and the task event listener to use the new partial status from Resolved to Migrated.
gitlab-migration changed the status of T535: Register partial task state in scheduler database from Resolved to Migrated.
gitlab-migration changed the status of T536: Enrich task return status to register partial completions, a subtask of T537: Update the task scheduler and the task event listener to use the new partial status, from Resolved to Migrated.
gitlab-migration changed the status of T536: Enrich task return status to register partial completions from Resolved to Migrated.
gitlab-migration changed the status of T535: Register partial task state in scheduler database, a subtask of T536: Enrich task return status to register partial completions, from Resolved to Migrated.
gitlab-migration changed the status of T535: Register partial task state in scheduler database, a subtask of T537: Update the task scheduler and the task event listener to use the new partial status, from Resolved to Migrated.
gitlab-migration changed the status of T315: swh-scheduler: add command-line interface from Resolved to Migrated.
Nov 14 2022
Nov 14 2022
olasd added a project to T4681: Add throttling/backoff to origin visit scheduler respawn logic: Easy hack.
olasd triaged T4681: Add throttling/backoff to origin visit scheduler respawn logic as Normal priority.
Oct 26 2022
Oct 26 2022
vlorentz updated the task description for T4661: Some Git loader tasks for gitlab.com origins have "lister_name: github" in their arguments.
vlorentz renamed T4661: Some Git loader tasks for gitlab.com origins have "lister_name: github" in their arguments from InvalidOrigin: netloc should be 'github.com', not 'gitlab.com' to Some Git loader tasks for gitlab.com origins have "lister_name: github" in their arguments.
vlorentz updated the task description for T4661: Some Git loader tasks for gitlab.com origins have "lister_name: github" in their arguments.
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T3857: unexpected long time between a task is received and the loading start for few tasks from Resolved to Migrated.
gitlab-migration changed the status of T3837: clean up swh-scheduler model db from Resolved to Migrated.
gitlab-migration changed the status of T3782: Drop tasks archival service from Resolved to Migrated.
gitlab-migration changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Resolved to Migrated.
gitlab-migration changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3538: Send scheduler metrics to prometheus, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3538: Send scheduler metrics to prometheus from Resolved to Migrated.
gitlab-migration changed the status of T3502: Date overflow error in scheduler journal client from Resolved to Migrated.
gitlab-migration changed the status of T3471: production: Deploy swh.scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3471: production: Deploy swh.scheduler v0.17 from Resolved to Migrated.
gitlab-migration changed the status of T3456: staging: Deploy scheduler v0.17 from Resolved to Migrated.
gitlab-migration changed the status of T3456: staging: Deploy scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3367: scheduler: Separate scheduling save code now tasks from the recurrent tasks from Resolved to Migrated.
gitlab-migration changed the status of T2993: Deploy visit-stats journal client on production, a subtask of T2444: Implement the scheduling policy for the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2993: Deploy visit-stats journal client on production from Resolved to Migrated.
gitlab-migration closed T1492: Requests to the scheduler API take up to 6 seconds in prod as Migrated.
gitlab-migration changed the status of T902: Make swh-scheduler's listener resilient to failure from Resolved to Migrated.
gitlab-migration changed the status of T327: swh-worker: puppetize daemon from Resolved to Migrated.
gitlab-migration changed the status of T326: swh-scheduler: puppetize event listener from Resolved to Migrated.
gitlab-migration changed the status of T325: swh-scheduler: puppetize task runner from Resolved to Migrated.
Sep 14 2022
Sep 14 2022
anlambert triaged T4535: "swh scheduler task add" command should print an error message in case of unknown task as Normal priority.
May 31 2022
May 31 2022
douardda triaged T4287: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Normal priority.
May 24 2022
May 24 2022
Mar 17 2022
Mar 17 2022
bchauvet removed a parent task for T1537: semi-automated addition of new "forges": T1538: Add "forge" now.
bchauvet added a parent task for T1537: semi-automated addition of new "forges": T4058: Add forge now request processing admin tools.
Mar 11 2022
Mar 11 2022
@lucifer4j There are still many missing annotations. And yes, TypedDict would be nice
Hi! I intended to work on this so I looked through the code in swh.scheduler.backend and swh.scheduler.interface. Both files seem to have type annotations (except at a couple of places?). At a few places, the types are mentioned in docstrings but AFAICS those are only for dict keys/list items. So, I wanted to ask if this task is still valid?
Feb 24 2022
Feb 24 2022
ardumont updated the task description for T3974: Origins without last visits are scheduled too often.
Jan 20 2022
Jan 20 2022
This task has been complete since a while now, closing it.
Jan 19 2022
Jan 19 2022
ardumont added a comment to T3857: unexpected long time between a task is received and the loading start for few tasks.
It did, prior to the fix, there were 3 systematically marked scheduled from earlier.
It went to 0 on its own since you deployed this so great!
vsellier closed T3857: unexpected long time between a task is received and the loading start for few tasks as Resolved.
The ack late propery is deployed in staging and production.
The number of scn in the 'scheduled' status should decrease.
Jan 18 2022
Jan 18 2022
ardumont added a comment to T3857: unexpected long time between a task is received and the loading start for few tasks.
The task_acks_lateoption was disabled before the new scheduler migration.
Perhaps it may be interesting to reactivate it for the high_priority_loaders as they handle tasks created by users.
They are also monitored by the end to end probes.
vsellier added a comment to T3857: unexpected long time between a task is received and the loading start for few tasks.
It looks it's the normal behavior of celery with the current configuration: