Scheduler/Lister refactoring
Details
Details
Description
Jan 8 2023
Jan 8 2023
gitlab-migration changed the status of T2966: Backfill origin_visit_status **with** the `visit_type` field properly given, a subtask of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2966: Backfill origin_visit_status **with** the `visit_type` field properly given from Resolved to Migrated.
gitlab-migration closed T2974: Define (and implement) scheduler performance metrics, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, as Migrated.
gitlab-migration closed T2973: Implement a scheduler simulator, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, as Migrated.
gitlab-migration closed T2345: Improve handling of recurrent loading tasks in scheduler as Migrated.
gitlab-migration changed the status of T3399: Improve PyPI lister to pull last update information when running incrementally, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3073: Properly document the new unified API lister, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3073: Properly document the new unified API lister from Resolved to Migrated.
gitlab-migration changed the status of T2992: Port launchpad lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2991: Port packagist lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2990: Port GNU lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2989: Port CRAN lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2987: Port gitlab lister to the new `swh.lister.pattern.Lister` API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2984: Port cgit lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T2984: Port cgit lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2979: Port debian lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T2979: Port debian lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2978: Deploy visit-stats journal client on staging from Resolved to Migrated.
gitlab-migration changed the status of T2972: Port npm lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2978: Deploy visit-stats journal client on staging, a subtask of T2967: Write journal client subcribed to origin_visit_status topics , from Resolved to Migrated.
gitlab-migration changed the status of T2972: Port npm lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T2971: Port Gitea lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T2967: Write journal client subcribed to origin_visit_status topics , a subtask of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2967: Write journal client subcribed to origin_visit_status topics from Resolved to Migrated.
gitlab-migration changed the status of T2965: Adapt storage to actually write the visit_type in the origin_visit_status topic from Resolved to Migrated.
gitlab-migration changed the status of T2965: Adapt storage to actually write the visit_type in the origin_visit_status topic, a subtask of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2964: Adapt origin_visit_status_(get|add) api to deal with the visit_type, a subtask of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2964: Adapt origin_visit_status_(get|add) api to deal with the visit_type from Resolved to Migrated.
gitlab-migration changed the status of T2963: Add visit_type field to OriginVisitStatus model object, a subtask of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2961: Add a "not_found" value in OriginVisitStatus.status from Resolved to Migrated.
gitlab-migration changed the status of T2963: Add visit_type field to OriginVisitStatus model object from Resolved to Migrated.
gitlab-migration changed the status of T2956: Port PyPI lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2956: Port PyPI lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T2955: Port Bitbucket lister to the new Lister API, a subtask of T2442: Provide a unified API for listers to interact with the scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2955: Port Bitbucket lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T2442: Provide a unified API for listers to interact with the scheduler, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, a subtask of T2444: Implement the scheduling policy for the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler from Resolved to Migrated.
gitlab-migration changed the status of T2442: Provide a unified API for listers to interact with the scheduler, a subtask of T2444: Implement the scheduling policy for the recurrent visit scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T2442: Provide a unified API for listers to interact with the scheduler from Resolved to Migrated.
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Resolved to Migrated.
gitlab-migration changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3538: Send scheduler metrics to prometheus, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3471: production: Deploy swh.scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.