Automatically subscribe workers to the per-task queues
ClosedPublic
Actions

Authored by olasd on Dec 18 2018, 5:28 PM.

Details

Reviewers

Commits

rDSCH4335cfc5e8dc: Automatically subscribe workers to the per-task queues

Summary

That only works for actual workers (the celeryd_after_setup signal isn't sent by
the test fixture), so keep the workaround in the fixture

Depends on D850

Test Plan

tox
Run a worker with a custom config: the task queues get subscribed.
Run a worker with no custom config and -I swh.loader.debian.tasks,swh.loader.git.tasks: the task queues get subscribed as well.

Diff Detail

Repository

rDSCH Scheduling utilities

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 3149
Build 4037: tox-on-jenkins	Jenkins
Build 4036: arc lint + arc unit

Event Timeline

olasd created this revision.Dec 18 2018, 5:28 PM

Harbormaster failed remote builds in B3149: Diff 2719!Dec 18 2018, 5:29 PM

Build has FAILED

Link to build: https://jenkins.softwareheritage.org/job/DSCH/job/tox/49/
See console output for more information: https://jenkins.softwareheritage.org/job/DSCH/job/tox/49/console

olasd mentioned this in D850: Route tasks using their task name rather than a task_queue attribute.Dec 18 2018, 5:29 PM

very nice!

This revision is now accepted and ready to land.Dec 18 2018, 5:30 PM

olasd mentioned this in D853: Explicitly register class-based tasks inheriting from our own class.Dec 18 2018, 5:32 PM

Closed by commit rDSCH4335cfc5e8dc: Automatically subscribe workers to the per-task queues (authored by olasd). · Explain WhyDec 18 2018, 5:33 PM

This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

Path

Size

swh/

scheduler/

celery_backend/

config.py

9 lines

Diff 2719

View Options

swh/scheduler/celery_backend/config.py

Automatically subscribe workers to the per-task queuesClosedPublicActions