Page MenuHomeSoftware Heritage

celery_backend: more robust queue length management
ClosedPublic

Authored by olasd on Dec 18 2018, 5:18 PM.

Details

Summary
  • Ignore the absence of the rabbitmq management interface
  • Handle inexistent queues as if they were empty

Depends on D848

Test Plan

tox

Diff Detail

Repository
rDSCH Scheduling utilities
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

olasd created this revision.Dec 18 2018, 5:18 PM
vlorentz added inline comments.
swh/scheduler/celery_backend/config.py
126

When does this happen?

This should probably be merged with the behavior in if conn_info['transport'] == 'memory':.

olasd marked an inline comment as done.Dec 18 2018, 5:26 PM
olasd added inline comments.
swh/scheduler/celery_backend/config.py
126

This happens when the queue doesn't exist in RabbitMQ.

What do you mean by "merged"?

ardumont accepted this revision.Dec 18 2018, 5:28 PM
This revision is now accepted and ready to land.Dec 18 2018, 5:28 PM
This revision was automatically updated to reflect the committed changes.