First step toward T1290.
Details
Details
- Reviewers
ardumont - Group Reviewers
Reviewers - Commits
- rDCIDXe778587b203a: Use swh.scheduler instead of celery in the orchestrator.
Diff Detail
Diff Detail
- Repository
- rDCIDX Metadata indexer
- Branch
- orchestrator-without-celery
- Lint
No Linters Available - Unit
No Unit Test Coverage - Build Status
Buildable 1950 Build 2349: arc lint + arc unit
Event Timeline
Comment Actions
I did not check the rest yet...
Will do tomorrow.
swh/indexer/orchestrator.py | ||
---|---|---|
62 | Use instead a configuration like so [1] scheduler: cls: remote args: url: http://localhost:5008 [2] [2] default port for scheduler instance is https://forge.softwareheritage.org/source/puppet-swh-site/browse/production/data/defaults.yaml$1136 | |
84 | That way, that becomes simpler here: self.scheduler = get_scheduler(**self.config['scheduler']) Also it matches consistently what we do elsewhere. |
swh/indexer/orchestrator.py | ||
---|---|---|
65 | Default should be for a developer machine so it should work out of the box. It's also consistent with other modules. |
swh/indexer/orchestrator.py | ||
---|---|---|
70 | We should make that 'indexer_mimetype' now, 'indexer_language', etc... |