Page MenuHomeSoftware Heritage

Refactor swh/scheduler/updater as well

Authored by douardda on Jan 29 2019, 3:11 PM.


  • use the same config system as the main backend, with the same conventions,
  • do not make SchedulerUpdaterBackend inherit from DbBackend, use a simple association, similar to the SchedulerBackend class,
  • refactor the ghtorrent the same (explicit config),
  • same for the updater writer
  • move their main functions in
  • adapt tests accordingly

Depends on D1027

Diff Detail

rDSCH Scheduling utilities
Automatic diff as part of commit; lint not applicable.
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

douardda created this revision.Jan 29 2019, 3:11 PM
ardumont added inline comments.

beware the packaging debian here, iirc, the packages are separated (without dependency i think)...

ardumont accepted this revision.Jan 30 2019, 10:27 AM

Sounds good.

I foresee impacts on the configuration part (swh-site) and the debian packaging.

Not completely sure about the the impacts for the "production" setup (swh-site).
It seems the some configuration changed (key renaming, plus the way it's loaded).

This revision is now accepted and ready to land.Jan 30 2019, 10:27 AM
This revision was automatically updated to reflect the committed changes.