Page MenuHomeSoftware Heritage

Add loader workers services
ClosedPublic

Authored by douardda on Wed, Jan 9, 5:29 PM.

Details

Summary

Also

  • task_queues configuration is not needed any more
  • Fix loader config file name

We should really consider being more consistant here:

  • loaders: ~/.config/swh/loader/<name>.yml
  • listers: ~/.config/swh/lister-<name>.yml

Require D888, D900 and D901 to work properly.

Diff Detail

Repository
rCDFD Dockerfiles for developers
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

douardda created this revision.Wed, Jan 9, 5:29 PM
vlorentz accepted this revision.Wed, Jan 9, 5:52 PM
vlorentz added a subscriber: vlorentz.
vlorentz added inline comments.
dockerfiles/swh-loaders-worker/Dockerfile
10–11

indent

dockerfiles/swh-loaders-worker/entrypoint.sh
9

will

scheduler.env
6

Did you mean to commit this?

This revision is now accepted and ready to land.Wed, Jan 9, 5:52 PM
ardumont accepted this revision.Thu, Jan 10, 8:52 AM
ardumont added a subscriber: ardumont.

\m/

We should really consider being more consistant here...

Quite!

consistant

also, probably a typo, still, it's consist`e`nt ;)

douardda marked an inline comment as done.Thu, Jan 10, 9:21 AM
douardda added inline comments.
scheduler.env
6

Defining the env var is needed here (according the entrypoint.sh file) and I don't mind running these dockerized env stuff in debug mode, but I'm fine with upgrading the log level to INFO here.

douardda updated this revision to Diff 2869.Thu, Jan 10, 9:27 AM

Fix typos and raise log level to INFO

douardda marked 3 inline comments as done.Thu, Jan 10, 9:36 AM
This revision was automatically updated to reflect the committed changes.