Page MenuHomeSoftware Heritage

Simplify and organize a bit the whole docker environment
ClosedPublic

Authored by douardda on Feb 6 2019, 10:40 AM.

Details

Summary
  • Move conf and env files in dedicated directories
  • Move all swh config file in conf/ and use volumes to inject them in dockers so that there is no need to rebuild the image when modifying one of them.
  • Reduce verbosity of the journal pusblisher and storage listener.
  • Install kombu from sources in scheduler-worker as a workaround for T1491
  • Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used
  • Merge all loaders and listers services in swh-loader and swh-lister in order to simplify the docker environment.
  • Also comment out the flower service, since it's pretty unreliable for now.

Diff Detail

Repository
rCDFD Dockerfiles for developers
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

douardda created this revision.Feb 6 2019, 10:40 AM
vlorentz accepted this revision.Feb 6 2019, 11:07 AM
vlorentz added a subscriber: vlorentz.

Nice one, thanks

docker-compose.yml
147–148

Did you mean to commit that?

This revision is now accepted and ready to land.Feb 6 2019, 11:07 AM
ardumont accepted this revision.Feb 6 2019, 2:07 PM
This revision was automatically updated to reflect the committed changes.