Paths

Table of Contentst

Differential D6248

docker: allow kafka to be consumed from the host
ClosedPublic
Actions

Authored by douardda on Sep 13 2021, 4:51 PM.

Tags

None

Subscribers

Details

Reviewers

Group Reviewers

Commits

rDENVb0f07795ddff: docker: Document how to consume kafka topics from the host
rDENVf612427f663d: docker: allow kafka to be consumed from the host

Summary

using a config like:

journal:

brokers:
  - 127.0.0.1:29002

shoud allow to execute swh commands like swh storage replay or `swh
dataset export` from the host, consuming kafka topics from the
docker-compose.

Also configure kafka topics cleanup policy to 'compact'

instead of the default 'delete', so the user can keep its data in the
test kafka server for more than a week.

Diff Detail

Repository

rDENV Development environment

Lint

Automatic diff as part of commit; lint not applicable.

Unit

Automatic diff as part of commit; unit tests not applicable.

Event Timeline

douardda created this revision.Sep 13 2021, 4:51 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptSep 13 2021, 4:51 PM

douardda requested review of this revision.Sep 13 2021, 4:51 PM

Harbormaster completed remote builds in B23560: Diff 22626.Sep 13 2021, 4:51 PM

Add a bit of documentation in the README file on how to consume kafka from the host

Harbormaster completed remote builds in B23561: Diff 22627.Sep 13 2021, 5:13 PM

ardumont accepted this revision.Sep 14 2021, 11:03 AM

This revision is now accepted and ready to land.Sep 14 2021, 11:03 AM

vlorentz added a subscriber: vlorentz.Sep 14 2021, 11:13 AM

vlorentz added inline comments.

docker/README.rst
188	why? (I see below that the port was not actually 5092; but why not set it to 5092 in docker-compose?)

douardda added inline comments.Sep 14 2021, 11:21 AM

docker/README.rst
188	because it's what I had in my docker-compose when I pushed this diff :-) and 29092 is a palindrome, which is thus much better :-) But ok, I see, 5092 kinda make sense with other exposed ports.

Keep port 5092 exposed on host

Harbormaster completed remote builds in B23573: Diff 22635.Sep 14 2021, 11:35 AM

Closed by commit rDENVf612427f663d: docker: allow kafka to be consumed from the host (authored by douardda). · Explain WhySep 14 2021, 11:40 AM

This revision was automatically updated to reflect the committed changes.

douardda added a commit: rDENVf612427f663d: docker: allow kafka to be consumed from the host.

douardda added a commit: rDENVb0f07795ddff: docker: Document how to consume kafka topics from the host.

Revision Contents
Changeset List

Path

Size

docker/

2 lines

docker-compose.yml

6 lines

Diff 22637

docker/README.rst

Loading...

docker/docker-compose.yml

Loading...