Page MenuHomeSoftware Heritage
Differential D8209 Diff 29650 docker/docker-compose.yml

Changeset View

Standalone View

View Options

docker/docker-compose.yml

Show All 14 Lines environment:
ZOO_LOG4J_PROP: WARN,CONSOLE ZOO_LOG4J_PROP: WARN,CONSOLE
kafka: kafka:
image: wurstmeister/kafka image: wurstmeister/kafka
ports: ports:
- "5092:5092" - "5092:5092"
env_file: ./env/kafka.env env_file: ./env/kafka.env
environment: environment:
KAFKA_BROKER_ID: 1 KAFKA_BROKER_ID: 1
vsellierUnsubmitted
Not Done
Inline Actions

TIL the possibility to specify the cleanup policy here.

Shouldn't this be specified for all the topics?

vsellier: TIL the possibility to specify the cleanup policy here. Shouldn't this be specified for all…
douarddaAuthorUnsubmitted
Done
Inline Actions

indeed, I though I did but I may have goofed a rebase or smthg

douardda: indeed, I though I did but I may have goofed a rebase or smthg
KAFKA_CREATE_TOPICS: swh.journal.objects.content:16:1, KAFKA_CREATE_TOPICS: swh.journal.objects.content:16:1:compact,
swh.journal.objects.directory:16:1, swh.journal.objects.directory:16:1:compact,
swh.journal.objects.origin:16:1, swh.journal.objects.extid:16:1:compact,
swh.journal.objects.origin_visit:16:1, swh.journal.objects.origin:16:1:compact,
swh.journal.objects.origin_visit_status:16:1, swh.journal.objects.origin_visit:16:1:compact,
swh.journal.objects.revision:16:1, swh.journal.objects.origin_visit_status:16:1:compact,
swh.journal.objects.release:16:1, swh.journal.objects.raw_extrinsic_metadata:16:1:compact,
swh.journal.objects.skipped_content:16:1, swh.journal.objects.release:16:1:compact,
swh.journal.objects.snapshot:16:1, swh.journal.objects_privileged.release:16:1:compact,
swh.journal.indexed.origin_intrinsic_metadata:16:1 swh.journal.objects.revision:16:1:compact,
swh.journal.objects_privileged.revision:16:1:compact,
swh.journal.objects.skipped_content:16:1:compact,
swh.journal.objects.snapshot:16:1:compact,
swh.journal.indexed.origin_intrinsic_metadata:16:1:compact
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka:9092,PLAINTEXT_HOST://127.0.0.1:5092 KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka:9092,PLAINTEXT_HOST://127.0.0.1:5092
KAFKA_LISTENERS: PLAINTEXT://:9092,PLAINTEXT_HOST://:5092 KAFKA_LISTENERS: PLAINTEXT://:9092,PLAINTEXT_HOST://:5092
KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT
KAFKA_INTER_BROKER_LISTENER_NAME: PLAINTEXT KAFKA_INTER_BROKER_LISTENER_NAME: PLAINTEXT
depends_on: depends_on:
- zookeeper - zookeeper
healthcheck: healthcheck:
test: "[ `JMX_PORT= kafka-topics.sh --list --zookeeper zookeeper:2181 | wc -l` -ge 6 ]" test: "[ `JMX_PORT= kafka-topics.sh --list --zookeeper zookeeper:2181 | wc -l` -ge `echo $$KAFKA_CREATE_TOPICS | tr ',' '\n' | wc -l` ]"
anlambertUnsubmitted
Not Done
Inline Actions

Since you have added new kafka topics, the healthcheck condition should be updated to ensure all topics got created before starting services depending on those,
the code below seems to do the trick:

healthcheck:
    test: "[ `JMX_PORT= kafka-topics.sh --list --zookeeper zookeeper:2181 | wc -l`
        -ge `echo $$KAFKA_CREATE_TOPICS | tr ',' '\n' | wc -l` ]"
anlambert: Since you have added new kafka topics, the healthcheck condition should be updated to ensure…
douarddaAuthorUnsubmitted
Done
Inline Actions

good catch thanks

douardda: good catch thanks
interval: 10s interval: 10s
timeout: 5s timeout: 5s
retries: 10 retries: 10
cmak: cmak:
# Note: CMAK does not work out of the box, you need to run this first: # Note: CMAK does not work out of the box, you need to run this first:
# $ docker-compose exec zookeeper ./bin/zkCli.sh # $ docker-compose exec zookeeper ./bin/zkCli.sh
# create /kafka-manager/mutex "" # create /kafka-manager/mutex ""
▲ Show 20 Lines • Show All 590 Lines • Show Last 20 Lines
About · Developer information · Legal