HomeSoftware Heritage

Migrate to confluent-kafka instead of kafka-python

Description

Migrate to confluent-kafka instead of kafka-python

While kafka-python is a useful library, confluent-kafka is based on rdkafka
which is the upstream-supported kafka client library, and supports more
features (e.g. proper authentication modes) which we should be using when
opening our kafka brokers to the internet.

Details

Provenance
olasdAuthored on Sep 11 2019, 2:53 PM
olasdPushed on Sep 13 2019, 2:25 PM
Differential Revision
D1980: Migrate to confluent-kafka instead of kafka-python
Parents
rDJNL2514cb23d134: Fix path to the 'extra_headers' field in _fix_revision_transplant_source.
Branches
Unknown
Tags
Unknown
References
tag: v0.0.16
Build Status
Buildable 7782
Build 11191: test-and-buildJenkins