Page MenuHomeSoftware Heritage

swh.journal.publisher: Process origins
ClosedPublic

Authored by ardumont on Nov 21 2018, 5:29 PM.

Details

Reviewers
olasd
douardda
Group Reviewers
Reviewers
Summary

This simply take the origin provided by the journal listener and
forwards it to the topic of reified objects.

Depends on D693

Test Plan

tox

Diff Detail

Repository
rDJNL Journal infrastructure
Branch
process-origins
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 2608
Build 3240: tox-on-jenkinsJenkins
Build 3239: arc lint + arc unit

Event Timeline

douardda added a subscriber: douardda.

Same as D692; LGTM but I really don't *see* what this diff is actually *doing*. Just reading this, seems like a convoluted way of testing the equality of a dict with itself, but I guess I miss some bigger picture...

This revision is now accepted and ready to land.Nov 22 2018, 9:48 AM

but I really don't *see* what this diff is actually *doing*. Just reading this, seems like a convoluted way of testing the equality of a dict with itself, but I guess I miss some bigger picture...

More details on answer [1]

[1] https://forge.softwareheritage.org/D692#14417

convoluted way of testing the equality of a dict with itself,

Since i did not have time to unstuck me on running a real kafka instance in test context (out of scope for this week ;)
I still needed to check that the data is indeed flowing through ;)

The publisher's process_objects method is the one running at the core of the publisher.
Independently of the topic subscription/publishing step (which is stuck in tests for now).

So yeah, in the end, that not much. That's better than nothing though.