Differential D6029

Add swh-graph to the docker environment
ClosedPublic
Actions

Authored by vlorentz on Jul 27 2021, 4:05 PM.

Tags

None

Subscribers

Details

Reviewers

Group Reviewers

Maniphest Tasks

T1936: integrate swh-graph into the docker environment

Commits

rDENVf4e9375c7a72: Add swh-graph to the docker environment

Summary

I'd like to use it to test the vault.

Diff Detail

Repository

rDENV Development environment

Branch

master

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 22762
Build 35496: arc lint + arc unit

Event Timeline

vlorentz created this revision.Jul 27 2021, 4:05 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptJul 27 2021, 4:05 PM

vlorentz requested review of this revision.Jul 27 2021, 4:05 PM

Harbormaster completed remote builds in B22762: Diff 21794.Jul 27 2021, 4:05 PM

.

sort graph and fix paths

Harbormaster completed remote builds in B22765: Diff 21797.Jul 27 2021, 4:32 PM

.

more path fixes

Harbormaster completed remote builds in B22768: Diff 21799.Jul 27 2021, 5:17 PM

.

final fixes

Harbormaster completed remote builds in B22769: Diff 21800.Jul 27 2021, 5:32 PM

vlorentz retitled this revision from [wip] Start adding swh-graph to the docker environment to Start adding swh-graph to the docker environment.Jul 27 2021, 5:32 PM

vlorentz added a task: T1936: integrate swh-graph into the docker environment.Jul 27 2021, 5:37 PM

partition all the topics

Harbormaster completed remote builds in B22774: Diff 21806.Jul 28 2021, 9:32 AM

Nice, thanks.

I don't get how the graph gets filled in though. Do you restart regularly the graph
service (through some docker-compose command) so the commands gets executed to fill it?
(I see there is a journal client so that must be where the data comes from)

docker/services/swh-graph/entrypoint.sh
28	maybe that could be parametric in the docker-compose.graph.yml so we can modify it in the override or something (if that becomes too verbose)?

This revision is now accepted and ready to land.Jul 28 2021, 10:01 AM

Do you restart regularly the graph service (through some docker-compose command) so the commands gets executed to fill it?

For now, yes

it works, finally

Harbormaster completed remote builds in B22800: Diff 21837.Jul 28 2021, 4:18 PM

Closed by commit rDENVf4e9375c7a72: Add swh-graph to the docker environment (authored by vlorentz). · Explain WhyJul 28 2021, 4:19 PM

This revision was automatically updated to reflect the committed changes.

vlorentz added a commit: rDENVf4e9375c7a72: Add swh-graph to the docker environment.

vlorentz added inline comments.Jul 28 2021, 4:19 PM

docker/services/swh-graph/entrypoint.sh
28	that's copy pasted from objstorage and others, so kind of out of scope for this diff

vlorentz retitled this revision from Start adding swh-graph to the docker environment to Add swh-graph to the docker environment.Jul 28 2021, 4:41 PM

vlorentz added a child revision: D6042: graph: don't run export+compression unless needed, and add documentation.

vlorentz added parent revisions: D6030: server: Define make_app_from_configfile so it can be ran by gunicorn, D6038: journalprocessor: Fix deserialize_message raising EOFError on the last message of each assignment.Jul 28 2021, 4:44 PM

vlorentz added a parent revision: D6028: journalprocessor: Fix freeze on empty offset ranges..

Revision Contents
Changeset List

Path

Size

docker/

7 lines

conf/

7 lines

docker-compose.graph.yml

23 lines

docker-compose.yml

12 lines

services/

swh-graph/

32 lines

Diff 21794

docker/Dockerfile

Loading...

docker/conf/graph.yml

Loading...

docker/docker-compose.graph.yml

Loading...

docker/docker-compose.yml

Loading...

docker/services/swh-graph/entrypoint.sh

Loading...