Differential D6029

Add swh-graph to the docker environment
ClosedPublic
Actions

Authored by vlorentz on Jul 27 2021, 4:05 PM.

Tags

None

Subscribers

Details

Reviewers

Group Reviewers

Maniphest Tasks

T1936: integrate swh-graph into the docker environment

Commits

rDENVf4e9375c7a72: Add swh-graph to the docker environment

Summary

I'd like to use it to test the vault.

Diff Detail

Repository

rDENV Development environment

Branch

docker-graph

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 22774
Build 35514: arc lint + arc unit

Event Timeline

vlorentz created this revision.Jul 27 2021, 4:05 PM

Herald added a reviewer: Reviewers. · View Herald TranscriptJul 27 2021, 4:05 PM

vlorentz requested review of this revision.Jul 27 2021, 4:05 PM

Harbormaster completed remote builds in B22762: Diff 21794.Jul 27 2021, 4:05 PM

.

sort graph and fix paths

Harbormaster completed remote builds in B22765: Diff 21797.Jul 27 2021, 4:32 PM

.

more path fixes

Harbormaster completed remote builds in B22768: Diff 21799.Jul 27 2021, 5:17 PM

.

final fixes

Harbormaster completed remote builds in B22769: Diff 21800.Jul 27 2021, 5:32 PM

vlorentz retitled this revision from [wip] Start adding swh-graph to the docker environment to Start adding swh-graph to the docker environment.Jul 27 2021, 5:32 PM

vlorentz added a task: T1936: integrate swh-graph into the docker environment.Jul 27 2021, 5:37 PM

partition all the topics

Harbormaster completed remote builds in B22774: Diff 21806.Jul 28 2021, 9:32 AM

Nice, thanks.

I don't get how the graph gets filled in though. Do you restart regularly the graph
service (through some docker-compose command) so the commands gets executed to fill it?
(I see there is a journal client so that must be where the data comes from)

docker/services/swh-graph/entrypoint.sh
28	maybe that could be parametric in the docker-compose.graph.yml so we can modify it in the override or something (if that becomes too verbose)?

This revision is now accepted and ready to land.Jul 28 2021, 10:01 AM

Do you restart regularly the graph service (through some docker-compose command) so the commands gets executed to fill it?

For now, yes

it works, finally

Harbormaster completed remote builds in B22800: Diff 21837.Jul 28 2021, 4:18 PM

Closed by commit rDENVf4e9375c7a72: Add swh-graph to the docker environment (authored by vlorentz). · Explain WhyJul 28 2021, 4:19 PM

This revision was automatically updated to reflect the committed changes.

vlorentz added a commit: rDENVf4e9375c7a72: Add swh-graph to the docker environment.

vlorentz added inline comments.Jul 28 2021, 4:19 PM

docker/services/swh-graph/entrypoint.sh
28	that's copy pasted from objstorage and others, so kind of out of scope for this diff

vlorentz retitled this revision from Start adding swh-graph to the docker environment to Add swh-graph to the docker environment.Jul 28 2021, 4:41 PM

vlorentz added a child revision: D6042: graph: don't run export+compression unless needed, and add documentation.

vlorentz added parent revisions: D6030: server: Define make_app_from_configfile so it can be ran by gunicorn, D6038: journalprocessor: Fix deserialize_message raising EOFError on the last message of each assignment.Jul 28 2021, 4:44 PM

vlorentz added a parent revision: D6028: journalprocessor: Fix freeze on empty offset ranges..

Revision Contents
Changeset List

Path

Size

docker/

8 lines

conf/

7 lines

docker-compose.graph.yml

23 lines

docker-compose.yml

16 lines

services/

swh-graph/

33 lines

Diff 21806

docker/Dockerfile

Loading...

docker/conf/graph.yml

Loading...

docker/docker-compose.graph.yml

Loading...

docker/docker-compose.yml

Loading...

docker/services/swh-graph/entrypoint.sh

Loading...