Page MenuHomeSoftware Heritage
Create Task
Maniphest T1936

integrate swh-graph into the docker environment
Closed, MigratedEdits Locked
Actions

Description

Ideally, docker-compose should also start the swh-graph service. It is not clear how to do that without an already compressed graph though.

Maybe we should start it by default on the compressed test data that are available in swh-graph (which will allow to play with the API, at least), and offer a way to reload a compressed graph that will come later?

Revisions and Commits

rDGRPH Compressed graph representation
D6030rDGRPH90d1109c5103 server: Define make_app_from_configfile so it can be ran by gunicorn
rDENV Development environment
D6042rDENV122eb0d250e6 graph: don't run export+compression unless needed, and add documentation
D6029rDENVf4e9375c7a72 Add swh-graph to the docker environment
rDDATASET Datasets
ClosedD6038 journalprocessor: Fix deserialize_message raising EOFError on the last message of each assignment
ClosedD6028 journalprocessor: Fix freeze on empty offset ranges.
rDDATASETec636d4957c5 journalprocessor: Show which step is running on progress bar lines

Related Objects

Event Timeline

zack triaged this task as Wishlist priority.Jul 28 2019, 6:56 PM
zack created this task.
vlorentz mentioned this in D6029: Add swh-graph to the docker environment.Jul 27 2021, 4:05 PM
vlorentz claimed this task.Jul 27 2021, 5:37 PM
vlorentz added revisions: D6029: Add swh-graph to the docker environment, D6030: server: Define make_app_from_configfile so it can be ran by gunicorn.
vlorentz added a revision: D6028: journalprocessor: Fix freeze on empty offset ranges..
vlorentz added a commit: rDDATASETec636d4957c5: journalprocessor: Show which step is running on progress bar lines.
vlorentz added a comment.Jul 27 2021, 5:39 PM

I decided to make the swh-graph container create the compressed graph itself before starting. That's the easiest way to use it AND to implement it IMO.

ardumont added a subscriber: ardumont.Jul 28 2021, 10:37 AM

Plus that documents it a bit in an automatic manner, so *thumbs up*.

vlorentz added a commit: rDENVf4e9375c7a72: Add swh-graph to the docker environment.Jul 28 2021, 4:19 PM
vlorentz added revisions: D6042: graph: don't run export+compression unless needed, and add documentation, D6038: journalprocessor: Fix deserialize_message raising EOFError on the last message of each assignment.Jul 28 2021, 4:44 PM
vlorentz added a commit: rDENV122eb0d250e6: graph: don't run export+compression unless needed, and add documentation.Jul 29 2021, 10:15 AM
vlorentz added a commit: rDGRPH90d1109c5103: server: Define make_app_from_configfile so it can be ran by gunicorn.Jul 29 2021, 11:53 AM
vlorentz closed this task as Resolved.Jul 29 2021, 3:51 PM
zack moved this task from Backlog to Deployed on the Compressed graph service board.Dec 1 2021, 4:38 PM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 9:59 PM
gitlab-migration claimed this task.
gitlab-migration added subscribers: vlorentz, gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal