Page MenuHomeSoftware Heritage
Differential D6199

Install graph services as-is
ClosedPublic
Actions

Authored by ardumont on Sep 7 2021, 12:18 PM.

Details

Reviewers
vsellier
Group Reviewers
System administration
Maniphest Tasks
T3564: Puppetize graph service and add icinga alert
T3168: Proper deployment of swh-graph with debian package
Commits
rSPSITE8bdf0baa99fc: Install graph services as-is
Summary

As-is as in what's actually deployed in granet.

Related to T3564

Test Plan

octo-diff on granet:

bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging granet
Found host granet.internal.softwareheritage.org
...
+ File[/etc/systemd/system/swhgraphdev.service] =>
   parameters =>
      "ensure": "file"
      "group": "root"
      "mode": "0644"
      "notify": "Class[Systemd::Systemctl::Daemon_reload]"
      "owner": "root"
      "show_diff": true
      "content": >>>
# Managed by puppet class profile::swh::deploy::graph
# Changes will be overwritten

[Unit]
Description=swh graph
After=swhgraphshm.service
Requires=swhgraphshm.service

[Service]
Type=simple
User=swhworker
Group=swhworker
ExecStart=/opt/swhgraph_venv/bin/swh graph rpc-serve -g /dev/shm/swh-graph/default/graph

[Install]
WantedBy=multi-user.target
<<<
*******************************************
+ File[/etc/systemd/system/swhgraphshm.service] =>
   parameters =>
      "ensure": "file"
      "group": "root"
      "mode": "0644"
      "notify": "Class[Systemd::Systemctl::Daemon_reload]"
      "owner": "root"
      "show_diff": true
      "content": >>>
# Managed by puppet class profile::swh::deploy::graph
# Changes will be overwritten

[Unit]
Description=swh graph shm mapper

[Service]
Type=oneshot
User=swhworker
Group=swhworker
RemainAfterExit=yes
# ExecStart=/opt/swhgraph_venv/bin/swh graph cachemount --graph /srv/softwareheritage/ssd/graph/2020-05-20/compressed/graph --cache /dev/shm/swh-graph/default
ExecStart=mkdir -p /dev/shm/swh-graph/default
ExecStart=sh -c "ln -s /srv/softwareheritage/ssd/graph/2020-12-15/compressed/* /dev/shm/swh-graph/default"
ExecStart=sh -c "cp --remove-destination /srv/softwareheritage/ssd/graph/2020-12-15/compressed/graph.graph /dev/shm/swh-graph/default"
ExecStart=sh -c "cp --remove-destination /srv/softwareheritage/ssd/graph/2020-12-15/compressed/graph-transposed.graph /dev/shm/swh-graph/default"
ExecStop=rm -rf /dev/shm/swh-graph/default

[Install]
WantedBy=multi-user.target
<<<
*******************************************
+ Package[python3-venv] =>
   parameters =>
      "ensure": "present"
*******************************************
+ Service[swhgraphdev] =>
   parameters =>
      "enable": true
      "ensure": "running"
*******************************************
+ Service[swhgraphshm] =>
   parameters =>
      "enable": false
      "ensure": "present"
*******************************************
+ Systemd::Unit_file[swhgraphdev.service] =>
   parameters =>
      "ensure": "present"
      "group": "root"
      "mode": "0644"
      "notify": ["Service[swhgraphdev]"]
      "owner": "root"
      "path": "/etc/systemd/system"
      "show_diff": true
      "content": >>>
# Managed by puppet class profile::swh::deploy::graph
# Changes will be overwritten

[Unit]
Description=swh graph
After=swhgraphshm.service
Requires=swhgraphshm.service

[Service]
Type=simple
User=swhworker
Group=swhworker
ExecStart=/opt/swhgraph_venv/bin/swh graph rpc-serve -g /dev/shm/swh-graph/default/graph

[Install]
WantedBy=multi-user.target
<<<
*******************************************
+ Systemd::Unit_file[swhgraphshm.service] =>
   parameters =>
      "ensure": "present"
      "group": "root"
      "mode": "0644"
      "notify": ["Service[swhgraphshm]"]
      "owner": "root"
      "path": "/etc/systemd/system"
      "show_diff": true
      "content": >>>
# Managed by puppet class profile::swh::deploy::graph
# Changes will be overwritten

[Unit]
Description=swh graph shm mapper

[Service]
Type=oneshot
User=swhworker
Group=swhworker
RemainAfterExit=yes
# ExecStart=/opt/swhgraph_venv/bin/swh graph cachemount --graph /srv/softwareheritage/ssd/graph/2020-05-20/compressed/graph --cache /dev/shm/swh-graph/default
ExecStart=mkdir -p /dev/shm/swh-graph/default
ExecStart=sh -c "ln -s /srv/softwareheritage/ssd/graph/2020-12-15/compressed/* /dev/shm/swh-graph/default"
ExecStart=sh -c "cp --remove-destination /srv/softwareheritage/ssd/graph/2020-12-15/compressed/graph.graph /dev/shm/swh-graph/default"
ExecStart=sh -c "cp --remove-destination /srv/softwareheritage/ssd/graph/2020-12-15/compressed/graph-transposed.graph /dev/shm/swh-graph/default"
ExecStop=rm -rf /dev/shm/swh-graph/default

[Install]
WantedBy=multi-user.target
<<<
*******************************************
*** End octocatalog-diff on granet.internal.softwareheritage.org

Diff Detail

Repository
rSPSITE puppet-swh-site
Branch
staging
Lint
Lint Skipped
Unit
Unit Tests Skipped
Build Status
Buildable 23396
Build 36509: arc lint + arc unit

Event Timeline

ardumont requested review of this revision.Sep 7 2021, 12:18 PM
ardumont created this revision.
Harbormaster completed remote builds in B23394: Diff 22445.Sep 7 2021, 12:18 PM
ardumont updated this revision to Diff 22447.Sep 7 2021, 12:20 PM

Drop the icinga checks part, moved it in D6200

Harbormaster completed remote builds in B23396: Diff 22447.Sep 7 2021, 12:20 PM
ardumont added a reviewer: System administration.Sep 7 2021, 12:21 PM
ardumont retitled this revision from Install graph services as-is and add icinga checks to Install graph services as-is.
ardumont edited the summary of this revision. (Show Details)
ardumont added a child revision: D6200: Add icinga checks around the graph service.Sep 7 2021, 12:24 PM
ardumont mentioned this in T3564: Puppetize graph service and add icinga alert.Sep 7 2021, 12:33 PM
ardumont edited the summary of this revision. (Show Details)Sep 7 2021, 1:48 PM
ardumont added a task: T3564: Puppetize graph service and add icinga alert.
vsellier accepted this revision.Sep 8 2021, 2:22 PM
vsellier added a subscriber: vsellier.

LGTM

This revision is now accepted and ready to land.Sep 8 2021, 2:22 PM
ardumont updated this revision to Diff 22504.Sep 9 2021, 10:31 AM

Rebase

Harbormaster completed remote builds in B23454: Diff 22504.Sep 9 2021, 10:32 AM
Closed by commit rSPSITE8bdf0baa99fc: Install graph services as-is (authored by ardumont). · Explain WhySep 9 2021, 10:38 AM
This revision was automatically updated to reflect the committed changes.
ardumont added a commit: rSPSITE8bdf0baa99fc: Install graph services as-is.

Revision Contents
Changeset List

PathSize
data/
common/
5 lines
site-modules/
profile/
manifests/
swh/
deploy/
41 lines
templates/
swh/
deploy/
graph/
16 lines
20 lines
role/
manifests/
1 line

Diff 22447

View Options

data/common/common.yaml

Loading...
View Options

site-modules/profile/manifests/swh/deploy/graph.pp

Loading...
View Options

site-modules/profile/templates/swh/deploy/graph/swhgraphdev.service.erb

Loading...
View Options

site-modules/profile/templates/swh/deploy/graph/swhgraphshm.service.erb

Loading...
View Options

site-modules/role/manifests/swh_graph_backend.pp

Loading...
About · Developer information · Legal