Add waagent profile to azure worker role
ClosedPublic
Actions

Authored by ardumont on Aug 1 2022, 6:13 PM.

Details

Reviewers

olasd

Group Reviewers

System administrators

Maniphest Tasks

T4415: Improve indexer workers performance

Commits

rSPSITE580c7688b33b: Add waagent profile to azure worker role

Summary

So we are able to activate swap for indexer workers.

Related to T4415
Depends on D8169

Test Plan

bin/octo on indexer-workers adapts the swap configuration:

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff vault-worker01.euwest.azure.internal.softwareheritage.org
...
*******************************************
+ File[/etc/waagent.conf] =>
   parameters =>
     "ensure": "present",
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File_line[ResourceDisk.EnableSwap] =>
   parameters =>
     "ensure": "present",
     "line": "ResourceDisk.EnableSwap=y",
     "match": "^ResourceDisk.EnableSwap=n",
     "path": "/etc/waagent.conf"
*******************************************
+ File_line[ResourceDisk.SwapSizeMB] =>
   parameters =>
     "ensure": "present",
     "line": "ResourceDisk.SwapSizeMB=14336",
     "match": "^ResourceDisk.SwapSizeMB=0",
     "path": "/etc/waagent.conf"
*******************************************
*** End octocatalog-diff on indexer-worker01.euwest.azure.internal.softwareheritage.org

bin/octo on azure worker without configuration manages the waagent.conf without activating swap:

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff vault-worker01.euwest.azure.internal.softwareheritage.org
...
*******************************************
+ File[/etc/waagent.conf] =>
   parameters =>
     "ensure": "present",
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File_line[/etc/waagent.conf-ResourceDisk.EnableSwap] =>
   parameters =>
     "ensure": "present",
     "line": "ResourceDisk.EnableSwap=n",
     "match": "^ResourceDisk\\.EnableSwap=",
     "path": "/etc/waagent.conf"
*******************************************
+ File_line[/etc/waagent.conf-ResourceDisk.SwapSizeMB] =>
   parameters =>
     "ensure": "present",
     "line": "ResourceDisk.SwapSizeMB=0",
     "match": "^ResourceDisk\\.SwapSizeMB=",
     "path": "/etc/waagent.conf"
*******************************************
*** End octocatalog-diff on vault-worker01.euwest.azure.internal.softwareheritage.org

Diff Detail

Repository

rSPSITE puppet-swh-site

Lint

Automatic diff as part of commit; lint not applicable.

Unit

Automatic diff as part of commit; unit tests not applicable.

Event Timeline

ardumont created this revision.Aug 1 2022, 6:13 PM

Herald added a reviewer: System administrators. · View Herald TranscriptAug 1 2022, 6:13 PM

ardumont requested review of this revision.Aug 1 2022, 6:13 PM

Harbormaster completed remote builds in B30575: Diff 29505.Aug 1 2022, 6:13 PM

Let's use file_line resources instead of using a template which will be out of date 28 seconds after the change is pushed.

Let's use file_line resources instead of using a template which will be out of date 28 seconds after the change is pushed.

lol, ok.

i'm assuming then that the last line will have the expected values (when there is redundant configuration line).

ardumont edited the test plan for this revision. (Show Details)Aug 2 2022, 10:02 AM

Adapt according to suggestion

Harbormaster completed remote builds in B30577: Diff 29507.Aug 2 2022, 10:03 AM

i'm assuming then that the last line will have the expected values (when there is redundant configuration line).

It's not an append-only mode. It's more of a sed-i like behavior so even better.

ardumont retitled this revision from Add waagent profile to azure indexer worker to Add waagent profile to azure worker role.Aug 2 2022, 10:09 AM

ardumont edited the summary of this revision. (Show Details)

I would suggest only matching on line beginnings, so that we can update the values and possibly disable swap if we find it problematic.
I've added escaping of the regexps.

site-modules/profile/manifests/swh/deploy/waagent.pp
1 ↗	(On Diff #29507)	This should be a top-level profile (e.g. `profile::waagent`), as it has nothing to do with swh stuff
5–33 ↗	(On Diff #29507)	Escape the regexps, and ensure that we disable swap if the setting disappears