Page MenuHomeSoftware Heritage
Differential D7600

Bootstrap elastic workers role
ClosedPublic
Actions

Authored by ardumont on Apr 20 2022, 12:09 PM.

Details

Reviewers
vsellier
Group Reviewers
System administrators
Maniphest Tasks
T4144: Elastic worker infrastructure
Commits
rSPSITE1f9f821c3c43: Bootstrap elastic worker role
Summary

Those worker nodes should be able to run docker containers. As an implementation detail,
we mount the main docker partition as zfs volume with compression enable to keep disk
use in check. It's expected they have an extra /dev/vdb partition to be
provided (through the provisioner vagrant or terraform-proxmox).

Related to T4144

Test Plan

vagrant up and puppet agent are ok:

P1341

Diff Detail

Repository
rSPSITE puppet-swh-site
Branch
staging
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 28594
Build 44695: arc lint + arc unit

Event Timeline

ardumont created this revision.Apr 20 2022, 12:09 PM
Herald added a reviewer: System administrators. · View Herald TranscriptApr 20 2022, 12:09 PM
ardumont requested review of this revision.Apr 20 2022, 12:09 PM
Harbormaster completed remote builds in B28562: Diff 27534.Apr 20 2022, 12:09 PM
ardumont mentioned this in D7601: Bootstrap elastic worker node and extra work.Apr 20 2022, 12:11 PM
vsellier added a subscriber: vsellier.Apr 20 2022, 1:26 PM
vsellier added inline comments.
Puppetfile
212 ↗(On Diff #27534)
site-modules/profile/manifests/zfs/docker.pp
24 ↗(On Diff #27534)

as the profile is specialized for docker, it should be possible to add a dependency to configure the zfs dataset and the docker package installation to avoid to hide the previous content of '/var/lib/docker' on freshly installed servers.

vsellier requested changes to this revision.Apr 20 2022, 1:26 PM
This revision now requires changes to proceed.Apr 20 2022, 1:26 PM
ardumont updated this revision to Diff 27544.Apr 20 2022, 2:51 PM
ardumont marked an inline comment as done.

Adapt according to review

Harbormaster completed remote builds in B28570: Diff 27544.Apr 20 2022, 2:51 PM
ardumont retitled this revision from Bootstrap elastic workers' role to Bootstrap elastic workers role.Apr 20 2022, 2:52 PM
ardumont edited the summary of this revision. (Show Details)
ardumont updated this revision to Diff 27546.Apr 20 2022, 2:53 PM

reword commit message

Harbormaster completed remote builds in B28572: Diff 27546.Apr 20 2022, 2:53 PM
ardumont marked an inline comment as done.Apr 20 2022, 2:53 PM

Thanks.

ardumont mentioned this in T4144: Elastic worker infrastructure.Apr 20 2022, 4:33 PM
ardumont updated this revision to Diff 27555.Apr 20 2022, 5:01 PM

Use the correct requirement on docker

Harbormaster completed remote builds in B28583: Diff 27555.Apr 20 2022, 5:01 PM
vsellier accepted this revision.Apr 20 2022, 5:48 PM

Thanks, we will look later how to have a better zpool initialization

This revision is now accepted and ready to land.Apr 20 2022, 5:48 PM
ardumont updated this revision to Diff 27565.Apr 21 2022, 9:49 AM

rebase

Harbormaster completed remote builds in B28594: Diff 27565.Apr 21 2022, 9:49 AM
ardumont updated this revision to Diff 27567.Apr 21 2022, 9:50 AM

Rebase with the right commit range

Harbormaster completed remote builds in B28596: Diff 27567.Apr 21 2022, 9:50 AM
Closed by commit rSPSITE1f9f821c3c43: Bootstrap elastic worker role (authored by ardumont). · Explain WhyApr 21 2022, 9:52 AM
This revision was automatically updated to reflect the committed changes.
ardumont added a commit: rSPSITE1f9f821c3c43: Bootstrap elastic worker role.

Revision Contents
Changeset List

PathSize
site-modules/
role/
manifests/
1 line

Diff 27565

View Options

site-modules/role/manifests/swh_maven_index_exporter.pp

Loading...
About · Developer information · Legal