Page MenuHomeSoftware Heritage
Feed Advanced Search

May 4 2022

vsellier requested review of D7740: Declare the rancher cluster for the deployment's internship.
May 4 2022, 4:58 PM
vsellier added a revision to T4221: Create a kubernetes cluster for the deployment experiment: D7740: Declare the rancher cluster for the deployment's internship.
May 4 2022, 4:58 PM · System administration
vsellier requested review of D7739: Declare a generic rancher-node-.* hostname matching.
May 4 2022, 4:07 PM
vsellier added a revision to T4221: Create a kubernetes cluster for the deployment experiment: D7739: Declare a generic rancher-node-.* hostname matching.
May 4 2022, 4:07 PM · System administration
vsellier committed rSENV38d0155f3f9a: Declare a rancher node to test the site.pp hostname matching (authored by vsellier).
Declare a rancher node to test the site.pp hostname matching
May 4 2022, 3:37 PM
vsellier closed T4222: backup01 disk is not large enough to handle the dali backups as Resolved.

The backup is in sync, everything is back to normal

May 4 2022, 2:27 PM · System administration
vsellier added a revision to T4132: Add the graphql service in the docker environment: D7734: Add GraphQL service to SWH environment.
May 4 2022, 12:43 PM · System administration, GraphQL API
vsellier added a task to D7734: Add GraphQL service to SWH environment: T4132: Add the graphql service in the docker environment.
May 4 2022, 12:43 PM
vsellier accepted D7734: Add GraphQL service to SWH environment.

LGTM thanks

May 4 2022, 12:40 PM
vsellier committed rSPRE1697be7f5e9e: Increase size of the backup01 data disk (authored by vsellier).
Increase size of the backup01 data disk
May 4 2022, 12:28 PM
vsellier added a comment to T4222: backup01 disk is not large enough to handle the dali backups.

Now let's restart the synchronization:

root@backup01:~# zfs destroy -r data/sync/dali/postgresql
root@backup01:~# systemctl reset-failed syncoid-dali-postgresql.service
root@backup01:~# systemctl restart syncoid-dali-postgresql.service

and the same for data/sync/dali/postgresql_wall

May 4 2022, 12:08 PM · System administration
vsellier added a comment to T4222: backup01 disk is not large enough to handle the dali backups.

The disk needed to be detached and reattached in order to be resized.
It seems zfs didn't detect the pool after the reboot.
A reimport did the work:

root@backup01:~# zpool import data
root@backup01:~# zpool list
NAME   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
data   255G   188G  66.9G        -         -     9%    73%  1.00x    ONLINE  -

(The pool is still correctly detected after a reboot)

May 4 2022, 12:01 PM · System administration
vsellier moved T4222: backup01 disk is not large enough to handle the dali backups from Backlog to in-progress on the System administration board.
May 4 2022, 11:28 AM · System administration
vsellier added a comment to T4222: backup01 disk is not large enough to handle the dali backups.

The disk is sized at 200G, according to the azure portal, it can be resized to 256 without any additional cost.

Enter the size of the disk you would like to create. You will be charged the same rate for your provisioned disk, regardless of how much of the disk space is being used For example, a 200 GiB disk is provisioned on a 256 GiB disk, so you would be billed for the 256 GiB provisioned.

May 4 2022, 11:28 AM · System administration
vsellier changed the status of T4222: backup01 disk is not large enough to handle the dali backups from Open to Work in Progress.
May 4 2022, 11:25 AM · System administration
vsellier requested changes to D7734: Add GraphQL service to SWH environment.
May 4 2022, 10:31 AM

May 3 2022

vsellier moved T4221: Create a kubernetes cluster for the deployment experiment from Backlog to in-progress on the System administration board.
May 3 2022, 5:27 PM · System administration
vsellier changed the status of T4221: Create a kubernetes cluster for the deployment experiment from Open to Work in Progress.
May 3 2022, 5:27 PM · System administration
vsellier committed rSENVdf19c80df544: Add new elastics workers facts (authored by vsellier).
Add new elastics workers facts
May 3 2022, 5:22 PM
vsellier changed the status of T4134: Package the graphql service, a subtask of T4131: Graphql service in staging, from Open to Work in Progress.
May 3 2022, 10:41 AM · System administration, GraphQL API
vsellier changed the status of T4134: Package the graphql service from Open to Work in Progress.
May 3 2022, 10:41 AM · System administration, GraphQL API
vsellier updated the diff for D6926: First iteration of prometheus export of the e2e metrics.
  • rebase
  • test the prometheus exporter file creation
May 3 2022, 10:28 AM

May 2 2022

vsellier added a member for Reviewers: amadouth6.
May 2 2022, 10:08 AM
vsellier added a member for Staff: amadouth6.
May 2 2022, 10:08 AM
vsellier added a member for Developers: amadouth6.
May 2 2022, 10:08 AM

Apr 21 2022

vsellier added a comment to T3592: POC elastic worker infrastructure.

Good news, it looks like there is no more issues with the inter-node communication with rancher 2.6.4 and bullseye.

Apr 21 2022, 8:04 PM · System administration
vsellier accepted D7607: Create elastic worker node up to rancher cluster registration.

gg ;)

Apr 21 2022, 7:39 PM
vsellier renamed T4191: Hedgedoc: websocket upgrade queries routed to grafana from Headgedoc: websocket upgrade queries routed to grafana to Hedgedoc: websocket upgrade queries routed to grafana.
Apr 21 2022, 7:24 PM · System administration
vsellier triaged T4191: Hedgedoc: websocket upgrade queries routed to grafana as High priority.
Apr 21 2022, 7:22 PM · System administration
vsellier accepted D7624: proxmox/templates: Upgrade bullseye vm to latest 11.3.
Apr 21 2022, 4:41 PM
vsellier accepted D7625: proxmox/templates: Build extra vm template with zfs tools ready.
Apr 21 2022, 4:17 PM

Apr 20 2022

vsellier updated the diff for D6926: First iteration of prometheus export of the e2e metrics.

Rebase

Apr 20 2022, 7:09 PM
vsellier accepted D7606: rancher: Bootstrap rancher declarations.
Apr 20 2022, 5:59 PM
vsellier accepted D7600: Bootstrap elastic workers role.

Thanks, we will look later how to have a better zpool initialization

Apr 20 2022, 5:48 PM
vsellier closed T3671: staging - swh-search (metadata indexer) is unable to update a document due to an unparseable date as Resolved.

There is no occurrences of this error in the logs and the consumers don't have any lag, so yes, I guess it is.

Apr 20 2022, 5:19 PM · Intrinsic metadata, Archive search
vsellier closed D7602: opam: avoid the repo management script to alway try to initialize the opam repositories.
Apr 20 2022, 4:20 PM
vsellier committed rSPSITE77d39da952be: opam: avoid the repo management script to alway try to initialize the opam… (authored by vsellier).
opam: avoid the repo management script to alway try to initialize the opam…
Apr 20 2022, 4:20 PM
vsellier updated the diff for D7602: opam: avoid the repo management script to alway try to initialize the opam repositories.

rebase

Apr 20 2022, 4:19 PM
vsellier accepted D7601: Bootstrap elastic worker node and extra work.
Apr 20 2022, 1:29 PM
vsellier requested changes to D7600: Bootstrap elastic workers role.
Apr 20 2022, 1:26 PM
vsellier added inline comments to D7600: Bootstrap elastic workers role.
Apr 20 2022, 1:26 PM
vsellier updated the summary of D7602: opam: avoid the repo management script to alway try to initialize the opam repositories.
Apr 20 2022, 12:18 PM
vsellier requested review of D7602: opam: avoid the repo management script to alway try to initialize the opam repositories.
Apr 20 2022, 12:17 PM

Apr 19 2022

vsellier added a watcher for Provenance database: vsellier.
Apr 19 2022, 4:36 PM
vsellier accepted D7595: Deploy scrubber checks on all object types and bump memory usage for those services.
Apr 19 2022, 2:55 PM

Apr 15 2022

vsellier added inline comments to D7590: Deploy swh-scrubber-checker-services to scrubber0.staging.
Apr 15 2022, 2:27 PM
vsellier triaged T4146: Test gitlab migrations in the gitlab staging instance as Normal priority.
Apr 15 2022, 9:41 AM · System administration, GitLab migration
vsellier moved T4046: Bootstrap a gitlab instance hosted on our infrastructure from in-progress to done on the System administration board.
Apr 15 2022, 9:32 AM · GitLab migration, System administration
vsellier closed T4046: Bootstrap a gitlab instance hosted on our infrastructure as Resolved.

A restoration of the azure instance on our infra was successfully performed [1].
Everything is well imported: users, repositories, issues, ...
The usage of a quick and dirty longhorn storage seems to make the instance slower than azure but the performance was not the goal of this POC.

Apr 15 2022, 9:32 AM · GitLab migration, System administration

Apr 14 2022

vsellier committed rSPRE5292d8c407a5: rancher: Create an aks cluster dedicated to rancher (authored by vsellier).
rancher: Create an aks cluster dedicated to rancher
Apr 14 2022, 6:57 PM
vsellier closed D7551: Prepare the rancher manager bootstrap.
Apr 14 2022, 6:57 PM
vsellier committed rSPRE0241d0e4514c: aks: Allow to disable the public ip provisioning (authored by vsellier).
aks: Allow to disable the public ip provisioning
Apr 14 2022, 6:57 PM
vsellier updated the diff for D7551: Prepare the rancher manager bootstrap.

rebase

Apr 14 2022, 6:57 PM

Apr 13 2022

vsellier closed D7562: Declare the rancher manager in the dns entries.
Apr 13 2022, 3:09 PM
vsellier committed rSPSITE435306667318: Declare the rancher manager in the dns entries (authored by vsellier).
Declare the rancher manager in the dns entries
Apr 13 2022, 3:09 PM
vsellier added a revision to T4046: Bootstrap a gitlab instance hosted on our infrastructure: D7562: Declare the rancher manager in the dns entries.
Apr 13 2022, 12:30 PM · GitLab migration, System administration
vsellier requested review of D7562: Declare the rancher manager in the dns entries.
Apr 13 2022, 12:30 PM
vsellier closed D7561: maven-exporter: fix the systemd reload after each puppet run.
Apr 13 2022, 9:48 AM
vsellier committed rSPSITEd72e254002ab: maven-exporter: fix the systemd reload after each puppet run (authored by vsellier).
maven-exporter: fix the systemd reload after each puppet run
Apr 13 2022, 9:48 AM
vsellier requested review of D7561: maven-exporter: fix the systemd reload after each puppet run.
Apr 13 2022, 9:14 AM
vsellier added a revision to T3746: staging: Deploy maven indexer/lister/loader: D7561: maven-exporter: fix the systemd reload after each puppet run.
Apr 13 2022, 9:14 AM · Maven loader, Maven lister, System administration, Archive coverage

Apr 12 2022

vsellier accepted D7556: staging: Drop poc rancher machines.

Thanks

Apr 12 2022, 2:58 PM
vsellier updated the diff for D7551: Prepare the rancher manager bootstrap.

don't provision a public ip for rancher

Apr 12 2022, 12:29 PM
vsellier updated the diff for D7551: Prepare the rancher manager bootstrap.

rebase

Apr 12 2022, 9:57 AM
vsellier requested review of D7551: Prepare the rancher manager bootstrap.
Apr 12 2022, 9:57 AM
vsellier added a revision to T4046: Bootstrap a gitlab instance hosted on our infrastructure: D7551: Prepare the rancher manager bootstrap.
Apr 12 2022, 9:57 AM · GitLab migration, System administration

Apr 11 2022

vsellier triaged T4135: staging: Deploy graphql service as Low priority.
Apr 11 2022, 11:58 AM · System administration, GraphQL API
vsellier triaged T4134: Package the graphql service as Low priority.
Apr 11 2022, 11:57 AM · System administration, GraphQL API
vsellier triaged T4132: Add the graphql service in the docker environment as Low priority.
Apr 11 2022, 11:56 AM · System administration, GraphQL API
vsellier triaged T4131: Graphql service in staging as Low priority.
Apr 11 2022, 11:56 AM · System administration, GraphQL API
vsellier renamed T4131: Graphql service in staging from Deploy Graphql service in staging to Graphql service in staging.
Apr 11 2022, 11:55 AM · System administration, GraphQL API
vsellier created T4135: staging: Deploy graphql service.
Apr 11 2022, 11:52 AM · System administration, GraphQL API
vsellier created T4134: Package the graphql service.
Apr 11 2022, 11:48 AM · System administration, GraphQL API
vsellier created T4132: Add the graphql service in the docker environment.
Apr 11 2022, 11:45 AM · System administration, GraphQL API
vsellier created T4131: Graphql service in staging.
Apr 11 2022, 11:43 AM · System administration, GraphQL API
vsellier added a watcher for GraphQL API: vsellier.
Apr 11 2022, 11:35 AM
vsellier committed rSPRE7edb55db2564: gitlab: Activate soft deletion of storage container (authored by vsellier).
gitlab: Activate soft deletion of storage container
Apr 11 2022, 9:35 AM
vsellier closed D7544: gitlab: create a storage container per application.
Apr 11 2022, 9:35 AM
vsellier committed rSPRE2630acf0415a: gitlab: create a storage container per application (authored by vsellier).
gitlab: create a storage container per application
Apr 11 2022, 9:35 AM

Apr 8 2022

vsellier updated the diff for D7544: gitlab: create a storage container per application.

Update the commit title

Apr 8 2022, 7:04 PM
vsellier retitled D7544: gitlab: create a storage container per application from gitlab: create a container per application to gitlab: create a storage container per application.
Apr 8 2022, 7:03 PM
vsellier requested review of D7544: gitlab: create a storage container per application.
Apr 8 2022, 7:01 PM
vsellier added a revision to T4046: Bootstrap a gitlab instance hosted on our infrastructure: D7544: gitlab: create a storage container per application.
Apr 8 2022, 7:01 PM · GitLab migration, System administration
vsellier updated the diff for D6926: First iteration of prometheus export of the e2e metrics.

Rebase and adapt

Apr 8 2022, 5:44 PM
vsellier accepted D7538: staging: Deploy maven lister.
Apr 8 2022, 4:53 PM
vsellier added inline comments to D7538: staging: Deploy maven lister.
Apr 8 2022, 4:47 PM
vsellier accepted D7540: staging: Deploy maven loader.
Apr 8 2022, 4:44 PM
vsellier accepted D7542: staging: Provision new maven-exporter0.internal.staging.swh.network.
Apr 8 2022, 4:42 PM
vsellier closed D7539: gitlab: Create a storage account to store the assets.
Apr 8 2022, 3:32 PM
vsellier committed rSPREb6f1b781e59b: gitlab: Create a storage account to store the assets (authored by vsellier).
gitlab: Create a storage account to store the assets
Apr 8 2022, 3:32 PM
vsellier requested review of D7539: gitlab: Create a storage account to store the assets.
Apr 8 2022, 3:02 PM
vsellier added a revision to T4046: Bootstrap a gitlab instance hosted on our infrastructure: D7539: gitlab: Create a storage account to store the assets.
Apr 8 2022, 3:02 PM · GitLab migration, System administration
vsellier accepted D7528: staging: Deploy apache service to serve extracted export.fld files.
Apr 8 2022, 2:43 PM
vsellier accepted D7527: staging: Deploy maven index exporter to extract export.fld files.
Apr 8 2022, 2:32 PM

Apr 7 2022

vsellier committed rCJSWH8f0b0ae312c7: Reduce the history of voluminous builds (authored by vsellier).
Reduce the history of voluminous builds
Apr 7 2022, 4:25 PM
vsellier closed D7507: Do not keep more than 6 months of build history for python builds.
Apr 7 2022, 4:25 PM
vsellier updated the diff for D7507: Do not keep more than 6 months of build history for python builds.

reduce the history to 90 days

Apr 7 2022, 4:24 PM
vsellier updated the diff for D7507: Do not keep more than 6 months of build history for python builds.

rebase

Apr 7 2022, 4:17 PM
vsellier added a comment to T4046: Bootstrap a gitlab instance hosted on our infrastructure.

Status update:

The token can be found on the dedicated gitlab page: https://gitlab-staging.swh.network/admin/health_check

  • outbound emails: Solved by creating a gandi's inbox and configuring the deployment to use it
Apr 7 2022, 10:34 AM · GitLab migration, System administration

Apr 6 2022

vsellier updated the diff for D7507: Do not keep more than 6 months of build history for python builds.

Thanks olasd for the feedback.

Apr 6 2022, 6:52 PM