Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 6 2022

vsellier accepted D7508: Make the docker image extract and publish the export.fld directly.
Apr 6 2022, 11:42 AM
vsellier accepted D7511: build-docker-image: Introduce a testing stage.
Apr 6 2022, 10:08 AM
vsellier accepted D7509: maven-index-exporter: Update tests to check the image behavior.
Apr 6 2022, 10:07 AM

Apr 5 2022

vsellier retitled D7507: Do not keep more than 6 months of build history for python builds from Do not keep more the 6 months of build history for python builds to Do not keep more than 6 months of build history for python builds.
Apr 5 2022, 6:40 PM
vsellier updated the diff for D7507: Do not keep more than 6 months of build history for python builds.

Fix a typo on the title

Apr 5 2022, 6:40 PM
vsellier requested review of D7507: Do not keep more than 6 months of build history for python builds.
Apr 5 2022, 6:36 PM

Apr 4 2022

vsellier accepted D7494: staging: Install new scrubber db in db1.staging.
Apr 4 2022, 5:54 PM

Apr 1 2022

vsellier closed D7488: aks: ensure there is a static ip assigned to the cluster.
Apr 1 2022, 6:19 PM
vsellier committed rSPREc7097d2af599: aks: ensure there is a static ip assigned to the cluster (authored by vsellier).
aks: ensure there is a static ip assigned to the cluster
Apr 1 2022, 6:19 PM
vsellier updated the summary of D7488: aks: ensure there is a static ip assigned to the cluster.
Apr 1 2022, 6:14 PM
vsellier added a revision to T4046: Bootstrap a gitlab instance hosted on our infrastructure: D7488: aks: ensure there is a static ip assigned to the cluster.
Apr 1 2022, 6:10 PM · GitLab migration, System administration
vsellier requested review of D7488: aks: ensure there is a static ip assigned to the cluster.
Apr 1 2022, 6:10 PM
vsellier accepted D7485: swh-build-docker-image: Use simple string TAG parameter.
Apr 1 2022, 3:50 PM
vsellier accepted D7479: Create job template to build docker image.
Apr 1 2022, 12:00 PM
vsellier accepted D7482: docs/index: Reference the actual roadmap-2022 file in the index toc.

LTGM for what it's worth ;)

Apr 1 2022, 11:13 AM
vsellier committed rSPRE0b4fd9f1cc8a: aks: Don't specify the default number of nodes on an autoscaled pool (authored by vsellier).
aks: Don't specify the default number of nodes on an autoscaled pool
Apr 1 2022, 9:14 AM
vsellier requested changes to D7479: Create job template to build docker image.
Apr 1 2022, 8:32 AM

Mar 30 2022

vsellier closed T4045: Create a automatic report of the azure consumption as Resolved.

The site is deployed and available at https://azure-billing.internal.admin.swh.network/

Mar 30 2022, 4:58 PM · System administration
vsellier committed rSPRE06f5c400ed47: Create the azure billing reporting server (authored by vsellier).
Create the azure billing reporting server
Mar 30 2022, 4:44 PM
vsellier closed D7459: Create the azure billing reporting server.
Mar 30 2022, 4:44 PM
vsellier updated the diff for D7459: Create the azure billing reporting server.

add the tfstate update after the creation of the server

Mar 30 2022, 4:43 PM
vsellier closed D7474: Add the cname for the azure-billing report site.
Mar 30 2022, 4:35 PM
vsellier committed rSPSITE1d7570ee1960: Add the cname for the azure-billing report site (authored by vsellier).
Add the cname for the azure-billing report site
Mar 30 2022, 4:35 PM
vsellier requested review of D7474: Add the cname for the azure-billing report site.
Mar 30 2022, 4:34 PM
vsellier added a revision to T4045: Create a automatic report of the azure consumption: D7474: Add the cname for the azure-billing report site.
Mar 30 2022, 4:34 PM · System administration
vsellier closed D7457: azure billing: export the report pages through an apache site.
Mar 30 2022, 3:32 PM
vsellier committed rSPSITE2df19018de02: azure billing: export the report pages through an apache site (authored by vsellier).
azure billing: export the report pages through an apache site
Mar 30 2022, 3:32 PM
vsellier closed T4117: Storage metrics not refreshed as Resolved.

Thanks olasd for restarting the service following this documentation: https://docs.gunicorn.org/en/stable/signals.html#upgrading-to-a-new-binary-on-the-fly

First, replace the old binary with a new one, then send a USR2 signal to the current master process. It executes a new binary whose PID file is postfixed with .2 (e.g. /var/run/gunicorn.pid.2), which in turn starts a new master process and new worker processes:
At this point, two instances of Gunicorn are running, handling the incoming requests together. To phase the old instance out, you have to send a WINCH signal to the old master process, and its worker processes will start to gracefully shut down.

Mar 30 2022, 11:51 AM · Storage manager, System administration
vsellier added a comment to T4117: Storage metrics not refreshed.

Sorry the description was not completely clear
The durations metrics are still updated, but not the operations count ones
In 2 metrics at 10 minutes of interval:

vsellier@saam ~ % ls -al /tmp/m[12]              
-rw-r--r-- 1 vsellier vsellier 176850 Mar 30 07:25 /tmp/m1
-rw-r--r-- 1 vsellier vsellier 176846 Mar 30 07:34 /tmp/m2
Mar 30 2022, 10:17 AM · Storage manager, System administration
vsellier renamed T4117: Storage metrics not refreshed from Storage metrics not updated to Storage metrics not refreshed.
Mar 30 2022, 10:02 AM · Storage manager, System administration
vsellier changed the status of T4117: Storage metrics not refreshed from Open to Work in Progress.
Mar 30 2022, 10:01 AM · Storage manager, System administration

Mar 29 2022

vsellier abandoned D7356: azure: add a tool to generate a billing report.

the scripts finally land in the puppet repository (D7456)

Mar 29 2022, 6:37 PM
vsellier updated the test plan for D7459: Create the azure billing reporting server.
Mar 29 2022, 5:53 PM
vsellier committed rSPPRIVCdca28de43124: Add azure billing credentials + sync with private entries (authored by vsellier).
Add azure billing credentials + sync with private entries
Mar 29 2022, 5:42 PM
vsellier closed D7456: azure billing: Deploy the report generation script.
Mar 29 2022, 5:40 PM
vsellier committed rSPSITE42ce41cc3bfd: azure billing: Deploy the report generation script (authored by vsellier).
azure billing: Deploy the report generation script
Mar 29 2022, 5:40 PM
vsellier added inline comments to D7460: docker/build_image.sh: Add script to build/ push to docker registry.
Mar 29 2022, 5:22 PM
vsellier requested changes to D7460: docker/build_image.sh: Add script to build/ push to docker registry.
Mar 29 2022, 5:08 PM
vsellier added a revision to T4045: Create a automatic report of the azure consumption: D7459: Create the azure billing reporting server.
Mar 29 2022, 4:19 PM · System administration
vsellier requested review of D7459: Create the azure billing reporting server.
Mar 29 2022, 4:19 PM
vsellier committed rSPRE11238545fe50: Refresh admin terraform.state according the reality of the proxmox cluster (authored by vsellier).
Refresh admin terraform.state according the reality of the proxmox cluster
Mar 29 2022, 4:16 PM
vsellier requested review of D7457: azure billing: export the report pages through an apache site.
Mar 29 2022, 3:41 PM
vsellier added a revision to T4045: Create a automatic report of the azure consumption: D7457: azure billing: export the report pages through an apache site.
Mar 29 2022, 3:41 PM · System administration
vsellier updated the diff for D7456: azure billing: Deploy the report generation script.

Remove useless debug logs leaking the azure credentials

Mar 29 2022, 3:36 PM
vsellier committed rSENV8d0df10aac83: Declare the azure billing report vm (authored by vsellier).
Declare the azure billing report vm
Mar 29 2022, 3:25 PM
vsellier added a watcher for Compressed graph service: vsellier.
Mar 29 2022, 3:17 PM
vsellier requested review of D7456: azure billing: Deploy the report generation script.
Mar 29 2022, 2:38 PM
vsellier added a revision to T4045: Create a automatic report of the azure consumption: D7456: azure billing: Deploy the report generation script.
Mar 29 2022, 2:38 PM · System administration

Mar 24 2022

vsellier added a comment to T4046: Bootstrap a gitlab instance hosted on our infrastructure.

The test instance can be reached at https://gitlab-staging.swh.network

Mar 24 2022, 7:32 PM · GitLab migration, System administration
vsellier closed D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 24 2022, 4:30 PM
vsellier committed rSPRE3b97e0d571cc: azure: allow to configure a kubernetes cluster for a gitlab hosting (authored by vsellier).
azure: allow to configure a kubernetes cluster for a gitlab hosting
Mar 24 2022, 4:30 PM
vsellier added a comment to D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.

The diff is now ready to be reviewed.
We will start with a manual deployment in a first time

Mar 24 2022, 12:16 PM
vsellier updated the summary of D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 24 2022, 12:04 PM
vsellier retitled D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting from [wip] azure: allow to configure a kubernetes cluster for a gitlab hosting to azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 24 2022, 12:03 PM
vsellier updated the diff for D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.

split gitlab installation from the aks configuration

Mar 24 2022, 8:28 AM

Mar 23 2022

vsellier updated the diff for D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.

same

Mar 23 2022, 7:17 PM
vsellier updated the diff for D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.

fix output typos

Mar 23 2022, 7:16 PM
vsellier updated the test plan for D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 23 2022, 7:15 PM
vsellier updated the test plan for D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 23 2022, 7:15 PM
vsellier requested review of D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 23 2022, 7:14 PM
vsellier added a revision to T4046: Bootstrap a gitlab instance hosted on our infrastructure: D7419: azure: allow to configure a kubernetes cluster for a gitlab hosting.
Mar 23 2022, 7:14 PM · GitLab migration, System administration
vsellier accepted D7412: Adapt run_full_export according to swh cli conventions.

a couple of non-blocking remarks in lined

Mar 23 2022, 4:26 PM
vsellier closed D7410: Update azurerm module to last 2.99.0 version.
Mar 23 2022, 9:19 AM
vsellier committed rSPRE2ebcc6fd885f: Update azurerm module to last 2.99.0 version (authored by vsellier).
Update azurerm module to last 2.99.0 version
Mar 23 2022, 9:19 AM

Mar 22 2022

vsellier added a comment to D7412: Adapt run_full_export according to swh cli conventions.

other more general points, not directly relative to this diff:

  • the image should be build from adoptopenjdk/openjdk11:debian-jre or any debian based image
  • The user used in the container seems to be root, doesn't it generate some permissions issues in the temporary directory?
Mar 22 2022, 8:13 PM
vsellier requested review of D7410: Update azurerm module to last 2.99.0 version.
Mar 22 2022, 5:19 PM
vsellier updated the diff for D7356: azure: add a tool to generate a billing report.
  • Review feedbacks
  • Add a report generation in html + an index page
  • Add a nginx container to export the html files
  • Use a docker volume to avoid permission issues in the output directory
  • Ensure the csv is downloaded each time a docker-compose up is launched
  • use the requirements.txt file to install the dependencies in the image
Mar 22 2022, 3:58 PM

Mar 21 2022

vsellier added a comment to T4046: Bootstrap a gitlab instance hosted on our infrastructure.

The following installation methods were tested:

  1. debian packages
  2. docker image
  3. helm charts
  4. gitlab operator
Mar 21 2022, 4:01 PM · GitLab migration, System administration

Mar 17 2022

vsellier added a project to T2225: Migrate to GitLab: GitLab migration.
Mar 17 2022, 11:21 AM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020

Mar 16 2022

vsellier added a comment to T4045: Create a automatic report of the azure consumption.

A working poc is implemented in the snippet repository for now.

Mar 16 2022, 11:23 AM · System administration
vsellier changed the status of T4046: Bootstrap a gitlab instance hosted on our infrastructure from Open to Work in Progress.
Mar 16 2022, 11:19 AM · GitLab migration, System administration
vsellier added a comment to D7356: azure: add a tool to generate a billing report.

btw: This is some examples of the output of the script: P1312

Mar 16 2022, 11:15 AM
vsellier added a watcher for GitLab migration: vsellier.
Mar 16 2022, 10:28 AM
vsellier updated the diff for D7356: azure: add a tool to generate a billing report.

Remove useless commented code

Mar 16 2022, 9:57 AM
vsellier added a revision to T4045: Create a automatic report of the azure consumption: D7356: azure: add a tool to generate a billing report.
Mar 16 2022, 9:54 AM · System administration
vsellier requested review of D7356: azure: add a tool to generate a billing report.
Mar 16 2022, 9:54 AM
vsellier changed the status of T4045: Create a automatic report of the azure consumption from Open to Work in Progress.
Mar 16 2022, 9:23 AM · System administration

Mar 14 2022

vsellier committed rSPRE6ca24e0104a9: fix a minor typo (authored by vsellier).
fix a minor typo
Mar 14 2022, 1:44 PM
vsellier closed D7220: backups: Add an azure backup vm.
Mar 14 2022, 1:40 PM
vsellier committed rSPREa8a9c4ced4e0: backups: Add an azure backup vm (authored by vsellier).
backups: Add an azure backup vm
Mar 14 2022, 1:40 PM
vsellier accepted D7334: Create remote internship account for andreystar.
Mar 14 2022, 10:47 AM

Mar 11 2022

vsellier committed rSPSITEe46da1a89a82: webapp: the sync_mailmaps command needs to be configured to use the main… (authored by vsellier).
webapp: the sync_mailmaps command needs to be configured to use the main…
Mar 11 2022, 4:31 PM
vsellier closed D7341: admin db: reduce the backup history.
Mar 11 2022, 4:31 PM
vsellier committed rSPSITE871fa30df692: admin db: reduce the backup history (authored by vsellier).
admin db: reduce the backup history
Mar 11 2022, 4:31 PM
vsellier requested review of D7341: admin db: reduce the backup history.
Mar 11 2022, 3:16 PM
vsellier closed D7340: webapp: use the postgresql replica to avoid timeouts.
Mar 11 2022, 2:51 PM
vsellier committed rSPSITEb21e12348fd2: webapp: use the postgresql replica to avoid timeouts (authored by vsellier).
webapp: use the postgresql replica to avoid timeouts
Mar 11 2022, 2:51 PM
vsellier requested review of D7340: webapp: use the postgresql replica to avoid timeouts.
Mar 11 2022, 2:06 PM
vsellier added a watcher for Storage manager: vsellier.
Mar 11 2022, 10:58 AM
vsellier added a comment to T4029: create vpn and unix account for Andrey to access granet.

@zack Do you know when the internship will end? (to schedule a reminder for the account removal)

Mar 11 2022, 10:05 AM · System administration
vsellier closed D7335: docker: Cleanup docker volumes at the end of the tests.
Mar 11 2022, 9:56 AM
vsellier committed rDENV00705e8a75fe: docker: Cleanup docker volumes at the end of the tests (authored by vsellier).
docker: Cleanup docker volumes at the end of the tests
Mar 11 2022, 9:56 AM
vsellier requested review of D7335: docker: Cleanup docker volumes at the end of the tests.
Mar 11 2022, 9:45 AM

Mar 10 2022

vsellier added inline comments to D7327: api: Add endpoint to update an add-forge request.
Mar 10 2022, 8:21 PM
vsellier added inline comments to D7327: api: Add endpoint to update an add-forge request.
Mar 10 2022, 7:55 PM

Mar 9 2022

vsellier added a watcher for Add Forge Now : vsellier.
Mar 9 2022, 10:35 AM

Mar 8 2022

vsellier accepted D7310: Add a moderator role for add forge now.
Mar 8 2022, 12:02 PM

Feb 24 2022

vsellier closed T3889: Admin database backup as Resolved.

The replication is in place:

root@backup01:~# zfs list -t all
NAME                                                                 USED  AVAIL     REFER  MOUNTPOINT
data                                                                 120G  72.5G       96K  none
data/sync                                                            120G  72.5G       96K  none
data/sync/dali                                                       120G  72.5G       96K  none
data/sync/dali/postgresql                                            120G  72.5G     73.2G  none
data/sync/dali/postgresql@autosnap_2022-02-08_19:04:44_monthly      22.9G      -     72.3G  -
data/sync/dali/postgresql@autosnap_2022-02-18_00:00:01_daily        3.11G      -     73.2G  -
data/sync/dali/postgresql@autosnap_2022-02-19_00:00:01_daily        2.43G      -     73.2G  -
data/sync/dali/postgresql@autosnap_2022-02-20_00:00:01_daily        2.39G      -     73.2G  -
data/sync/dali/postgresql@autosnap_2022-02-21_00:00:01_daily        2.44G      -     73.2G  -
data/sync/dali/postgresql@autosnap_2022-02-22_00:00:00_daily        2.47G      -     73.2G  -
data/sync/dali/postgresql@autosnap_2022-02-23_00:00:02_daily        2.56G      -     73.2G  -
data/sync/dali/postgresql@autosnap_2022-02-24_00:00:00_daily           0B      -     73.2G  -
data/sync/dali/postgresql/wal                                        600M  72.5G     88.4M  none
data/sync/dali/postgresql/wal@autosnap_2022-02-08_19:04:44_monthly  61.9M      -     61.9M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-18_00:00:01_daily    90.9M      -      107M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-19_00:00:01_daily    94.7M      -      111M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-20_00:00:01_daily    55.4M      -     87.5M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-21_00:00:01_daily    50.1M      -     98.2M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-22_00:00:00_daily    57.7M      -      106M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-23_00:00:02_daily    52.8M      -     68.8M  -
data/sync/dali/postgresql/wal@autosnap_2022-02-24_00:00:00_daily       0B      -     88.4M  -

The retention will 2 monthly snapshots and 30 daily snapshots
The space occupation should be just around 200Go so we will probably have to extend a little the data disk.

Feb 24 2022, 6:24 PM · System administration
vsellier closed D7246: sanoid: Add the configuration to manage the snapshot retention on backup01.
Feb 24 2022, 4:43 PM
vsellier committed rSPSITEe5ca853821e6: sanoid: Add the configuration to manage the snapshot retention on backup01 (authored by vsellier).
sanoid: Add the configuration to manage the snapshot retention on backup01
Feb 24 2022, 4:43 PM