Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 8 2023

gitlab-migration closed T2761: Install webapp counters in the staging webapp/storage as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Storage manager, Web app, Staging environment
gitlab-migration closed T2231: Continuous deployment as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020
gitlab-migration changed the status of T2817: Enable the swh-search environment in staging from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · System administrators, Staging environment, Journal, Archive search
gitlab-migration changed the status of T2816: Enable the journal-writer for the swh-idx-storage in staging from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:01 PM · System administrators, Staging environment, Journal, Archive search
gitlab-migration changed the status of T2428: Unstuck failing loaders in staging from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:30 PM · Staging environment, Core Loader

Oct 19 2022

gitlab-migration changed the status of T3915: Deploy Bzr loader to the staging environment from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:05 PM · System administration, Staging environment, BZR loader
gitlab-migration closed T3772: Fix default collation configuration on staging databases as Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:05 PM · System administration, Staging environment, Provenance database
gitlab-migration changed the status of T3380: staging - Disk errors on storage1 from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:02 PM · System administration, Staging environment
gitlab-migration changed the status of T3243: Replace /dev/sdb and /dev/sdc on storage1.staging from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:02 PM · System administration, Staging environment
gitlab-migration changed the status of T3243: Replace /dev/sdb and /dev/sdc on storage1.staging, a subtask of T3236: staging: Disk error on storage1, from Resolved to Migrated.
Oct 19 2022, 6:02 PM · System administration, Staging environment
gitlab-migration changed the status of T3236: staging: Disk error on storage1 from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:02 PM · System administration, Staging environment
gitlab-migration changed the status of T3159: Deploy swh-counters:v0.1.0 in staging from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:02 PM · Staging environment, System administration, Monitoring
gitlab-migration changed the status of T2920: Document staging infrastructure from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:00 PM · Documentation, System administration, Staging environment
gitlab-migration changed the status of T2897: [staging] kafka data dir over 80% from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:00 PM · System administration, Staging environment
gitlab-migration changed the status of T2897: [staging] kafka data dir over 80%, a subtask of T2790: [staging] deploy the journal infrastructure, from Resolved to Migrated.
Oct 19 2022, 6:00 PM · System administration, Staging environment
gitlab-migration changed the status of T2877: Investigate spurious deposit logs from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:00 PM · System administration, Staging environment, SWORD deposit
gitlab-migration changed the status of T2790: [staging] deploy the journal infrastructure from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:00 PM · System administration, Staging environment
gitlab-migration changed the status of T2790: [staging] deploy the journal infrastructure, a subtask of T2682: Deploy a small publicly available kafka server (with some content) on a staging (+ the related objstorage), from Resolved to Migrated.
Oct 19 2022, 6:00 PM · Staging environment, System administration
gitlab-migration changed the status of T2770: Fix all icinga checks on staging webapp from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:00 PM · Monitoring, System administration, Staging environment
gitlab-migration changed the status of T2682: Deploy a small publicly available kafka server (with some content) on a staging (+ the related objstorage) from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:58 PM · Staging environment, System administration
gitlab-migration changed the status of T2628: Recycle ceph-osd2 as objstorage/storage backend for staging from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:58 PM · Staging environment, System administration
gitlab-migration changed the status of T2627: Recycle ceph-osd1 as staging database host from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:58 PM · Staging environment, System administration
gitlab-migration changed the status of T1995: swh-lister: Unstuck debian build failures, a subtask of T1875: staging infra: Reproduce existing production setup in a compact way, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1876: staging infra: Configure DNS zones, a subtask of T1785: Setup staging infrastructure, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1875: staging infra: Reproduce existing production setup in a compact way, a subtask of T1785: Setup staging infrastructure, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1874: staging infra: Setup gateway vm, a subtask of T1872: staging infra: New vlan, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, Staff, System administration
gitlab-migration changed the status of T1875: staging infra: Reproduce existing production setup in a compact way from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1874: staging infra: Setup gateway vm from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1872: staging infra: New vlan from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:56 PM · Staging environment, Staff, System administration
gitlab-migration changed the status of T1872: staging infra: New vlan, a subtask of T2627: Recycle ceph-osd1 as staging database host, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1872: staging infra: New vlan, a subtask of T2628: Recycle ceph-osd2 as objstorage/storage backend for staging, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1872: staging infra: New vlan, a subtask of T1785: Setup staging infrastructure, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Staging environment, System administration
gitlab-migration changed the status of T1785: Setup staging infrastructure from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:55 PM · Staging environment, System administration
gitlab-migration changed the status of T1711: Create a testing environment, a subtask of T1785: Setup staging infrastructure, from Resolved to Migrated.
Oct 19 2022, 5:55 PM · Staging environment, System administration

Sep 9 2022

ardumont added a parent task for T2231: Continuous deployment: T4523: Dynamic infrastructure.
Sep 9 2022, 5:12 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020

Mar 25 2022

bchauvet lowered the priority of T2231: Continuous deployment from Normal to Low.
Mar 25 2022, 5:28 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020

Mar 23 2022

bchauvet added projects to T2231: Continuous deployment: Roadmap 2022, meta-task.
Mar 23 2022, 5:02 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020

Feb 18 2022

douardda updated the task description for T2231: Continuous deployment.
Feb 18 2022, 12:32 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020
douardda updated the task description for T2231: Continuous deployment.
Feb 18 2022, 12:23 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020
douardda updated the task description for T2231: Continuous deployment.
Feb 18 2022, 12:22 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020

Feb 16 2022

ardumont closed T3915: Deploy Bzr loader to the staging environment as Resolved.
Feb 16 2022, 3:15 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 16 2022, 3:14 PM · System administration, Staging environment, BZR loader

Feb 15 2022

ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

New lister did its work, 74 new origins got seen [1] [2].

Feb 15 2022, 10:14 AM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 15 2022, 10:11 AM · System administration, Staging environment, BZR loader

Feb 14 2022

ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 14 2022, 5:35 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

@Alphare fixed the sourceforge lister to list correctly bzr origins.
Tagged a v2.6.4 with that fix in the intent to deploy this on staging.

Feb 14 2022, 4:59 PM · System administration, Staging environment, BZR loader
ardumont added a revision to T3915: Deploy Bzr loader to the staging environment: D7172: sourceforge: fix support for listing bzr origins.
Feb 14 2022, 4:58 PM · System administration, Staging environment, BZR loader

Feb 11 2022

ardumont moved T3915: Deploy Bzr loader to the staging environment from in-progress to deployed/landed/monitoring on the System administration board.
Feb 11 2022, 6:11 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 11 2022, 5:58 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 11 2022, 5:57 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

And deployed.
Next step: Actually feeding them some bzr origins.
We'll need to discuss some more with @Alphare.

Feb 11 2022, 5:56 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

Of course, the build was ok, but not the actual install [1]
Another build release ongoing to fix that... [2]

Feb 11 2022, 5:48 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

After some more fight and backporting dependencies [1] [2]. The build is now happy on
stable as well [3].

Feb 11 2022, 5:47 PM · System administration, Staging environment, BZR loader

Feb 10 2022

ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

Previous one fixed.
pypi-upload job failed for some reason.
Fixed.

Feb 10 2022, 5:59 PM · System administration, Staging environment, BZR loader
ardumont added a revision to T3915: Deploy Bzr loader to the staging environment: D7150: test: Simplify test_needs_upgrade.
Feb 10 2022, 4:09 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

Yes, thanks for the heads up.

Feb 10 2022, 3:36 PM · System administration, Staging environment, BZR loader
Alphare added a comment to T3915: Deploy Bzr loader to the staging environment.

D7130 has been committed, so a new version of the loader for faster ingestion will need to be released.

Feb 10 2022, 3:28 PM · System administration, Staging environment, BZR loader

Feb 9 2022

ardumont added a revision to T3915: Deploy Bzr loader to the staging environment: D7135: tests: Reference tasks module for tests to be ok with debian build.
Feb 9 2022, 4:00 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 9 2022, 3:07 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 9 2022, 2:49 PM · System administration, Staging environment, BZR loader
ardumont added a revision to T3915: Deploy Bzr loader to the staging environment: D7132: bzr: Allow cloning with breezy version without cmd_clone function.
Feb 9 2022, 2:31 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 9 2022, 11:28 AM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.
  • Prepare the necessary debian metadata files to allow CI package build [1]
Feb 9 2022, 11:26 AM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 9 2022, 11:14 AM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

Here we go, first release is up. [1]

Feb 9 2022, 10:45 AM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

Repository configured correctly regarding the ci.
But the hook was missing on the repository.
Fixed [1].
Let's do the first release.

Feb 9 2022, 10:21 AM · System administration, Staging environment, BZR loader

Feb 8 2022

ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

loader-bzr run in docker \o/:

Feb 8 2022, 5:19 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 8 2022, 5:18 PM · System administration, Staging environment, BZR loader
ardumont added a revision to T3915: Deploy Bzr loader to the staging environment: D7124: Allow loader-bzr to run within docker.
Feb 8 2022, 5:10 PM · System administration, Staging environment, BZR loader
ardumont changed the status of T3915: Deploy Bzr loader to the staging environment from Open to Work in Progress.
Feb 8 2022, 5:08 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 8 2022, 2:55 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.
  • Make it run within docker
Feb 8 2022, 2:55 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 8 2022, 11:19 AM · System administration, Staging environment, BZR loader

Feb 7 2022

ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 7 2022, 6:14 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 7 2022, 6:13 PM · System administration, Staging environment, BZR loader
ardumont added a revision to T3915: Deploy Bzr loader to the staging environment: D7112: Deploy swh-worker@loader_bzr service to staging workers.
Feb 7 2022, 6:13 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 7 2022, 6:07 PM · System administration, Staging environment, BZR loader
ardumont updated the task description for T3915: Deploy Bzr loader to the staging environment.
Feb 7 2022, 6:06 PM · System administration, Staging environment, BZR loader
ardumont moved T3915: Deploy Bzr loader to the staging environment from Backlog to Weekly backlog on the System administration board.
Feb 7 2022, 5:54 PM · System administration, Staging environment, BZR loader
ardumont added a comment to T3915: Deploy Bzr loader to the staging environment.

We got those bzr origins currently listed in staging (and prod) infra [1].
Do they sound good enough as dataset?

Feb 7 2022, 5:50 PM · System administration, Staging environment, BZR loader
ardumont added a project to T3915: Deploy Bzr loader to the staging environment: System administration.
Feb 7 2022, 3:34 PM · System administration, Staging environment, BZR loader
ardumont triaged T3915: Deploy Bzr loader to the staging environment as Normal priority.
Feb 7 2022, 3:34 PM · System administration, Staging environment, BZR loader
Alphare added a parent task for T3915: Deploy Bzr loader to the staging environment: T3610: Bazaar/Breezy loader.
Feb 7 2022, 3:32 PM · System administration, Staging environment, BZR loader
Alphare created T3915: Deploy Bzr loader to the staging environment.
Feb 7 2022, 3:32 PM · System administration, Staging environment, BZR loader

Dec 6 2021

ardumont added projects to T3772: Fix default collation configuration on staging databases: Provenance database, Staging environment, System administration.
Dec 6 2021, 6:02 PM · System administration, Staging environment, Provenance database

Jul 29 2021

ardumont moved T3159: Deploy swh-counters:v0.1.0 in staging from in-progress to done on the System administration board.
Jul 29 2021, 1:23 PM · Staging environment, System administration, Monitoring
ardumont moved T2877: Investigate spurious deposit logs from deployed/landed/monitoring to done on the System administration board.
Jul 29 2021, 1:22 PM · System administration, Staging environment, SWORD deposit

Jul 7 2021

vsellier added a comment to T3380: staging - Disk errors on storage1.

This is the disk position according to a picture of the server taken by Christophe :

Jul 7 2021, 4:22 PM · System administration, Staging environment

Jun 14 2021

ardumont closed T3380: staging - Disk errors on storage1 as Resolved.
Jun 14 2021, 3:34 PM · System administration, Staging environment
ardumont moved T3380: staging - Disk errors on storage1 from in-progress to deployed/landed/monitoring on the System administration board.
Jun 14 2021, 3:34 PM · System administration, Staging environment
ardumont changed the status of T3380: staging - Disk errors on storage1 from Open to Work in Progress.
Jun 14 2021, 3:01 PM · System administration, Staging environment
ardumont added a comment to T3380: staging - Disk errors on storage1.

A priori, zfs did itself the replace action, selecting one spare disk in the disks spare pool.
We needed only to detach the failing one, it's done. [1]

Jun 14 2021, 3:01 PM · System administration, Staging environment
ardumont added a comment to T3380: staging - Disk errors on storage1.

Serial number:

root@storage1:~# smartctl -a /dev/disk/by-id/wwn-0x5000c500a23e4511 | grep -B1 "Serial Number"
Device Model:     ST6000NM0115-1YZ110
Serial Number:    ZAD0SDDK
Jun 14 2021, 2:43 PM · System administration, Staging environment
vsellier triaged T3380: staging - Disk errors on storage1 as High priority.
Jun 14 2021, 9:56 AM · System administration, Staging environment

May 6 2021

vsellier closed T3243: Replace /dev/sdb and /dev/sdc on storage1.staging as Resolved.

Actions performed:

  • wwn-0x5000c500d5de652a(sdb) : new -> spare
  • wwn-0x5000c500a22eed6f(sdh) : spare -> mirror
  • wwn-0x5000c500d5dda886(sdc) : new -> mirror
May 6 2021, 9:54 AM · System administration, Staging environment
vsellier closed T3243: Replace /dev/sdb and /dev/sdc on storage1.staging, a subtask of T3236: staging: Disk error on storage1, as Resolved.
May 6 2021, 9:54 AM · System administration, Staging environment
vsellier added a comment to T3243: Replace /dev/sdb and /dev/sdc on storage1.staging.

The checks ran without detecting any bad block on the disk.
They can be added on the zfs pool again.

May 6 2021, 9:33 AM · System administration, Staging environment

May 5 2021

vsellier added a comment to T3243: Replace /dev/sdb and /dev/sdc on storage1.staging.

A full badblock test is launched on both disks:

root@storage1:~# badblocks -v -w -B -s -b 4096 /dev/sdb
root@storage1:~# badblocks -v -w -B -s -b 4096 /dev/sdc
May 5 2021, 11:33 AM · System administration, Staging environment
vsellier added a comment to T3243: Replace /dev/sdb and /dev/sdc on storage1.staging.

The disk were replaced by Christophe.
Apparently, the led of one of the disk is still on, so they need to be switched off:

root@storage1:~# ls /dev/sd* | grep -e "[a-z]$" | xargs -n1 -t -i{} ledctl normal={} 
ledctl normal=/dev/sda 
ledctl normal=/dev/sdb 
ledctl normal=/dev/sdc 
ledctl normal=/dev/sdd 
ledctl normal=/dev/sde 
ledctl normal=/dev/sdf 
ledctl normal=/dev/sdg 
ledctl normal=/dev/sdh 
ledctl normal=/dev/sdi 
ledctl normal=/dev/sdj 
ledctl normal=/dev/sdk 
ledctl normal=/dev/sdl 
ledctl normal=/dev/sdm 
ledctl normal=/dev/sdn
May 5 2021, 11:02 AM · System administration, Staging environment

May 3 2021

vsellier added a comment to T3243: Replace /dev/sdb and /dev/sdc on storage1.staging.

The replacement disks were delivered at rocquencourt :

May 3 2021, 8:29 AM · System administration, Staging environment