Page MenuHomeSoftware Heritage
Feed Advanced Search

Thu, Dec 2

vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Dec 2, 6:23 PM · System administration (Component upgrades)
vsellier closed D6736: kafka: remove the physical interface declaration.
Thu, Dec 2, 5:40 PM
vsellier committed rSPSITEca930fb95203: kafka: remove the physical interface declaration (authored by vsellier).
kafka: remove the physical interface declaration
Thu, Dec 2, 5:40 PM
vsellier requested review of D6736: kafka: remove the physical interface declaration.
Thu, Dec 2, 5:38 PM
vsellier added a revision to T3762: Upgrade kafka nodes to bullseye: D6736: kafka: remove the physical interface declaration.
Thu, Dec 2, 5:38 PM · System administration (Component upgrades)
vsellier closed D6733: kafka: remove the physical interface declaration.
Thu, Dec 2, 5:22 PM
vsellier committed rSPSITE40bbfa808515: kafka: remove the physical interface declaration (authored by vsellier).
kafka: remove the physical interface declaration
Thu, Dec 2, 5:22 PM
vsellier requested review of D6733: kafka: remove the physical interface declaration.
Thu, Dec 2, 5:16 PM
vsellier added a revision to T3762: Upgrade kafka nodes to bullseye: D6733: kafka: remove the physical interface declaration.
Thu, Dec 2, 5:16 PM · System administration (Component upgrades)
vsellier closed D6732: kafka: remove the physical interface declaration.
Thu, Dec 2, 4:43 PM
vsellier committed rSPSITEd8bd43fcacc6: kafka: remove the physical interface declaration (authored by vsellier).
kafka: remove the physical interface declaration
Thu, Dec 2, 4:43 PM
vsellier requested review of D6732: kafka: remove the physical interface declaration.
Thu, Dec 2, 4:39 PM
vsellier added a revision to T3762: Upgrade kafka nodes to bullseye: D6732: kafka: remove the physical interface declaration.
Thu, Dec 2, 4:39 PM · System administration (Component upgrades)
vsellier updated the task description for T3762: Upgrade kafka nodes to bullseye.
Thu, Dec 2, 3:49 PM · System administration (Component upgrades)
vsellier updated the task description for T3762: Upgrade kafka nodes to bullseye.
Thu, Dec 2, 3:38 PM · System administration (Component upgrades)
vsellier closed D6728: debian: prepare the kafka servers upgrade.
Thu, Dec 2, 3:04 PM
vsellier committed rSPSITEf752bfd2658d: debian: prepare the kafka servers upgrade (authored by vsellier).
debian: prepare the kafka servers upgrade
Thu, Dec 2, 3:04 PM
vsellier requested review of D6728: debian: prepare the kafka servers upgrade.
Thu, Dec 2, 2:49 PM
vsellier added a revision to T3762: Upgrade kafka nodes to bullseye: D6728: debian: prepare the kafka servers upgrade.
Thu, Dec 2, 2:49 PM · System administration (Component upgrades)
vsellier committed rSENVdec312429e19: vagrant: declare production kafka nodes (authored by vsellier).
vagrant: declare production kafka nodes
Thu, Dec 2, 12:49 PM
vsellier committed rSENV0eb1f25cf338: Upgrade migrated boxes to bullseye (authored by vsellier).
Upgrade migrated boxes to bullseye
Thu, Dec 2, 12:49 PM
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Dec 2, 10:49 AM · System administration (Component upgrades)
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Dec 2, 10:48 AM · System administration (Component upgrades)
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Dec 2, 10:37 AM · System administration (Component upgrades)
vsellier updated the task description for T3762: Upgrade kafka nodes to bullseye.
Thu, Dec 2, 10:37 AM · System administration (Component upgrades)
vsellier changed the status of T3762: Upgrade kafka nodes to bullseye from Open to Work in Progress.
Thu, Dec 2, 10:13 AM · System administration (Component upgrades)
vsellier closed T3357: Perform some tests of the cassandra storage on Grid5000, a subtask of T1892: Cassandra as a storage backend, as Resolved.
Thu, Dec 2, 10:10 AM · meta-task, Storage manager
vsellier closed T3357: Perform some tests of the cassandra storage on Grid5000 as Resolved.

The slide of the restrospective of the experiment are available at : https://hedgedoc.softwareheritage.org/VOP9qh1MTqm4DjPQfFgNbQ

Thu, Dec 2, 10:10 AM · System administration, Storage manager
vsellier closed T3573: [cassandra] directory and content read benchmarks, a subtask of T3357: Perform some tests of the cassandra storage on Grid5000, as Resolved.
Thu, Dec 2, 10:08 AM · System administration, Storage manager
vsellier closed T3573: [cassandra] directory and content read benchmarks as Resolved.

It was not easy to know if it's a lot of call or long running calls because it's regular sample and we don't have this granularity.

Thu, Dec 2, 10:08 AM · System administration, Storage manager

Wed, Dec 1

vsellier updated the task description for T3706: (Minor) upgrade Opnsense to 21.1.9.
Wed, Dec 1, 1:14 PM · System administration (Component upgrades)

Mon, Nov 29

vsellier accepted D6703: Decomission old vault nodes (orangerie and orangeriedev).

LGTM

Mon, Nov 29, 12:09 PM

Fri, Nov 26

vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Fri, Nov 26, 6:52 PM · System administration (Component upgrades)
vsellier closed T3751: Upgrade swh-search elasticsearch servers to bullseye , a subtask of T3579: Meta-task: upgrade infrastructure to Debian Bullseye, as Resolved.
Fri, Nov 26, 5:52 PM · System administration (Component upgrades)
vsellier closed T3751: Upgrade swh-search elasticsearch servers to bullseye as Resolved.

All the production nodes (`search-esnode[4-6]') are upgraded to bullseye

Fri, Nov 26, 5:52 PM · System administration (Component upgrades)
vsellier closed T3750: Upgrade ELK stack to bullseye, a subtask of T3579: Meta-task: upgrade infrastructure to Debian Bullseye, as Resolved.
Fri, Nov 26, 1:58 PM · System administration (Component upgrades)
vsellier closed T3750: Upgrade ELK stack to bullseye as Resolved.

All the nodes are updated

Fri, Nov 26, 1:58 PM · System administration (Component upgrades)
vsellier moved T3750: Upgrade ELK stack to bullseye from Backlog to In progress on the System administration (Component upgrades) board.
Fri, Nov 26, 9:39 AM · System administration (Component upgrades)
vsellier edited projects for T3750: Upgrade ELK stack to bullseye, added: System administration (Component upgrades); removed System administration.
Fri, Nov 26, 9:39 AM · System administration (Component upgrades)
vsellier moved T3751: Upgrade swh-search elasticsearch servers to bullseye from Backlog to In progress on the System administration (Component upgrades) board.
Fri, Nov 26, 9:38 AM · System administration (Component upgrades)
vsellier added a comment to T3751: Upgrade swh-search elasticsearch servers to bullseye .
  • search-esnode0 updated without errors
Fri, Nov 26, 9:38 AM · System administration (Component upgrades)
vsellier updated the task description for T3751: Upgrade swh-search elasticsearch servers to bullseye .
Fri, Nov 26, 9:36 AM · System administration (Component upgrades)
vsellier changed the status of T3751: Upgrade swh-search elasticsearch servers to bullseye from Open to Work in Progress.
Fri, Nov 26, 8:55 AM · System administration (Component upgrades)

Thu, Nov 25

vsellier added a comment to T3750: Upgrade ELK stack to bullseye.

The upgrade by itself was made with the same command as explained previously.
The shard allocation was disabled during the process to avoid unnecessary movements of shard in the cluster

Thu, Nov 25, 7:19 PM · System administration (Component upgrades)
vsellier added a comment to T3750: Upgrade ELK stack to bullseye.
  1. kibana0
  2. The server was updated using the same procedure used for logstash0
  3. there is no error detected when puppet is running
  4. all the services are correctly started
Thu, Nov 25, 3:52 PM · System administration (Component upgrades)
vsellier updated subscribers of T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Nov 25, 2:59 PM · System administration (Component upgrades)
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Nov 25, 2:58 PM · System administration (Component upgrades)
vsellier added a comment to T3750: Upgrade ELK stack to bullseye.
  1. logstash0 upgrade
Thu, Nov 25, 2:50 PM · System administration (Component upgrades)
vsellier closed D6689: logstash: remove unecessary dependency to the openjdk package.
Thu, Nov 25, 2:23 PM
vsellier committed rSPSITE668a23c476c8: logstash: remove unecessary dependency to the openjdk package (authored by vsellier).
logstash: remove unecessary dependency to the openjdk package
Thu, Nov 25, 2:23 PM
vsellier requested review of D6689: logstash: remove unecessary dependency to the openjdk package.
Thu, Nov 25, 12:37 PM
vsellier added a revision to T3750: Upgrade ELK stack to bullseye: D6689: logstash: remove unecessary dependency to the openjdk package.
Thu, Nov 25, 12:37 PM · System administration (Component upgrades)
vsellier updated subscribers of T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Thu, Nov 25, 9:53 AM · System administration (Component upgrades)
vsellier changed the status of T3750: Upgrade ELK stack to bullseye from Open to Work in Progress.
Thu, Nov 25, 9:53 AM · System administration (Component upgrades)

Wed, Nov 24

vsellier closed T3741: swh-search - upgrade elasticsearch backend as Resolved.
Wed, Nov 24, 6:11 PM · System administration, Archive search
vsellier added a comment to T3741: swh-search - upgrade elasticsearch backend.

production nodes are upgraded :
For each node :

  • disable shard allocation:
cat > /tmp/shard_allocation.json <<EOF
{
  "persistent": {
    "cluster.routing.allocation.enable": "primaries"
  }
}
EOF
Wed, Nov 24, 5:26 PM · System administration, Archive search
vsellier closed D6682: swh-search: Upgrade elasticsearch to 7.15.2.
Wed, Nov 24, 5:22 PM
vsellier committed rSPSITE3c6fdbb59608: swh-search: Upgrade elasticsearch to 7.15.2 (authored by vsellier).
swh-search: Upgrade elasticsearch to 7.15.2
Wed, Nov 24, 5:22 PM
vsellier updated the diff for D6682: swh-search: Upgrade elasticsearch to 7.15.2.

rebase

Wed, Nov 24, 5:20 PM
vsellier closed D6685: swh-search: upgrade elasticsearch to 7.15.2.
Wed, Nov 24, 4:56 PM
vsellier committed rDENV839946f79dc1: swh-search: upgrade elasticsearch to 7.15.2 (authored by vsellier).
swh-search: upgrade elasticsearch to 7.15.2
Wed, Nov 24, 4:56 PM
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Wed, Nov 24, 4:35 PM · System administration (Component upgrades)
vsellier updated the diff for D6685: swh-search: upgrade elasticsearch to 7.15.2.

fix a type in the commit message

Wed, Nov 24, 4:31 PM
vsellier requested review of D6685: swh-search: upgrade elasticsearch to 7.15.2.
Wed, Nov 24, 4:24 PM
vsellier added a revision to T3741: swh-search - upgrade elasticsearch backend: D6685: swh-search: upgrade elasticsearch to 7.15.2.
Wed, Nov 24, 4:24 PM · System administration, Archive search
vsellier accepted D6683: unattended-upgrade: Use internal distro_codename variable.

https://github.com/mvo5/unattended-upgrades/blob/5d05cd182325bad80558df53968a06c119f60746/data/50unattended-upgrades.Debian#L13
'n' is an alias for 'codename' so everything should be ok

Wed, Nov 24, 4:05 PM
vsellier requested review of D6682: swh-search: Upgrade elasticsearch to 7.15.2.
Wed, Nov 24, 11:53 AM
vsellier added a revision to T3741: swh-search - upgrade elasticsearch backend: D6682: swh-search: Upgrade elasticsearch to 7.15.2.
Wed, Nov 24, 11:53 AM · System administration, Archive search
vsellier added a comment to T3741: swh-search - upgrade elasticsearch backend.

The staging elasticsearch is migrated to 7.15.2, everything looks good.

Wed, Nov 24, 10:39 AM · System administration, Archive search
vsellier closed D6677: staging: upgrade swh-search elasticsearch to 7.15.2.
Wed, Nov 24, 10:19 AM
vsellier committed rSPSITEa6fda040f0d3: staging: upgrade swh-search elasticsearch to 7.15.2 (authored by vsellier).
staging: upgrade swh-search elasticsearch to 7.15.2
Wed, Nov 24, 10:19 AM
vsellier updated the test plan for D6677: staging: upgrade swh-search elasticsearch to 7.15.2.
Wed, Nov 24, 10:19 AM
vsellier updated the diff for D6677: staging: upgrade swh-search elasticsearch to 7.15.2.

Disable the new embedded geoip database
It creates and regularly update a .geoip_database index
not used by swh_search, so removing it

Wed, Nov 24, 10:14 AM

Tue, Nov 23

vsellier requested review of D6677: staging: upgrade swh-search elasticsearch to 7.15.2.
Tue, Nov 23, 7:53 PM
vsellier added a revision to T3741: swh-search - upgrade elasticsearch backend: D6677: staging: upgrade swh-search elasticsearch to 7.15.2.
Tue, Nov 23, 7:53 PM · System administration, Archive search
vsellier committed rSENV4241293fc459: Remove the decommissioned staging-journal0 node (authored by vsellier).
Remove the decommissioned staging-journal0 node
Tue, Nov 23, 6:44 PM
vsellier accepted D6672: Vagrantfile: Fix vagrant environment lookup for admin nodes.

thanks for having fixed this

Tue, Nov 23, 5:23 PM

Mon, Nov 22

vsellier committed rSPRE08c54f245ea9: staging: Increase memory of objstorage0 to avoid OOM (authored by vsellier).
staging: Increase memory of objstorage0 to avoid OOM
Mon, Nov 22, 4:18 PM
vsellier committed rSPRE927d01960123: Match the reality (authored by vsellier).
Match the reality
Mon, Nov 22, 4:18 PM
vsellier committed rSPSITE1dce10672503: logstash: explicitely match not number facility ids (authored by vsellier).
logstash: explicitely match not number facility ids
Mon, Nov 22, 3:46 PM
vsellier closed D6665: logstash: rename syslog facility to facility_name when it's a string.
Mon, Nov 22, 2:37 PM
vsellier committed rSPSITEae1e994eabc5: logstash: rename syslog facility to facility_name when it's a string (authored by vsellier).
logstash: rename syslog facility to facility_name when it's a string
Mon, Nov 22, 2:37 PM
vsellier requested review of D6665: logstash: rename syslog facility to facility_name when it's a string.
Mon, Nov 22, 2:28 PM
vsellier added a revision to T3705: Upgrade the ELK stack: D6665: logstash: rename syslog facility to facility_name when it's a string.
Mon, Nov 22, 2:28 PM · System administration (Component upgrades)

Fri, Nov 19

vsellier triaged T3741: swh-search - upgrade elasticsearch backend as Normal priority.
Fri, Nov 19, 5:01 PM · System administration, Archive search
vsellier committed rSPSITE8b58820956ae: Increase the number of workers of the staging objstorage (authored by vsellier).
Increase the number of workers of the staging objstorage
Fri, Nov 19, 4:16 PM
vsellier closed D6663: varnish: specify the authentication type in case of 401.
Fri, Nov 19, 4:05 PM
vsellier committed rSPSITE5c17ed204a18: varnish: specify the authentication type in case of 401 (authored by vsellier).
varnish: specify the authentication type in case of 401
Fri, Nov 19, 4:05 PM
vsellier added inline comments to D6663: varnish: specify the authentication type in case of 401.
Fri, Nov 19, 4:01 PM
vsellier updated the diff for D6663: varnish: specify the authentication type in case of 401.

remove useless response code update

Fri, Nov 19, 4:01 PM
vsellier requested review of D6663: varnish: specify the authentication type in case of 401.
Fri, Nov 19, 2:13 PM
vsellier added a revision to T3621: Create a production read-only objstorage: D6663: varnish: specify the authentication type in case of 401.
Fri, Nov 19, 2:13 PM · System administration
vsellier closed D6659: logstash: puppetize the main logstash configuration file.
Fri, Nov 19, 11:54 AM
vsellier committed rSPSITE53eef5fef7fc: logstash: puppetize the main logstash configuration file (authored by vsellier).
logstash: puppetize the main logstash configuration file
Fri, Nov 19, 11:54 AM
vsellier updated the task description for T3738: Replace failing disks on db1 and storage1 (before the end of february 2022).
Fri, Nov 19, 11:37 AM · System administration
vsellier added a project to T3738: Replace failing disks on db1 and storage1 (before the end of february 2022): System administration.
Fri, Nov 19, 11:35 AM · System administration
vsellier triaged T3738: Replace failing disks on db1 and storage1 (before the end of february 2022) as Normal priority.
Fri, Nov 19, 11:35 AM · System administration

Thu, Nov 18

vsellier requested review of D6659: logstash: puppetize the main logstash configuration file.
Thu, Nov 18, 6:34 PM
vsellier added a revision to T3705: Upgrade the ELK stack: D6659: logstash: puppetize the main logstash configuration file.
Thu, Nov 18, 6:34 PM · System administration (Component upgrades)
vsellier closed T3705: Upgrade the ELK stack as Resolved.
  • journalbeat and filebeat are migrated on all the nodes
  • after the lag recovery and the fix of the closed indexes script, everything looks good
Thu, Nov 18, 5:09 PM · System administration (Component upgrades)