Page MenuHomeSoftware Heritage
Feed Advanced Search

Aug 31 2022

vsellier requested review of D8366: terraform: centralize the production bridge configuration.
Aug 31 2022, 4:30 PM
vsellier added inline comments to D8352: staging/graphql: Push issues to sentry.
Aug 31 2022, 4:04 PM
vsellier accepted D8363: staging/graphql/ingress: Fix double if instruction.

nice

Aug 31 2022, 4:01 PM
vsellier requested changes to D8352: staging/graphql: Push issues to sentry.
Aug 31 2022, 3:48 PM
vsellier closed D8358: sysadm: fix build errors.
Aug 31 2022, 3:04 PM
vsellier committed rDDOC82afe898c11c: sysadm: fix build errors (authored by vsellier).
sysadm: fix build errors
Aug 31 2022, 3:04 PM
vsellier requested review of D8358: sysadm: fix build errors.
Aug 31 2022, 3:03 PM
vsellier added a comment to D8325: sysadmin: Document the ArgoCD management and configuration.

oups, the diff was accidentally pushed on master, let's fix the build asap

Aug 31 2022, 11:13 AM
vsellier closed D8325: sysadmin: Document the ArgoCD management and configuration.
Aug 31 2022, 11:09 AM
vsellier committed rDDOC6005327189a8: sysadmin: Document the ArgoCD management and configuration (authored by vsellier).
sysadmin: Document the ArgoCD management and configuration
Aug 31 2022, 11:09 AM

Aug 30 2022

vsellier committed rSPREc38db719de13: Remove the temporary cassandra cluster (authored by vsellier).
Remove the temporary cassandra cluster
Aug 30 2022, 6:41 PM
vsellier closed T4456: Clean up rancher clusters as Resolved.

The staging cluster was reorganized to have one dedicated management node with only etcd and control plane deployed. The other nodes are only workers.
We will have to check if we want to add more rpc nodes for service resiliency (and more etcd node also to have a resilient cluster)

Aug 30 2022, 6:17 PM · System administration
vsellier updated the task description for T4456: Clean up rancher clusters.
Aug 30 2022, 3:46 PM · System administration
vsellier added a comment to T4456: Clean up rancher clusters.

Production cassandra cluster cleanup: P1438

Apply complete! Resources: 0 added, 0 changed, 4 destroyed.
Aug 30 2022, 3:40 PM · System administration
vsellier created P1438 terraform plan -destroy -target rancher2_cluster.production_cassandra.
Aug 30 2022, 3:40 PM
vsellier closed T4476: Azure Billing: Retrieve the balance information as Resolved.

The consumed credits, remaining credit and day before the end of subscription is now displayed on the report.

Aug 30 2022, 3:00 PM · System administration
vsellier closed D8344: azure-billing: Add the balance information on the report.
Aug 30 2022, 2:55 PM
vsellier committed rSPSITEfad8dbb7fe5c: azure-billing: Add the balance information on the report (authored by vsellier).
azure-billing: Add the balance information on the report
Aug 30 2022, 2:55 PM
vsellier updated the diff for D8344: azure-billing: Add the balance information on the report.

fix string concatenation according the review feedback

Aug 30 2022, 2:54 PM
vsellier requested review of D8344: azure-billing: Add the balance information on the report.
Aug 30 2022, 12:19 PM
vsellier added a revision to T4476: Azure Billing: Retrieve the balance information: D8344: azure-billing: Add the balance information on the report.
Aug 30 2022, 12:18 PM · System administration
vsellier changed the status of T4476: Azure Billing: Retrieve the balance information from Open to Work in Progress.
Aug 30 2022, 11:07 AM · System administration
vsellier renamed T4476: Azure Billing: Retrieve the balance information from Azure Billing: Retrieve the balance informations to Azure Billing: Retrieve the balance information.
Aug 30 2022, 11:06 AM · System administration
vsellier triaged T4476: Azure Billing: Retrieve the balance information as Normal priority.
Aug 30 2022, 11:01 AM · System administration
vsellier closed T4449: Azure Billing site not refreshed as Resolved.

The service is restarted, an intermediate license upgrade validation page was inserted. After having manually validated the EULA, the script is working again.

Aug 30 2022, 11:00 AM · System administration
vsellier edited projects for T4472: swh-graph: Allow to specify the rpc port, added: Compressed graph service; removed GraphQL API.
Aug 30 2022, 9:29 AM · Compressed graph service
vsellier edited projects for T4471: swh-graph Add java process port monitoring , added: Compressed graph service; removed GraphQL API.
Aug 30 2022, 9:29 AM · Compressed graph service, System administration

Aug 29 2022

vsellier committed rSPSITE51841aa36df4: swh-graph: Add the monitoring of the java backend (authored by vsellier).
swh-graph: Add the monitoring of the java backend
Aug 29 2022, 5:51 PM
vsellier closed D8335: swh-graph: Add the monitoring of the java backend.
Aug 29 2022, 5:51 PM
vsellier committed rSPSITE847102942060: vagrant: add granet ip in vagrant environment (authored by vsellier).
vagrant: add granet ip in vagrant environment
Aug 29 2022, 5:51 PM
vsellier updated the diff for D8335: swh-graph: Add the monitoring of the java backend.

Remove unecessary empty line

Aug 29 2022, 5:45 PM
vsellier updated the diff for D8335: swh-graph: Add the monitoring of the java backend.

Restore deleted lines that should not have been

Aug 29 2022, 5:16 PM
vsellier added inline comments to D8335: swh-graph: Add the monitoring of the java backend.
Aug 29 2022, 5:10 PM
vsellier requested review of D8335: swh-graph: Add the monitoring of the java backend.
Aug 29 2022, 5:07 PM
vsellier added a revision to T4471: swh-graph Add java process port monitoring : D8335: swh-graph: Add the monitoring of the java backend.
Aug 29 2022, 5:07 PM · Compressed graph service, System administration
vsellier committed rSENVbdd30997156c: vagrant: declare prod-granet (authored by vsellier).
vagrant: declare prod-granet
Aug 29 2022, 5:00 PM
vsellier triaged T4472: swh-graph: Allow to specify the rpc port as Normal priority.
Aug 29 2022, 4:21 PM · Compressed graph service
vsellier changed the status of T4471: swh-graph Add java process port monitoring from Open to Work in Progress.
Aug 29 2022, 4:08 PM · Compressed graph service, System administration
vsellier closed D8331: Increase the memory allocated to webapp1.
Aug 29 2022, 2:44 PM
vsellier committed rSPRE007fcff7d36f: Increase the memory allocated to webapp1 (authored by vsellier).
Increase the memory allocated to webapp1
Aug 29 2022, 2:44 PM
vsellier requested review of D8331: Increase the memory allocated to webapp1.
Aug 29 2022, 2:18 PM
vsellier added a comment to T4470: Prometheus timeouts when querying thanos on large history range.

For info, it seems the I/Os on ceph are quite important during a large query:

Aug 29 2022, 1:53 PM · Monitoring, System administration
vsellier triaged T4470: Prometheus timeouts when querying thanos on large history range as Normal priority.
Aug 29 2022, 1:35 PM · Monitoring, System administration

Aug 26 2022

vsellier accepted D8327: Boostrap swh-loader-git apps.

nice thanks

Aug 26 2022, 5:29 PM
vsellier accepted D8320: graphql: Reference new search backend for latest graphql version.
Aug 26 2022, 4:43 PM
vsellier accepted D8322: graphql: Generate frozen requirements.

\o/ thanks

Aug 26 2022, 4:02 PM
vsellier requested changes to D8320: graphql: Reference new search backend for latest graphql version.
Aug 26 2022, 3:39 PM
vsellier requested changes to D8322: graphql: Generate frozen requirements.

looks like swh.graphql==0.0.2.post2 is an old grapqhl release ?

Aug 26 2022, 3:32 PM

Aug 25 2022

vsellier accepted D8318: Deploy graphql application to staging cluster.
Aug 25 2022, 7:24 PM
vsellier updated the task description for T4461: Move argocd to a private admin url.
Aug 25 2022, 4:03 PM · System administration
vsellier triaged T4461: Move argocd to a private admin url as Normal priority.
Aug 25 2022, 4:02 PM · System administration
vsellier updated the task description for T4460: Upgrade rancher cluster to v2.6.7.
Aug 25 2022, 4:00 PM · System administration
vsellier triaged T4460: Upgrade rancher cluster to v2.6.7 as Normal priority.
Aug 25 2022, 4:00 PM · System administration
vsellier closed D8242: sysadmin: bootstrap the cassandra documentation.
Aug 25 2022, 3:41 PM
vsellier committed rDDOCb5a88986034c: sysadmin: bootstrap the cassandra documentation (authored by vsellier).
sysadmin: bootstrap the cassandra documentation
Aug 25 2022, 3:41 PM
vsellier updated the diff for D8242: sysadmin: bootstrap the cassandra documentation.

fix the typos according the review feedback

Aug 25 2022, 3:40 PM
vsellier updated the diff for D8242: sysadmin: bootstrap the cassandra documentation.

rebase

Aug 25 2022, 3:37 PM
vsellier added a comment to T4456: Clean up rancher clusters.

It's the same for the gitlab-rocq cluster:

  • gitlab-rocq deleted in the rancher UI
  • Vms poc-k8s-gitlab0[1-3] deleted in proxmox
  • ips deleted in the inventory
Aug 25 2022, 11:42 AM · System administration
vsellier updated the task description for T4456: Clean up rancher clusters.
Aug 25 2022, 11:30 AM · System administration
vsellier added a comment to T4456: Clean up rancher clusters.

poc-argoworkflow was manually created so the cluster was manually removed:

  • from rancher
  • the 3 vms poc-argoworkflow-[1-3] was remove from uffizi
  • the provisionned ips were deleted in the the inventory
Aug 25 2022, 11:15 AM · System administration
vsellier updated the task description for T4456: Clean up rancher clusters.
Aug 25 2022, 11:13 AM · System administration
vsellier triaged T4458: Test reaper to automate the cassandra repair actions as Normal priority.
Aug 25 2022, 10:54 AM · System administration
vsellier updated the task description for T4456: Clean up rancher clusters.
Aug 25 2022, 10:46 AM · System administration
vsellier updated the task description for T4456: Clean up rancher clusters.
Aug 25 2022, 10:45 AM · System administration
vsellier closed D8311: Bootstrap a swh chart only with the cassandra replayer stack.
Aug 25 2022, 10:09 AM
vsellier committed R260:3b295de813f3: Bootstrap a swh chart only with the cassandra replayer stack (authored by vsellier).
Bootstrap a swh chart only with the cassandra replayer stack
Aug 25 2022, 10:09 AM
vsellier updated the diff for D8311: Bootstrap a swh chart only with the cassandra replayer stack.

Move the checksum computation inside the if

Aug 25 2022, 10:09 AM

Aug 24 2022

vsellier added a revision to T4391: [cassandra] deploy the replaying stack: D8311: Bootstrap a swh chart only with the cassandra replayer stack.
Aug 24 2022, 6:24 PM · System administration
vsellier requested review of D8311: Bootstrap a swh chart only with the cassandra replayer stack.
Aug 24 2022, 6:24 PM
vsellier added a comment to T4391: [cassandra] deploy the replaying stack.

Everything is almost ready to start the ingestion tests:

  • The deployment of the replayers is implemented
  • The monitoring can also be easily deployed in a kubernetes cluster having the prometheus operator installed [1]
  • the grafana dashboards are also available as templates [1]
Aug 24 2022, 6:10 PM · System administration
vsellier committed rSKCONF1fef5d96e81b: Add grafana dashboards dedicated to cassandra and replayers statistics (authored by vsellier).
Add grafana dashboards dedicated to cassandra and replayers statistics
Aug 24 2022, 5:41 PM
vsellier accepted D8301: staging: Unify vlan declaration.
Aug 24 2022, 10:42 AM
vsellier committed R260:b2b7600f7a1c: fix statsd_exporter image version (authored by vsellier).
fix statsd_exporter image version
Aug 24 2022, 10:12 AM
vsellier committed R260:8d11190a0259: Deploy a prometheus statsd exporter and declare the monitoring (authored by vsellier).
Deploy a prometheus statsd exporter and declare the monitoring
Aug 24 2022, 10:09 AM
vsellier committed R260:767f83f70b95: Add more cassandra servers as seed to dispatch the connections accross all the… (authored by vsellier).
Add more cassandra servers as seed to dispatch the connections accross all the…
Aug 24 2022, 9:40 AM

Aug 23 2022

vsellier committed rSKCONF99b55cad41a6: Declare the monitoring of external cassandra nodes (authored by vsellier).
Declare the monitoring of external cassandra nodes
Aug 23 2022, 5:19 PM

Aug 22 2022

vsellier triaged T4455: Upgrade elk stack to a more recent version as Normal priority.
Aug 22 2022, 3:58 PM · System administration
vsellier triaged T4454: Create a dashboard for the swh-scrubber metrics as High priority.
Aug 22 2022, 3:54 PM · Datastore Scrubber, System administrators
vsellier committed R260:647876a4824a: remove useless name overriding (authored by vsellier).
remove useless name overriding
Aug 22 2022, 3:25 PM
vsellier committed R260:97d8e298ba2f: fix affinity criteria quoting (authored by vsellier).
fix affinity criteria quoting
Aug 22 2022, 2:27 PM
vsellier committed R260:60afde8112bc: affine the resources requests (authored by vsellier).
affine the resources requests
Aug 22 2022, 2:25 PM
vsellier committed R260:b95e7a1f37f3: Allow to specify the replayers's pods affinity (authored by vsellier).
Allow to specify the replayers's pods affinity
Aug 22 2022, 2:25 PM
vsellier triaged T4449: Azure Billing site not refreshed as Normal priority.
Aug 22 2022, 10:06 AM · System administration

Aug 20 2022

vsellier committed R260:dc40c24b4bfc: reduce the deployment history (authored by vsellier).
reduce the deployment history
Aug 20 2022, 11:58 PM
vsellier committed R260:a400f447256d: Add snapshots and increase the directory parallelism (authored by vsellier).
Add snapshots and increase the directory parallelism
Aug 20 2022, 11:52 PM
vsellier committed R260:b0983dbf143c: Adjust memory limits according the real values (authored by vsellier).
Adjust memory limits according the real values
Aug 20 2022, 11:52 PM
vsellier committed R260:06d3ec8f15ea: fix memory spec (authored by vsellier).
fix memory spec
Aug 20 2022, 12:02 PM
vsellier committed R260:a4ee511e00cc: ingest more object type (authored by vsellier).
ingest more object type
Aug 20 2022, 11:55 AM
vsellier committed R260:96f4eeefd246: Fix syntax issues with topics containing a _ (authored by vsellier).
Fix syntax issues with topics containing a _
Aug 20 2022, 11:33 AM
vsellier committed R260:ebed5df4cf6f: Configure autoscaling and add other origin_* topics (authored by vsellier).
Configure autoscaling and add other origin_* topics
Aug 20 2022, 11:19 AM

Aug 19 2022

vsellier committed R260:8b0d38664259: fix cpu reservation unit (authored by vsellier).
fix cpu reservation unit
Aug 19 2022, 8:00 PM
vsellier committed R260:d4a5f53e3035: Declare a cpu and memory request (authored by vsellier).
Declare a cpu and memory request
Aug 19 2022, 7:53 PM
vsellier committed R260:94747dd38910: Use internal kafka addresses (authored by vsellier).
Use internal kafka addresses
Aug 19 2022, 7:32 PM
vsellier committed rSKCONFe19517bb86ea: Depploy keda on cassandra-production cluster (authored by vsellier).
Depploy keda on cassandra-production cluster
Aug 19 2022, 6:09 PM
vsellier committed rSKCONF4434c969017a: declare the cassandra production replaying stack (authored by vsellier).
declare the cassandra production replaying stack
Aug 19 2022, 5:38 PM
vsellier committed R260:d9552225c7c6: Remove debug logs (authored by vsellier).
Remove debug logs
Aug 19 2022, 5:36 PM
vsellier committed rSPSITE42405baf257b: fix kafka credential creation script (authored by vsellier).
fix kafka credential creation script
Aug 19 2022, 5:25 PM
vsellier committed R260:a432372b70d2: bump swh-storage-replayer image versions (authored by vsellier).
bump swh-storage-replayer image versions
Aug 19 2022, 4:42 PM
vsellier committed R259:a3571bce9a00: use apt clean instead of removing all the dpkg content (authored by vsellier).
use apt clean instead of removing all the dpkg content
Aug 19 2022, 4:39 PM
vsellier committed R260:fb1c89846639: fix the way to quote the server in the init command (authored by vsellier).
fix the way to quote the server in the init command
Aug 19 2022, 3:47 PM