Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 20 2021

vsellier committed rDENV7fef5665858a: Add indexer workers (authored by ardumont).
Add indexer workers
Apr 20 2021, 4:20 PM
vsellier committed rDENVe2a1bdb720a5: Add indexer storage rpc service (authored by ardumont).
Add indexer storage rpc service
Apr 20 2021, 4:20 PM
vsellier committed rDENV7bd763b91b61: kubernetes/Readme: Simplify readme instructions (authored by ardumont).
kubernetes/Readme: Simplify readme instructions
Apr 20 2021, 4:20 PM
vsellier committed rDENVf03bd679bf5a: Add indexer storage db service (authored by ardumont).
Add indexer storage db service
Apr 20 2021, 4:20 PM
vsellier committed rDENVf0fba4227e7d: speedup rebuild (authored by vsellier).
speedup rebuild
Apr 20 2021, 4:20 PM
vsellier committed rDENV30007adceb03: Parallelize builds (authored by vsellier).
Parallelize builds
Apr 20 2021, 4:20 PM
vsellier committed rDENVbcc93abec692: reduce kafka startup time (authored by vsellier).
reduce kafka startup time
Apr 20 2021, 4:20 PM
vsellier committed rDENVc955e3a82e56: Add a UI on top of the registry (authored by vsellier).
Add a UI on top of the registry
Apr 20 2021, 4:20 PM
vsellier committed rDENV2c3d0f8274cd: counters: use labels in prometheus queries (authored by vsellier).
counters: use labels in prometheus queries
Apr 20 2021, 4:20 PM
vsellier committed rDENV38f8aa3fadda: loaders: use a dynamic hostname (authored by vsellier).
loaders: use a dynamic hostname
Apr 20 2021, 4:20 PM
vsellier committed rDENV2e0dd8ed9990: monitoring: use consistent names for exporter job (authored by vsellier).
monitoring: use consistent names for exporter job
Apr 20 2021, 4:20 PM
vsellier committed rDENVb10d8517b7cf: webapp use counters to display the history count graph (authored by vsellier).
webapp use counters to display the history count graph
Apr 20 2021, 4:20 PM
vsellier committed rDENV78c3bf55b146: use a local storage for the registry (authored by vsellier).
use a local storage for the registry
Apr 20 2021, 4:20 PM
vsellier committed rDENVe6ebec4998ae: try to perform a warm shutdown of the lister and loaders (authored by vsellier).
try to perform a warm shutdown of the lister and loaders
Apr 20 2021, 4:20 PM
vsellier committed rDENV22cb1e91ddc6: Decrease verbosity for scheduler and counter stack (authored by ardumont).
Decrease verbosity for scheduler and counter stack
Apr 20 2021, 4:20 PM
vsellier committed rDENVf0dfeb8581be: kubernetes/02-monitoring: Add scraping webapp metrics to prometheus (authored by ardumont).
kubernetes/02-monitoring: Add scraping webapp metrics to prometheus
Apr 20 2021, 4:20 PM
vsellier committed rDENVde347db31946: declare the counters stack (authored by vsellier).
declare the counters stack
Apr 20 2021, 4:20 PM
vsellier committed rDENVefa4de1f9541: add missing parts for counters (authored by vsellier).
add missing parts for counters
Apr 20 2021, 4:20 PM
vsellier committed rDENVedf940100bae: Add missing dockerfile for the lister's image (authored by vsellier).
Add missing dockerfile for the lister's image
Apr 20 2021, 4:20 PM
vsellier committed rDENV60b672c77729: reorder skaffold configuration (authored by vsellier).
reorder skaffold configuration
Apr 20 2021, 4:20 PM
vsellier committed rDENV55b356e0cac6: adapt limits (authored by vsellier).
adapt limits
Apr 20 2021, 4:20 PM
vsellier committed rDENV70a8dd6e6185: add scheduler journal client (authored by vsellier).
add scheduler journal client
Apr 20 2021, 4:20 PM
vsellier committed rDENV7205315a7d3b: Increase storage limit to avoid OOM (authored by vsellier).
Increase storage limit to avoid OOM
Apr 20 2021, 4:20 PM
vsellier committed rDENV093900b5782e: Add search journal client (authored by vsellier).
Add search journal client
Apr 20 2021, 4:20 PM
vsellier committed rDENV6a429ff7a096: Adjust limits (authored by vsellier).
Adjust limits
Apr 20 2021, 4:20 PM
vsellier committed rDENVe94dfa3450d1: add listers (authored by vsellier).
add listers
Apr 20 2021, 4:20 PM
vsellier committed rDENV17a38b2c0ece: configure the webapp to use postgresql (authored by vsellier).
configure the webapp to use postgresql
Apr 20 2021, 4:20 PM
vsellier committed rDENVd94ef9c03041: Improve elasticsearch startup (authored by vsellier).
Improve elasticsearch startup
Apr 20 2021, 4:20 PM
vsellier committed rDENV1c63c1267f3b: add missing point on the documentation (authored by vsellier).
add missing point on the documentation
Apr 20 2021, 4:20 PM
vsellier committed rDENV68d1bfb65f9e: Add swh-scheduler-listener service (authored by ardumont).
Add swh-scheduler-listener service
Apr 20 2021, 4:20 PM
vsellier committed rDENV046c1a456053: rabbitmq: Expose the rabbitmq manager port (authored by ardumont).
rabbitmq: Expose the rabbitmq manager port
Apr 20 2021, 4:20 PM
vsellier committed rDENV79876819cbcc: Drop scheduler-runner verbosity to INFO (authored by ardumont).
Drop scheduler-runner verbosity to INFO
Apr 20 2021, 4:20 PM
vsellier committed rDENVac7974bd84ef: Add swh search service (authored by ardumont).
Add swh search service
Apr 20 2021, 4:20 PM
vsellier committed rDENVe723af31c9ed: fix postgresql persistence (authored by vsellier).
fix postgresql persistence
Apr 20 2021, 4:20 PM
vsellier committed rDENV8221060a4ca5: Add elasticsearch service (authored by ardumont).
Add elasticsearch service
Apr 20 2021, 4:20 PM
vsellier committed rDENVebe1321c8418: Add scheduler-runner service (authored by ardumont).
Add scheduler-runner service
Apr 20 2021, 4:20 PM
vsellier committed rDENVe788685ffd03: allow kafka to start without being killed by an oom (authored by vsellier).
allow kafka to start without being killed by an oom
Apr 20 2021, 4:20 PM
vsellier committed rDENV8b26181dd29e: Move rabbitmq definition prior to the scheduler (authored by ardumont).
Move rabbitmq definition prior to the scheduler
Apr 20 2021, 4:20 PM
vsellier committed rDENVd2078d9e1f58: Add prometheus and grafana (authored by vsellier).
Add prometheus and grafana
Apr 20 2021, 4:20 PM
vsellier committed rDENVe7423de91e1f: add directory initialisation task (authored by vsellier).
add directory initialisation task
Apr 20 2021, 4:20 PM
vsellier committed rDENVfad6ffd1f12a: persist zookeeper data to fix kafka restart (authored by vsellier).
persist zookeeper data to fix kafka restart
Apr 20 2021, 4:20 PM
vsellier committed rDENV02c68c6193f3: webapp: configure rolling upgrade (authored by vsellier).
webapp: configure rolling upgrade
Apr 20 2021, 4:20 PM
vsellier committed rDENV1ab6aeedca06: webapp: correctly install source via pip (authored by vsellier).
webapp: correctly install source via pip
Apr 20 2021, 4:20 PM
vsellier committed rDENV3496dfe7d6f0: Make webapp use an entrypoint and update to use postgres backend (authored by ardumont).
Make webapp use an entrypoint and update to use postgres backend
Apr 20 2021, 4:20 PM
vsellier committed rDENVdbe2a7d8a20d: objstorage: correctly install source via pip (authored by vsellier).
objstorage: correctly install source via pip
Apr 20 2021, 4:20 PM
vsellier committed rDENV56591249a5eb: Dockerfile: Clean up whitespaces (authored by ardumont).
Dockerfile: Clean up whitespaces
Apr 20 2021, 4:20 PM
vsellier committed rDENV5f3dfa662f54: loaders: Decrease loaders verbosity (authored by ardumont).
loaders: Decrease loaders verbosity
Apr 20 2021, 4:20 PM
vsellier committed rDENV8564f0d2c001: Add loaders (#2) (authored by ardumont).
Add loaders (#2)
Apr 20 2021, 4:20 PM
vsellier committed rDENVb09640e4fa5a: add service declaration on the /etc/hosts (authored by vsellier).
add service declaration on the /etc/hosts
Apr 20 2021, 4:20 PM
vsellier committed rDENVb1d314ab971c: cleanup base image (authored by vsellier).
cleanup base image
Apr 20 2021, 4:20 PM
vsellier committed rDENV265e3e412909: declare the webapp (authored by vsellier).
declare the webapp
Apr 20 2021, 4:20 PM
vsellier committed rDENV885dabee1d78: deploy kafka (authored by vsellier).
deploy kafka
Apr 20 2021, 4:20 PM
vsellier committed rDENV844c4620cb50: add util scripts on the base image (authored by vsellier).
add util scripts on the base image
Apr 20 2021, 4:20 PM
vsellier committed rDENV35d3074b2fb1: Add rabbitmq service (authored by ardumont).
Add rabbitmq service
Apr 20 2021, 4:20 PM
vsellier committed rDENVa7b622631244: README: Fix and unify host mount points creation (authored by ardumont).
README: Fix and unify host mount points creation
Apr 20 2021, 4:20 PM
vsellier committed rDENV6c1f8354a594: Reference how to build the objstorage (authored by ardumont).
Reference how to build the objstorage
Apr 20 2021, 4:20 PM
vsellier committed rDENV899449c9c99e: Add scheduler service (authored by ardumont).
Add scheduler service
Apr 20 2021, 4:20 PM
vsellier committed rDENV37bf87db47b2: Readme: Update reference names (authored by ardumont).
Readme: Update reference names
Apr 20 2021, 4:20 PM
vsellier committed rDENVa2974219dea5: Cleanup whitespace noises (authored by ardumont).
Cleanup whitespace noises
Apr 20 2021, 4:20 PM
vsellier committed rDENVb6c95efb90be: restore missing python dependencies (authored by vsellier).
restore missing python dependencies
Apr 20 2021, 4:20 PM
vsellier committed rDENV957b5399b9f1: Specify the righ patch creation on the doc (authored by vsellier).
Specify the righ patch creation on the doc
Apr 20 2021, 4:20 PM
vsellier committed rDENV3de0baef88d1: docker: stop ignoring .git directory to allow pip to perform local install (authored by vsellier).
docker: stop ignoring .git directory to allow pip to perform local install
Apr 20 2021, 4:20 PM
vsellier committed rDENVd917810e87b1: fix zookeeper configuration (authored by vsellier).
fix zookeeper configuration
Apr 20 2021, 4:20 PM
vsellier committed rDENV454aa1ef5eb0: add limit on containers (authored by vsellier).
add limit on containers
Apr 20 2021, 4:20 PM
vsellier committed rDENV6cf5f524ed23: storage: Initialize database schema on startup (authored by vsellier).
storage: Initialize database schema on startup
Apr 20 2021, 4:20 PM
vsellier committed rDENV51377bcdf873: fix database startup (authored by vsellier).
fix database startup
Apr 20 2021, 4:20 PM
vsellier committed rDENVf99fb0d09a45: make modules discoverable for swh command line (authored by vsellier).
make modules discoverable for swh command line
Apr 20 2021, 4:20 PM
vsellier committed rDENV5075e104e233: add skaffold section on the readme (authored by vsellier).
add skaffold section on the readme
Apr 20 2021, 4:19 PM
vsellier committed rDENV0cfe5be92631: split image to efficiently manage dependencies (authored by vsellier).
split image to efficiently manage dependencies
Apr 20 2021, 4:19 PM
vsellier committed rDENV5c8b476ed513: wip try journal (authored by vsellier).
wip try journal
Apr 20 2021, 4:19 PM
vsellier committed rDENV71bab54065af: wip - kubernetes and skaffold initialization (authored by vsellier).
wip - kubernetes and skaffold initialization
Apr 20 2021, 4:19 PM
vsellier added a comment to T3041: [production] Provision enough space for the search ES cluster to ingest all intrinsic metadata.

Apparently the order was lost somewhere after it was sent to dell the 6th april 馃
It was reissued yesterday...

Apr 20 2021, 10:37 AMSystem administration, Archive search

Apr 19 2021

vsellier added a revision to T3242: Decommission ClearlyDefined resources: D5557: Remove clearly-defined resources.
Apr 19 2021, 7:02 PMSystem administration
vsellier requested review of D5557: Remove clearly-defined resources.
Apr 19 2021, 7:02 PM
vsellier committed rSPSITEe749fd9a244c: Remove tenma's access (authored by vsellier).
Remove tenma's access
Apr 19 2021, 6:38 PM
vsellier added a comment to T3242: Decommission ClearlyDefined resources.

The clearly-defined dump is backuped on /srv/storage/space/mirrors/clearly-defined/clearcode-dump-2021-01-05/clearcode_backup-20210105-2111.dump

Apr 19 2021, 6:35 PMSystem administration
vsellier changed the status of T3251: Count authors from revisions and releases, a subtask of T2912: Next generation archive counters, from Open to Work in Progress.
Apr 19 2021, 3:52 PMRoadmap 2021, System administration, Monitoring, Web app
vsellier changed the status of T3251: Count authors from revisions and releases from Open to Work in Progress.
Apr 19 2021, 3:52 PMMonitoring, Web app
vsellier closed T2501: Proxmox reliability improvements (Summer 2020) as Resolved.

changing the status to resolved as all the subtasks are done. feel free to reopen if it shouldn't.

Apr 19 2021, 3:44 PMSystem administration

Apr 16 2021

vsellier accepted D5549: Deploy check save code now end to end check.

just one question inline regarding the icinga test name.
Otherwise, looks good

Apr 16 2021, 6:00 PM
vsellier accepted D5541: Add end to end save code now check.

lgtm

Apr 16 2021, 3:52 PM
vsellier closed T3254: Outboarding of tenma as Resolved.
Apr 16 2021, 2:23 PMSystem administration
vsellier added a comment to T3254: Outboarding of tenma.
  • he was not in the list of members of the swh-team (thanks @ardumont for adding me to the owners of the list)
Apr 16 2021, 2:23 PMSystem administration
vsellier updated subscribers of T3254: Outboarding of tenma.
  • unix credentials disabled
  • user tenma removed from the groups Staff and Reviewers in phabricator
  • VPN credential revoked:
root@louvre:~# cd /etc/openvpn/keys
root@louvre:/etc/openvpn/keys# ls
dh1024.pem  dh2048.pem	easyrsa  old  pki  vars  x509-types
root@louvre:/etc/openvpn/keys# ./easyrsa revoke tenma
Apr 16 2021, 11:51 AMSystem administration
vsellier placed T2743: Investigate why logging is inconsistent up for grabs.
Apr 16 2021, 11:48 AMVault, Object storage, Core & foundations
vsellier placed T1410: Kill implicit configuration: new configuration scheme up for grabs.
Apr 16 2021, 11:48 AMCore & foundations
vsellier placed T2885: investigate the persistent seemingly benign errors on cooking progress up for grabs.
Apr 16 2021, 11:48 AMVault
vsellier removed a member for Staff: Tanya.
Apr 16 2021, 11:44 AM
vsellier removed a member for Reviewers: tenma.
Apr 16 2021, 11:43 AM
vsellier removed a member for Staff: tenma.
Apr 16 2021, 11:41 AM
vsellier committed rSPPRIVC8abf1d0534b8: refresh compared to uncensored data (authored by vsellier).
refresh compared to uncensored data
Apr 16 2021, 11:39 AM
vsellier added a revision to T3254: Outboarding of tenma: D5542: Remove tenma's access.
Apr 16 2021, 11:31 AMSystem administration
vsellier requested review of D5542: Remove tenma's access.
Apr 16 2021, 11:31 AM
vsellier changed the status of T3254: Outboarding of tenma from Open to Work in Progress.
Apr 16 2021, 10:42 AMSystem administration
vsellier moved T3203: docs: Document the firewall installation and procedures from Backlog to Weekly backlog on the System administration board.
Apr 16 2021, 10:13 AMDocumentation, System administration
vsellier moved T3242: Decommission ClearlyDefined resources from Backlog to in-progress on the System administration board.
Apr 16 2021, 10:13 AMSystem administration
vsellier moved T3243: Replace /dev/sdb and /dev/sdc on storage1.staging from Backlog to in-progress on the System administration board.
Apr 16 2021, 10:12 AMSystem administration, Staging environment
vsellier accepted D5541: Add end to end save code now check.

I'm not a big fan of the random pickup of repo because it adds entropy on the result, but otherwise it's great to be able to monitor this 馃憤

Apr 16 2021, 9:35 AM

Apr 15 2021

vsellier closed T2939: Replace out of order disks on db1.staging and storage1.staging as Resolved.

closing this issue as the quota of disks replacement will be over after T3243.
The disk on db1 looks stable for the moment. It will be removed from the zfs pool in case of problems.

Apr 15 2021, 6:14 PMSystem administration
vsellier closed D5539: Outboarding of tg1999.
Apr 15 2021, 5:57 PM