Page MenuHomeSoftware Heritage

System administrationFolder
ActivePublic

Milestones

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

general system administration tasks, not specific to any product

Recent Activity

Fri, May 20

ardumont added a comment to T4064: Test GitLab migration scripts.

Clean up gitlab instance

Fri, May 20, 12:30 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Gist of the actions are currently:

  • Mirror the forgerie repository to add some docker commands to allow sandboxed execution (see diffs ^)
  • Adaptations in the forgerie code source to allow migration runs with our current gitlab/phabricator instances (see diffs ^)
  • Current runs are working a bit but do not succeed entirely
Fri, May 20, 12:17 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Fri, May 20, 12:15 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a revision to T4064: Test GitLab migration scripts: D7866: gitlab: Allow gitlab rail command to run without ssh.
Fri, May 20, 9:07 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a revision to T4064: Test GitLab migration scripts: D7865: Allow remote mysql connection.
Fri, May 20, 9:05 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a revision to T4064: Test GitLab migration scripts: D7858: Allow main script executions within container.
Fri, May 20, 9:00 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a revision to T4064: Test GitLab migration scripts: D7856: docs: Fix typos and clean up whitespace.
Fri, May 20, 9:00 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a revision to T4064: Test GitLab migration scripts: D7857: Install Dockerfile to allow containerized script execution.
Fri, May 20, 8:59 AM · System administration, GitLab migration, Roadmap 2020

Thu, May 19

ardumont changed the status of T4064: Test GitLab migration scripts from Open to Work in Progress.
Thu, May 19, 4:55 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a project to T4064: Test GitLab migration scripts: System administration.
Thu, May 19, 4:55 PM · System administration, GitLab migration, Roadmap 2020

Wed, May 18

vsellier added a revision to T4258: [add forge now] email inbound not catched by django: D7849: webapp: fix the inbound email command name.
Wed, May 18, 2:11 PM · System administration, Add Forge Now
vsellier added projects to T4258: [add forge now] email inbound not catched by django: Add Forge Now , System administration.
Wed, May 18, 2:08 PM · System administration, Add Forge Now
vsellier added a revision to T4134: Package the graphql service: D7846: [swh-graphql] Prepare the docker image generation.
Wed, May 18, 11:37 AM · System administration, GraphQL API

Tue, May 17

vsellier reopened T4251: [swh-search] Investigate long search queries response time as "Work in Progress".
Tue, May 17, 5:39 PM · System administration, Archive search
vsellier edited projects for T4251: [swh-search] Investigate long search queries response time, added: System administration; removed System administrators.
Tue, May 17, 5:39 PM · System administration, Archive search

Mon, May 16

ardumont updated the task description for T4144: Elastic worker infrastructure.
Mon, May 16, 9:44 AM · meta-task, System administration, Roadmap 2022
vsellier renamed T4247: journalbeat failed to start after reboot from journalbeat fails to start after reboot to journalbeat failed to start after reboot.
Mon, May 16, 9:24 AM · System administration
vsellier renamed T4247: journalbeat failed to start after reboot from journalbeat fail to start after reboot to journalbeat fails to start after reboot.
Mon, May 16, 9:24 AM · System administration
vsellier closed T4247: journalbeat failed to start after reboot as Resolved.
Mon, May 16, 9:17 AM · System administration
vsellier added a comment to T4247: journalbeat failed to start after reboot.

the file /var/lib/journalbeat/registry looks corrupted:
on worker10.euwest:

root@worker10:/var/lib/journalbeat# cat registry 
<?xml version="1.0" encoding="utf-8"?>
<GoalState xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="goalstate10.xsd">
  <Version>2012-11-30</Version>
  <Incarnation>1</Incarnation>
  <Machine>
    <ExpectedState>Started</ExpectedState>
    <StopRolesDeadlineHint>3

on worker09.euwest:

root@worker09:/var/lib/journalbeat# cat registry 
update_time: 2022-05-16T07:11:29.680690647Z
journal_entries:
- path: LOCAL_SYSTEM_JOURNAL
  cursor: s=1b5676c17e22450b80579b9caf065703;i=659f65c;b=97b0842367c749299a4a12ec839f1c3b;m=5b66c4ba4c0;t=5df1bbb86b72f;x=8e43c09dfc1a706e
  realtime_timestamp: 1652685086832431
  monotonic_timestamp: 6281059083456
Mon, May 16, 9:17 AM · System administration
vsellier changed the status of T4247: journalbeat failed to start after reboot from Open to Work in Progress.
Mon, May 16, 9:13 AM · System administration

Fri, May 13

ardumont added a parent task for T4242: Deployed loader.git v1.8: T4219: Investigate why GitHub fork detection did not bring a speed-up.
Fri, May 13, 6:01 PM · System administration, Git loader
ardumont closed T4243: Deploy loader.metadata credentials for high and oneshot loaders as Resolved.
Fri, May 13, 5:59 PM · System administration, Metadata Loaders, Git loader
ardumont closed T4242: Deployed loader.git v1.8 as Resolved.
Fri, May 13, 5:59 PM · System administration, Git loader
ardumont added a comment to T4242: Deployed loader.git v1.8.

Dashboard to check for improvments [1]

Fri, May 13, 5:29 PM · System administration, Git loader
ardumont moved T4243: Deploy loader.metadata credentials for high and oneshot loaders from in-progress to deployed/landed/monitoring on the System administration board.
Fri, May 13, 5:23 PM · System administration, Metadata Loaders, Git loader
ardumont moved T4242: Deployed loader.git v1.8 from in-progress to deployed/landed/monitoring on the System administration board.
Fri, May 13, 5:23 PM · System administration, Git loader
ardumont renamed T4243: Deploy loader.metadata credentials for high and oneshot loaders from Deploy loader.metadata credentials for high and oneshot loader to Deploy loader.metadata credentials for high and oneshot loaders.
Fri, May 13, 5:16 PM · System administration, Metadata Loaders, Git loader
ardumont updated the task description for T4243: Deploy loader.metadata credentials for high and oneshot loaders.
Fri, May 13, 5:16 PM · System administration, Metadata Loaders, Git loader
ardumont added a revision to T4243: Deploy loader.metadata credentials for high and oneshot loaders: D7832: Deploy metadata loader credentials for high and oneshot loaders.
Fri, May 13, 5:13 PM · System administration, Metadata Loaders, Git loader
ardumont changed the status of T4243: Deploy loader.metadata credentials for high and oneshot loaders from Open to Work in Progress.
Fri, May 13, 5:12 PM · System administration, Metadata Loaders, Git loader
ardumont triaged T4243: Deploy loader.metadata credentials for high and oneshot loaders as Normal priority.
Fri, May 13, 5:11 PM · System administration, Metadata Loaders, Git loader
anlambert added a project to T4105: Push maven-index-exporter image to docker hub: Maven lister.
Fri, May 13, 4:55 PM · Maven lister, System administration, Continuous Integration
ardumont changed the status of T4242: Deployed loader.git v1.8 from Open to Work in Progress.
Fri, May 13, 4:55 PM · System administration, Git loader
anlambert added projects to T4143: staging: Deploy maven stack fixes: Maven lister, Maven loader.
Fri, May 13, 4:55 PM · Maven loader, Maven lister, System administration, Archive coverage
ardumont updated the task description for T4242: Deployed loader.git v1.8.
Fri, May 13, 4:55 PM · System administration, Git loader
anlambert added projects to T3746: staging: Deploy maven indexer/lister/loader: Maven lister, Maven loader.
Fri, May 13, 4:54 PM · Maven loader, Maven lister, System administration, Archive coverage
anlambert added projects to T4215: staging: Deploy latest maven stack: Maven lister, Maven loader.
Fri, May 13, 4:54 PM · Maven loader, Maven lister, System administration, Archive coverage
vlorentz added a comment to T4225: Deploy a more recent version of prometheus-statsd-exporter on all nodes.

thanks, btw! :)

Fri, May 13, 4:24 PM · System administration
olasd added a comment to T4225: Deploy a more recent version of prometheus-statsd-exporter on all nodes.

That's deployed on all nodes and validated as working now.

Fri, May 13, 4:21 PM · System administration
olasd closed T4225: Deploy a more recent version of prometheus-statsd-exporter on all nodes as Resolved.
Fri, May 13, 4:20 PM · System administration
ardumont closed T4238: Deploy latest loaders version (> v3.4) as Resolved.
Fri, May 13, 11:47 AM · System administration, Core Loader
ardumont moved T4238: Deploy latest loaders version (> v3.4) from in-progress to deployed/landed/monitoring on the System administration board.
Fri, May 13, 11:47 AM · System administration, Core Loader
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
Fri, May 13, 11:47 AM · System administration, Core Loader
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
Fri, May 13, 11:35 AM · System administration, Core Loader
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
Fri, May 13, 10:42 AM · System administration, Core Loader
ardumont moved T4238: Deploy latest loaders version (> v3.4) from Weekly backlog to in-progress on the System administration board.
Fri, May 13, 10:31 AM · System administration, Core Loader
olasd added a comment to T4225: Deploy a more recent version of prometheus-statsd-exporter on all nodes.

Puppet ran manually on staging workers now, and the new statsd exporter has been deployed. The metrics properly show up in prometheus.

Fri, May 13, 10:29 AM · System administration
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
Fri, May 13, 10:23 AM · System administration, Core Loader
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
Fri, May 13, 10:23 AM · System administration, Core Loader