Page MenuHomeSoftware Heritage
Feed All Stories

Aug 27 2021

ardumont added a comment to T3338: Load the archived bitbucket mercurial repositories.

So this ingestion got stopped or crashed, at some point.
Probably around the db outage from last week (which emptied the rabbitmq queue).

Aug 27 2021, 5:21 PM · System administration, Mercurial loader
ardumont requested review of D6156: Ensure icinga alerts are raised if the scheduler journal client is down.
Aug 27 2021, 5:01 PM
vsellier changed the status of T3517: [cassandra] decorate the method calls to have statsd metrics from Open to Work in Progress.
Aug 27 2021, 4:48 PM · System administration, Storage manager
moranegg added a parent task for T3516: Implement API entry point for (intrinsic) citation metadata: T3494: Implement citation button for directories with codemeta or CFF.
Aug 27 2021, 4:41 PM · Intrinsic metadata
moranegg added a subtask for T3494: Implement citation button for directories with codemeta or CFF: T3516: Implement API entry point for (intrinsic) citation metadata.
Aug 27 2021, 4:41 PM · Intrinsic metadata, Web app
moranegg triaged T3516: Implement API entry point for (intrinsic) citation metadata as Normal priority.
Aug 27 2021, 4:41 PM · Intrinsic metadata
olasd added a comment to T2960: Add disk health monitoring.

Replicating the comment from T3500:

Aug 27 2021, 4:37 PM · System administration
olasd merged T3500: Add icinga checks for SMART disk status into T2960: Add disk health monitoring.
Aug 27 2021, 4:36 PM · System administration
olasd merged task T3500: Add icinga checks for SMART disk status into T2960: Add disk health monitoring.
Aug 27 2021, 4:36 PM · System administration
ardumont closed T3495: The weekly report bot is down as Resolved.

Postfix alert installed so next time, we should be able to be made aware ;)
Closing now.

Aug 27 2021, 4:35 PM · System administration
ardumont moved T3497: Allow systemd service status monitoring from in-progress to code-review/await-feedback/pause on the System administration board.
Aug 27 2021, 4:33 PM · System administration
ardumont added a comment to T3497: Allow systemd service status monitoring.

There, some illegitimate alerts about smart error on vms were raised.

Aug 27 2021, 4:33 PM · System administration
anlambert requested review of D6155: templates/content-display: Remove script tag when no content to display.
Aug 27 2021, 4:31 PM
anlambert added a revision to T3454: Displaying "large" PDF raise a Javascript error: D6155: templates/content-display: Remove script tag when no content to display.
Aug 27 2021, 4:17 PM · Web app
ardumont closed D6154: Install smart monitoring tools on physical machines only.
Aug 27 2021, 4:15 PM
ardumont committed rSPSITEbf61d160f45b: Install smart monitoring tools on physical machines only (authored by ardumont).
Install smart monitoring tools on physical machines only
Aug 27 2021, 4:15 PM
olasd accepted D6154: Install smart monitoring tools on physical machines only.
Aug 27 2021, 4:14 PM
ardumont added a revision to T3497: Allow systemd service status monitoring: D6154: Install smart monitoring tools on physical machines only.
Aug 27 2021, 4:14 PM · System administration
ardumont requested review of D6154: Install smart monitoring tools on physical machines only.
Aug 27 2021, 4:14 PM
moranegg updated subscribers of T3489: Implement iframe view for content and directory elements.

That's really nice, but I still prefer the minimalist first iframe :-)

Aug 27 2021, 4:01 PM · Software Stories, Web app
anlambert updated the diff for D6153: webapp/config: Bump content_display_max_size to 5 Mb.

s/Mb/MB/

Aug 27 2021, 3:54 PM
ardumont added a comment to D6152: agent_checks: Update necessary source to install package.

(elsewhere: giverny is still on stretch, so the package needs to be made to exist there)

Aug 27 2021, 3:37 PM
olasd added a comment to D6152: agent_checks: Update necessary source to install package.

(elsewhere: giverny is still on stretch, so the package needs to be made to exist there)

Aug 27 2021, 3:36 PM
ardumont abandoned D6152: agent_checks: Update necessary source to install package.

This is not needed.
The issue lies elsewhere.

Aug 27 2021, 3:34 PM
vlorentz added a comment to D6153: webapp/config: Bump content_display_max_size to 5 Mb.

nit: 5MB, not 5Mb

Aug 27 2021, 3:33 PM
ardumont updated the summary of D6152: agent_checks: Update necessary source to install package.
Aug 27 2021, 3:18 PM
ardumont updated the test plan for D6152: agent_checks: Update necessary source to install package.
Aug 27 2021, 3:16 PM
vlorentz closed T3506: Get rid of the concept of vault "object_type", a subtask of T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp, as Resolved.
Aug 27 2021, 3:15 PM · Vault, Web app
vlorentz closed T3506: Get rid of the concept of vault "object_type" as Resolved.
Aug 27 2021, 3:15 PM · Vault, Web app
vlorentz closed T3507: prod: vault: Deploy v1.0.0, a subtask of T3506: Get rid of the concept of vault "object_type", as Resolved.
Aug 27 2021, 3:15 PM · Vault, Web app
vlorentz closed T3507: prod: vault: Deploy v1.0.0 as Resolved.

And I triggered re-cooking bundles that were requested in the last month.

Aug 27 2021, 3:15 PM · System administration, Vault, Web app
anlambert updated the diff for D6153: webapp/config: Bump content_display_max_size to 5 Mb.

Add comment

Aug 27 2021, 3:15 PM
anlambert requested review of D6153: webapp/config: Bump content_display_max_size to 5 Mb.
Aug 27 2021, 3:14 PM
anlambert added a revision to T3454: Displaying "large" PDF raise a Javascript error: D6153: webapp/config: Bump content_display_max_size to 5 Mb.
Aug 27 2021, 3:14 PM · Web app
anlambert added a task to D6004: misc/coverage: Revamp and improve archive coverage widget: T1870: revamp archive coverage page to list instances of mentioned listers.
Aug 27 2021, 3:04 PM
anlambert added a revision to T1870: revamp archive coverage page to list instances of mentioned listers: D6004: misc/coverage: Revamp and improve archive coverage widget.
Aug 27 2021, 3:04 PM · Web app
ardumont requested review of D6152: agent_checks: Update necessary source to install package.
Aug 27 2021, 3:02 PM
ardumont added a revision to T3497: Allow systemd service status monitoring: D6152: agent_checks: Update necessary source to install package.
Aug 27 2021, 3:02 PM · System administration
ardumont added a revision to T1724: Maven Central repository support: D6133: maven-lister: initialise lister..
Aug 27 2021, 2:57 PM · Maven loader, Maven lister, GSoC 2019, Archive coverage
vsellier added a comment to D6139: cassandra: Add option to select (hopefully) more efficient batch insertion algos.

thanks. I will test that once the monitoring is updated to use the statsd statistics instead of the object_count table content.

Aug 27 2021, 2:55 PM
swh-public-ci added a comment to D6139: cassandra: Add option to select (hopefully) more efficient batch insertion algos.

Build is green

Aug 27 2021, 2:54 PM
vlorentz updated the test plan for D6139: cassandra: Add option to select (hopefully) more efficient batch insertion algos.
Aug 27 2021, 2:47 PM
vlorentz updated the diff for D6139: cassandra: Add option to select (hopefully) more efficient batch insertion algos.

rebase + squash + add tests

Aug 27 2021, 2:47 PM
swh-public-ci added a comment to D6083: hypothesis: Run with more examples by default.

Build is green

Aug 27 2021, 2:44 PM
ardumont created P1135 es_open_unfreeze_from_journalctl.sh and es_open_unfreeze.sh:.
Aug 27 2021, 2:37 PM
vlorentz added a comment to D6139: cassandra: Add option to select (hopefully) more efficient batch insertion algos.

This should be addressed by D6149 + D6150

Aug 27 2021, 2:32 PM
vlorentz closed D6083: hypothesis: Run with more examples by default.
Aug 27 2021, 2:30 PM
vlorentz committed rDWAPPS3a448d88c80f: hypothesis: Run with more examples by default (authored by vlorentz).
hypothesis: Run with more examples by default
Aug 27 2021, 2:30 PM
vlorentz updated the diff for D6083: hypothesis: Run with more examples by default.

rebase

Aug 27 2021, 2:30 PM
vlorentz closed D6148: Reword 'no more available to download' in more natural English.
Aug 27 2021, 2:30 PM
vlorentz committed rDWAPPSe9f7a91bc390: Reword 'no more available to download' in more natural English (authored by vlorentz).
Reword 'no more available to download' in more natural English
Aug 27 2021, 2:30 PM
ardumont accepted D6148: Reword 'no more available to download' in more natural English.
Aug 27 2021, 2:29 PM
ardumont added a comment to T3497: Allow systemd service status monitoring.

Got deployed. Some more alerts are raised now. Some legitimate, some others are errors
in the deployment.

Aug 27 2021, 2:28 PM · System administration
vsellier committed rDSNIP237c76e754a8: grid5000/cassandra: fix zfs configuration when only one dataset is used (authored by vsellier).
grid5000/cassandra: fix zfs configuration when only one dataset is used
Aug 27 2021, 2:26 PM
vsellier committed rDSNIP79906e54998c: grid5000/cassandra: fix besteffort nodes deployment (authored by vsellier).
grid5000/cassandra: fix besteffort nodes deployment
Aug 27 2021, 2:26 PM
anlambert added a comment to T3489: Implement iframe view for content and directory elements.

Yeah SWHIDs are long so they eat a lot of horizontal space.

Aug 27 2021, 2:26 PM · Software Stories, Web app
swh-public-ci added a comment to D6148: Reword 'no more available to download' in more natural English.

Build is green

Aug 27 2021, 2:16 PM
moranegg added a comment to T3489: Implement iframe view for content and directory elements.

Looks better with the first implementation with "Go to the archive" :-)
With the badge, it seems right and left side aren't balanced.

Aug 27 2021, 2:03 PM · Software Stories, Web app
vlorentz updated the diff for D6148: Reword 'no more available to download' in more natural English.

apply comments

Aug 27 2021, 2:01 PM
vlorentz closed D6149: Add counting storage proxy.
Aug 27 2021, 1:59 PM
vlorentz committed rDSTO47a6919fee49: Add counting storage proxy (authored by vlorentz).
Add counting storage proxy
Aug 27 2021, 1:59 PM
vlorentz requested review of D6150: cassandra: Remove stat_counters..
Aug 27 2021, 1:47 PM
swh-public-ci added a comment to D6149: Add counting storage proxy.

Build is green

Aug 27 2021, 1:41 PM
vlorentz updated the diff for D6149: Add counting storage proxy.

rebase

Aug 27 2021, 1:31 PM
swh-public-ci added a comment to D5818: send-to-celery: Add more options to allow scheduling of edge case origins.

Build is green

Aug 27 2021, 1:29 PM
swh-public-ci added a comment to D6149: Add counting storage proxy.

Build is green

Aug 27 2021, 1:28 PM
ardumont updated the summary of D5818: send-to-celery: Add more options to allow scheduling of edge case origins.
Aug 27 2021, 1:28 PM
ardumont closed D6124: agent_checks: Install check_systemd plugin and command.

Landed through ad85a394 (forgot to update the diff apparently).

Aug 27 2021, 1:27 PM
swh-public-ci added a comment to D5818: send-to-celery: Add more options to allow scheduling of edge case origins.

Build is green

Aug 27 2021, 1:27 PM
ardumont updated the diff for D5818: send-to-celery: Add more options to allow scheduling of edge case origins.

Use --only-enabled and --only-disabled as mentioned yesterday

Aug 27 2021, 1:26 PM
ardumont updated the diff for D5818: send-to-celery: Add more options to allow scheduling of edge case origins.
  • Rebase on top of latest master
  • Adapt according to remarks
Aug 27 2021, 1:24 PM
vlorentz updated the diff for D6149: Add counting storage proxy.

rebase + fix typos

Aug 27 2021, 1:19 PM
Harbormaster failed to build B23219: rDSCH7cc37fa233c7: Refine scheduling policy for origins with no known last update for rDSCH7cc37fa233c7: Refine scheduling policy for origins with no known last update!
Aug 27 2021, 12:38 PM
Harbormaster failed to build B23218: rDSCH2efad289833e: Add a swh scheduler origin send-to-celery subcommand for rDSCH2efad289833e: Add a swh scheduler origin send-to-celery subcommand!
Aug 27 2021, 12:37 PM
Harbormaster failed to build B23217: rDSCH5e8007fdbfeb: Add table sampling option to grab_next_visits for rDSCH5e8007fdbfeb: Add table sampling option to grab_next_visits!
Aug 27 2021, 12:37 PM
olasd closed D6147: Refine scheduling policy for origins with no known last update.
Aug 27 2021, 12:37 PM
olasd committed rDSCH7cc37fa233c7: Refine scheduling policy for origins with no known last update (authored by olasd).
Refine scheduling policy for origins with no known last update
Aug 27 2021, 12:37 PM
olasd closed D6146: Add a swh scheduler origin send-to-celery subcommand.
Aug 27 2021, 12:37 PM
olasd committed rDSCH2efad289833e: Add a swh scheduler origin send-to-celery subcommand (authored by olasd).
Add a swh scheduler origin send-to-celery subcommand
Aug 27 2021, 12:37 PM
olasd closed D6145: Add table sampling option to grab_next_visits.
Aug 27 2021, 12:37 PM
olasd committed rDSCH5e8007fdbfeb: Add table sampling option to grab_next_visits (authored by olasd).
Add table sampling option to grab_next_visits
Aug 27 2021, 12:37 PM
ardumont closed D6151: Raise alert when systemd services are detected as degraded.
Aug 27 2021, 12:30 PM
ardumont committed rSPSITEa2108b0ca841: Raise alert when systemd services are detected as degraded (authored by ardumont).
Raise alert when systemd services are detected as degraded
Aug 27 2021, 12:30 PM
ardumont committed rSPSITE8e92a5381143: Raise alert when postfix service is not running (authored by ardumont).
Raise alert when postfix service is not running
Aug 27 2021, 12:30 PM
ardumont closed D6134: Raise alert when postfix service is down.
Aug 27 2021, 12:30 PM
ardumont committed rSPSITEad85a3942647: agent_checks: Install check_systemd plugin and command (authored by ardumont).
agent_checks: Install check_systemd plugin and command
Aug 27 2021, 12:30 PM
ardumont committed rSPSITEd8a31214860f: agent_checks: cosmetic: Drop blank character (authored by ardumont).
agent_checks: cosmetic: Drop blank character
Aug 27 2021, 12:30 PM
ardumont updated the diff for D6134: Raise alert when postfix service is down.

Rebase

Aug 27 2021, 12:28 PM
ardumont added a comment to D6149: Add counting storage proxy.

couple of typos inline.

Aug 27 2021, 12:25 PM
ardumont accepted D6149: Add counting storage proxy.
Aug 27 2021, 12:25 PM
ardumont added inline comments to D6149: Add counting storage proxy.
Aug 27 2021, 12:23 PM
ardumont updated the test plan for D6151: Raise alert when systemd services are detected as degraded.
Aug 27 2021, 12:21 PM
olasd accepted D6151: Raise alert when systemd services are detected as degraded.
Aug 27 2021, 12:20 PM
olasd accepted D6134: Raise alert when postfix service is down.
Aug 27 2021, 12:20 PM
vsellier added a comment to T3357: Perform some tests of the cassandra storage on Grid5000.

the lz4 compression was already activated by default. Changing the algo to zstd on the table snapshot was not really significant (initially with lz4: 7Go, zstd: 12Go, go back to lz4: 9Go :) )

Aug 27 2021, 12:10 PM · System administration, Storage manager
ardumont added a revision to T3497: Allow systemd service status monitoring: D6151: Raise alert when systemd services are detected as degraded.
Aug 27 2021, 12:00 PM · System administration
ardumont requested review of D6151: Raise alert when systemd services are detected as degraded.
Aug 27 2021, 12:00 PM
vlorentz requested review of D6149: Add counting storage proxy.
Aug 27 2021, 11:50 AM
anlambert added a comment to T3489: Implement iframe view for content and directory elements.

The one thing that is missing is the current SWHID I’m viewing.
Maybe use a SWHID (or a badge) instead of the path in the center of the panel… or as a footer like a reference…
Not sure about this, but we need to know what artifact is identified in the iframe.

Aug 27 2021, 11:27 AM · Software Stories, Web app
vlorentz committed rDDOCb8aff96078e9: Bump next available port (authored by vlorentz).
Bump next available port
Aug 27 2021, 11:04 AM