Page MenuHomeSoftware Heritage
Feed All Stories

Aug 24 2021

olasd accepted D6127: backfill: add extra where clause to use the right index for extid requests.

*ugh* but thanks

Aug 24 2021, 2:26 PM
anlambert closed T3496: Handle webapp authentication error when session is no longer active as Resolved.

Fix has been deployed to production, issue is now fixed, closing this.

Aug 24 2021, 2:23 PM · Web app, Authentication
vsellier triaged T3499: Move firewall storage to local hypervisor storage as High priority.
Aug 24 2021, 2:21 PM · System administration
swh-public-ci added a comment to D6113: vault API: Rename bundle types and use SWHIDs to identify objects.

Build is green

Aug 24 2021, 2:10 PM
swh-public-ci added a comment to D6114: swh-scanner: retrieve additional information about software artifacts.

Build is green

Aug 24 2021, 2:05 PM
vsellier requested review of D6127: backfill: add extra where clause to use the right index for extid requests.
Aug 24 2021, 2:02 PM
vlorentz updated the diff for D6113: vault API: Rename bundle types and use SWHIDs to identify objects.

fix bugs, add test, add migration for client-side data

Aug 24 2021, 1:56 PM
vsellier added a revision to T3485: extid topic is misconfigured in staging and production: D6127: backfill: add extra where clause to use the right index for extid requests.
Aug 24 2021, 1:55 PM · System administration
anlambert accepted D6126: vault.spec.js: Add test checking the LocalStorage is used to show the task list.
Aug 24 2021, 1:53 PM
anlambert accepted D6125: vault.spec.js: Remove vaultItems from global variables.
Aug 24 2021, 1:49 PM
aeviso added inline comments to D6094: Provenance Mongo backend.
Aug 24 2021, 1:39 PM · Provenance database
jayeshv requested review of D6094: Provenance Mongo backend.
Aug 24 2021, 12:09 PM · Provenance database
vsellier renamed T3493: [cassandra] Git loader performance are very bad from Git loader performance are very bad to [cassandra] Git loader performance are very bad.
Aug 24 2021, 12:07 PM · System administration, Storage manager
vlorentz requested review of D6126: vault.spec.js: Add test checking the LocalStorage is used to show the task list.
Aug 24 2021, 11:51 AM
vlorentz requested review of D6125: vault.spec.js: Remove vaultItems from global variables.
Aug 24 2021, 11:37 AM
anlambert closed D6123: tests: Fix sampled_from hypothesis strategy import.
Aug 24 2021, 11:00 AM
anlambert committed rDWAPPS8acd72636928: tests: Fix sampled_from hypothesis strategy import (authored by anlambert).
tests: Fix sampled_from hypothesis strategy import
Aug 24 2021, 11:00 AM
vsellier accepted D6124: agent_checks: Install check_systemd plugin and command.

LGTM (double checked with @olasd ;) )

Aug 24 2021, 10:58 AM
vlorentz created P1130 vault.spec.js: Remove vaultItems from global variables.
Aug 24 2021, 10:52 AM
vlorentz abandoned D6081: Fix api_raw_extrinsic_metadata_swhid-related bugs found when using the 'slow' hypothesis profile.
Aug 24 2021, 10:51 AM
ardumont retitled D6124: agent_checks: Install check_systemd plugin and command from agent_checks: Install check_systemd plugin to agent_checks: Install check_systemd plugin and command.
Aug 24 2021, 10:45 AM
ardumont requested review of D6124: agent_checks: Install check_systemd plugin and command.
Aug 24 2021, 10:43 AM
ardumont added a revision to T3497: Allow systemd service status monitoring: D6124: agent_checks: Install check_systemd plugin and command.
Aug 24 2021, 10:43 AM · System administration
ardumont changed the status of T3497: Allow systemd service status monitoring from Open to Work in Progress.
Aug 24 2021, 10:34 AM · System administration
ardumont added a project to T3497: Allow systemd service status monitoring: System administration.
Aug 24 2021, 10:34 AM · System administration
ardumont triaged T3497: Allow systemd service status monitoring as Normal priority.
Aug 24 2021, 9:42 AM · System administration

Aug 23 2021

ardumont accepted D6123: tests: Fix sampled_from hypothesis strategy import.
Aug 23 2021, 6:53 PM
ardumont added a comment to T3495: The weekly report bot is down.

Turns out this one ^ is already packaged for debian unstable but not backported.
I'm of a mind to just do the necessary packaging glue to be able to build it and upload
it to our swh debian repository [1]

Aug 23 2021, 6:52 PM · System administration
anlambert requested review of D6123: tests: Fix sampled_from hypothesis strategy import.
Aug 23 2021, 6:21 PM
ardumont added a comment to P1129 (An Untitled Masterwork).

Fixed.

Aug 23 2021, 6:20 PM
ardumont committed rSPSITE9f7e8e8863d6: common/common: Define properly the swh-web db port (authored by ardumont).
common/common: Define properly the swh-web db port
Aug 23 2021, 6:15 PM
Harbormaster failed remote builds in B23104: Diff 22147 for D6114: swh-scanner: retrieve additional information about software artifacts!
Aug 23 2021, 6:12 PM
swh-public-ci added a comment to D6114: swh-scanner: retrieve additional information about software artifacts.

Build has FAILED

Aug 23 2021, 6:12 PM
ardumont committed rSPSITEc7b42deeb462: pg_bouncer: Fix wrong variable use (authored by ardumont).
pg_bouncer: Fix wrong variable use
Aug 23 2021, 5:54 PM
ardumont created P1129 (An Untitled Masterwork).
Aug 23 2021, 5:38 PM
ardumont committed rSPSITE4772374859e3: Decrease replication lag warning/critical threshold by a hundredfold (authored by ardumont).
Decrease replication lag warning/critical threshold by a hundredfold
Aug 23 2021, 5:30 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDAUTH9bde6b2c5a23: Updated backport on buster-swh from debian/0.6.1-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.6.1-1_swh1 (unstable-swh)
Aug 23 2021, 5:20 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDAUTHd248d078d960: Merge tag 'debian/0.6.1-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.6.1-1_swh1' into debian/buster-swh
Aug 23 2021, 5:20 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDAUTH908efbd37000: pristine-tar data for swh-auth_0.6.1.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-auth_0.6.1.orig.tar.gz
Aug 23 2021, 5:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDAUTHc4673d80d8a1: Updated debian changelog for version 0.6.1 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.6.1
Aug 23 2021, 5:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDAUTH7162f01b9395: New upstream version 0.6.1 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.6.1
Aug 23 2021, 5:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDAUTHcd893c99a34a: Update upstream source from tag 'debian/upstream/0.6.1' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.6.1'
Aug 23 2021, 5:19 PM
anlambert accepted D6083: hypothesis: Run with more examples by default.
Aug 23 2021, 5:17 PM
swh-public-ci added a comment to D6083: hypothesis: Run with more examples by default.

Build is green

Aug 23 2021, 5:17 PM
anlambert closed D6122: django/backends: Handle error when user session is no longer active.
Aug 23 2021, 5:16 PM
anlambert committed rDAUTH508b476db7c5: django/backends: Handle error when user session is no longer active (authored by anlambert).
django/backends: Handle error when user session is no longer active
Aug 23 2021, 5:16 PM
anlambert added a comment to D6122: django/backends: Handle error when user session is no longer active.

nice catch.

Aug 23 2021, 5:15 PM
ardumont accepted D6122: django/backends: Handle error when user session is no longer active.

nice catch.

Aug 23 2021, 5:05 PM
vlorentz updated the diff for D6083: hypothesis: Run with more examples by default.

rebase

Aug 23 2021, 5:03 PM
ardumont committed rPMPS11efa2fffef3: d/changelog: Backport new release (authored by ardumont).
d/changelog: Backport new release
Aug 23 2021, 3:30 PM
anlambert accepted D6121: Add test for origin_visit_get_latest in presence of mismatched id and date orders.
Aug 23 2021, 3:26 PM
anlambert requested review of D6122: django/backends: Handle error when user session is no longer active.
Aug 23 2021, 3:17 PM
anlambert added a revision to T3496: Handle webapp authentication error when session is no longer active: D6122: django/backends: Handle error when user session is no longer active.
Aug 23 2021, 3:15 PM · Web app, Authentication
ardumont added a comment to T3495: The weekly report bot is down.

For this, the following plugins [1] [2] sound interesting.
Plus, that'd definitely help to have alerts around other systemd services as well.

[1] https://icinga.com/docs/icinga-2/latest/doc/10-icinga-template-library/#systemd

Aug 23 2021, 3:09 PM · System administration
ardumont created P1128 gbp buildpackage for buster-swh of monitoring-plugins-systemd.
Aug 23 2021, 3:09 PM
vsellier accepted D6120: cassandra: Bump next_visit_id when origin_visit_add is called by a replayer.
Aug 23 2021, 2:50 PM
vsellier added a comment to T3492: cassandra: origin_visit_add should increase next_visit_id even when upserting.

It seems the problem is no longer present now (tested with several origins)

root@parasilo-19:~/swh-environment/docker# docker exec -ti docker_swh-loader_1 bash
swh@8e68948366b7:/$ swh loader run git https://github.com/slackhq/nebula
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/slackhq/nebula' with type 'git'
INFO:swh.loader.git.loader.GitLoader:Listed 293 refs for repo https://github.com/slackhq/nebula
{'status': 'uneventful'}
swh@8e68948366b7:/$ swh loader run git https://github.com/slackhq/nebula
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/slackhq/nebula' with type 'git'
INFO:swh.loader.git.loader.GitLoader:Listed 293 refs for repo https://github.com/slackhq/nebula
{'status': 'uneventful'}
swh@8e68948366b7:/$ swh loader run git https://github.com/slackhq/nebula
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/slackhq/nebula' with type 'git'
INFO:swh.loader.git.loader.GitLoader:Listed 293 refs for repo https://github.com/slackhq/nebula
{'status': 'uneventful'}
Aug 23 2021, 2:50 PM · Storage manager
anlambert triaged T3496: Handle webapp authentication error when session is no longer active as Normal priority.
Aug 23 2021, 2:01 PM · Web app, Authentication
DanSeraf updated the diff for D6114: swh-scanner: retrieve additional information about software artifacts.

commit message

Aug 23 2021, 1:25 PM
swh-public-ci added a comment to D6114: swh-scanner: retrieve additional information about software artifacts.

Build is green

Aug 23 2021, 1:16 PM
DanSeraf updated the diff for D6114: swh-scanner: retrieve additional information about software artifacts.

requested changes

Aug 23 2021, 1:13 PM
ardumont added a comment to T3495: The weekly report bot is down.

Looking into adding an icinga alert around this.

Aug 23 2021, 12:36 PM · System administration
dachary closed T3422: Running the benchmarks: August 6th, 2021, 9 days, a subtask of T3054: Scale out object storage design, as Resolved.
Aug 23 2021, 12:26 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary closed T3422: Running the benchmarks: August 6th, 2021, 9 days as Resolved.
Aug 23 2021, 12:26 PM · Object storage
dachary updated the task description for T3422: Running the benchmarks: August 6th, 2021, 9 days.
Aug 23 2021, 12:25 PM · Object storage
vsellier added a comment to T3492: cassandra: origin_visit_add should increase next_visit_id even when upserting.

The origin_visit topic was replayed with your diff during the weekend. let's test now if the worker behavior is more deterministic

Aug 23 2021, 11:42 AM · Storage manager
ardumont moved T3495: The weekly report bot is down from Weekly backlog to in-progress on the System administration board.
Aug 23 2021, 11:34 AM · System administration
ardumont added a comment to T3495: The weekly report bot is down.

The postfix server was down. It got restarted today.

Aug 23 2021, 11:32 AM · System administration
zack requested changes to D6114: swh-scanner: retrieve additional information about software artifacts.

Nice! And I also like the refactoring out of client.py.

Aug 23 2021, 11:18 AM
vlorentz added a task to D6120: cassandra: Bump next_visit_id when origin_visit_add is called by a replayer: T3492: cassandra: origin_visit_add should increase next_visit_id even when upserting.
Aug 23 2021, 10:59 AM
vlorentz added a revision to T3492: cassandra: origin_visit_add should increase next_visit_id even when upserting: D6120: cassandra: Bump next_visit_id when origin_visit_add is called by a replayer.
Aug 23 2021, 10:59 AM · Storage manager
vlorentz added a task to D6057: Add typing, and fix potential issues found by mypy.: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6056: Don't hide git-fsck error messages, even when none is expected: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6096: git_bare: Fix crash on dangling branches: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6097: git_bare: Deduplicate loading of release subgraphs: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6098: git_bare: Skip loading empty lists: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6099: git_bare: Add support for directories as snapshot branches: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6100: git_bare: add some modularity to directory creation: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6101: Rename obj_type to bundle_type: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6102: git_bare: Use an enum to represent the root object type: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6104: git_bare: Add support for contents pointed by snapshots: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6105: git_bare: Statically check for exhaustiveness of enum matching: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added a task to D6111: Add support for releases pointing to other releases or contents.: T843: Vault: Add a "git bare" tarball cooker.
Aug 23 2021, 10:55 AM
vlorentz added revisions to T843: Vault: Add a "git bare" tarball cooker: D6056: Don't hide git-fsck error messages, even when none is expected, D6057: Add typing, and fix potential issues found by mypy., D6096: git_bare: Fix crash on dangling branches, D6097: git_bare: Deduplicate loading of release subgraphs, D6098: git_bare: Skip loading empty lists, D6099: git_bare: Add support for directories as snapshot branches, D6100: git_bare: add some modularity to directory creation, D6101: Rename obj_type to bundle_type, D6102: git_bare: Use an enum to represent the root object type, D6103: git_bare: Add support for directories as snapshot branches, D6104: git_bare: Add support for contents pointed by snapshots, D6105: git_bare: Statically check for exhaustiveness of enum matching, D6111: Add support for releases pointing to other releases or contents..
Aug 23 2021, 10:55 AM · Vault
ardumont moved T3495: The weekly report bot is down from Backlog to Weekly backlog on the System administration board.
Aug 23 2021, 10:48 AM · System administration
vlorentz added a project to T3495: The weekly report bot is down: System administration.
Aug 23 2021, 9:22 AM · System administration
vlorentz triaged T3495: The weekly report bot is down as High priority.
Aug 23 2021, 9:22 AM · System administration
rdicosmo moved T3162: Services page iconography from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Aug 23 2021, 9:08 AM · Unknown Object (Project)
rdicosmo moved T3409: Prepare ambassador's blog post from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Aug 23 2021, 9:07 AM · Unknown Object (Project)

Aug 22 2021

Harbormaster failed remote builds in B23102: Diff 22145 for D6114: swh-scanner: retrieve additional information about software artifacts!
Aug 22 2021, 6:42 PM
swh-public-ci added a comment to D6114: swh-scanner: retrieve additional information about software artifacts.

Build has FAILED

Aug 22 2021, 6:42 PM
DanSeraf updated the diff for D6114: swh-scanner: retrieve additional information about software artifacts.

fix 'get_origin' response

Aug 22 2021, 6:40 PM

Aug 21 2021

vanisha10 created P1127 error.
Aug 21 2021, 2:51 PM
swh-public-ci added a comment to D6114: swh-scanner: retrieve additional information about software artifacts.

Build is green

Aug 21 2021, 11:21 AM
DanSeraf updated the diff for D6114: swh-scanner: retrieve additional information about software artifacts.

missing unit test

Aug 21 2021, 11:18 AM

Aug 20 2021

vlorentz requested review of D6121: Add test for origin_visit_get_latest in presence of mismatched id and date orders.
Aug 20 2021, 8:18 PM
vsellier committed rSENV1c4068100e99: packer/vagrant: upgrade debian buster to version 10.10 (authored by vsellier).
packer/vagrant: upgrade debian buster to version 10.10
Aug 20 2021, 6:59 PM
vlorentz requested review of D6120: cassandra: Bump next_visit_id when origin_visit_add is called by a replayer.
Aug 20 2021, 6:19 PM
vsellier committed rSENV023b0c6ca879: packer: update base image url as 10.9.0 is not anymore the current one (authored by vsellier).
packer: update base image url as 10.9.0 is not anymore the current one
Aug 20 2021, 6:16 PM
olasd closed T1981: Meta-task: upgrade infrastructure to Debian Buster as Resolved.

(superseded by the same task for bullseye)

Aug 20 2021, 6:14 PM · System administration