Page MenuHomeSoftware Heritage
Feed All Stories

Sep 28 2021

Alphare added a comment to T3611: Define the mapping for Bazaar repositories/branches to the SWH data model.

The conclusions in the meeting were as follows:

Sep 28 2021, 5:02 PM · Data Model, BZR loader
douardda created P1181 (An Untitled Masterwork).
Sep 28 2021, 4:54 PM
anlambert edited P1180 (An Untitled Masterwork).
Sep 28 2021, 4:51 PM
anlambert created P1180 (An Untitled Masterwork).
Sep 28 2021, 4:48 PM
douardda created P1179 (An Untitled Masterwork).
Sep 28 2021, 4:46 PM
swh-public-ci added a comment to D6348: Clarify local/remote heads type as those are hexadecimal bytes str.

Build is green

Sep 28 2021, 4:16 PM
ardumont added inline comments to D6348: Clarify local/remote heads type as those are hexadecimal bytes str.
Sep 28 2021, 4:14 PM
ardumont updated the diff for D6348: Clarify local/remote heads type as those are hexadecimal bytes str.

Fix type

Sep 28 2021, 4:13 PM
vsellier triaged T3617: Create a journalbeat package for bulleye as Normal priority.
Sep 28 2021, 4:08 PM · System administration
ardumont renamed T3615: Adapt rabbitmq monitoring for bullseye from Adapt rabbimq monitoring for bullseye to Adapt rabbitmq monitoring for bullseye.
Sep 28 2021, 4:08 PM · System administration
ardumont updated the test plan for D6367: Adapt the prometheus rabbitmq plugin for bullseye.
Sep 28 2021, 4:03 PM · System administration
vsellier triaged T3616: Create a prometheus-statsd-exporter package for bullseye as Normal priority.
Sep 28 2021, 4:03 PM · System administration
ardumont added a revision to T3615: Adapt rabbitmq monitoring for bullseye: D6367: Adapt the prometheus rabbitmq plugin for bullseye.
Sep 28 2021, 4:03 PM · System administration
ardumont requested review of D6367: Adapt the prometheus rabbitmq plugin for bullseye.
Sep 28 2021, 4:03 PM · System administration
vsellier triaged T3615: Adapt rabbitmq monitoring for bullseye as Normal priority.
Sep 28 2021, 4:02 PM · System administration
Harbormaster failed remote builds in B24054: Diff 23141 for D6348: Clarify local/remote heads type as those are hexadecimal bytes str!
Sep 28 2021, 3:42 PM
swh-public-ci added a comment to D6348: Clarify local/remote heads type as those are hexadecimal bytes str.

Build has FAILED

Sep 28 2021, 3:42 PM
ardumont updated the diff for D6348: Clarify local/remote heads type as those are hexadecimal bytes str.

Rebase

Sep 28 2021, 3:40 PM
ardumont triaged T3614: Deploy swh.loader.git v1.1.0 and swh.model v3.0 as Normal priority.
Sep 28 2021, 3:39 PM · System administration, Git loader
anlambert closed D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 3:11 PM
anlambert committed rDLDGd3976ca6504c: loader: Add support for dumb HTTP transfer protocol (authored by anlambert).
loader: Add support for dumb HTTP transfer protocol
Sep 28 2021, 3:11 PM
ardumont committed rSPSITEf02668a43c66: Fix met's correct ip address (authored by ardumont).
Fix met's correct ip address
Sep 28 2021, 3:08 PM
ardumont closed D6365: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:55 PM
ardumont committed rSPSITE530e01d211ff: Adapt pgbouncer connection information for the provenance server (authored by ardumont).
Adapt pgbouncer connection information for the provenance server
Sep 28 2021, 2:55 PM
ardumont updated the diff for D6365: Adapt postgresql connection information on the provenance server.

Rebase

Sep 28 2021, 2:55 PM
vsellier accepted D6365: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:54 PM
ardumont updated the test plan for D6365: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:53 PM
ardumont updated the diff for D6365: Adapt postgresql connection information on the provenance server.

Use correct branch

Sep 28 2021, 2:51 PM
ardumont requested review of D6365: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:49 PM
ardumont added a revision to T3487: Installation of the new provenance server: D6365: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:49 PM · System administration
vsellier closed D6364: provenance: declare rabbitmq users.
Sep 28 2021, 2:49 PM
vsellier committed rSPSITEd38d468c061c: provenance: declare rabbitmq users (authored by vsellier).
provenance: declare rabbitmq users
Sep 28 2021, 2:49 PM
vsellier updated the diff for D6364: provenance: declare rabbitmq users.

rebase

Sep 28 2021, 2:48 PM
vsellier committed rSPPRIVC2362ec691041: Generate censored data from uncensored repository (authored by vsellier).
Generate censored data from uncensored repository
Sep 28 2021, 2:47 PM
swh-public-ci added a comment to D6342: loader: Add support for dumb HTTP transfer protocol.

Build is green

Sep 28 2021, 2:46 PM
anlambert updated the diff for D6342: loader: Add support for dumb HTTP transfer protocol.

Update: move comment inside if block

Sep 28 2021, 2:44 PM
ardumont closed D6363: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:39 PM
ardumont committed rSPSITEed1297dd6955: Adapt postgresql connection information on the provenance server (authored by ardumont).
Adapt postgresql connection information on the provenance server
Sep 28 2021, 2:39 PM
vlorentz accepted D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 2:39 PM
vsellier accepted D6363: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:38 PM
ardumont accepted D6364: provenance: declare rabbitmq users.
Sep 28 2021, 2:38 PM
vsellier requested review of D6364: provenance: declare rabbitmq users.
Sep 28 2021, 2:36 PM
vsellier added a revision to T3487: Installation of the new provenance server: D6364: provenance: declare rabbitmq users.
Sep 28 2021, 2:36 PM · System administration
ardumont requested review of D6363: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:35 PM
ardumont added a revision to T3487: Installation of the new provenance server: D6363: Adapt postgresql connection information on the provenance server.
Sep 28 2021, 2:35 PM · System administration
ardumont committed rSENVbfc658e9a0ce: Update puppet facts (authored by ardumont).
Update puppet facts
Sep 28 2021, 2:33 PM
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 2:22 PM
vlorentz added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 2:08 PM
anlambert updated the language for P1178 swh-web config from autodetect to yaml.
Sep 28 2021, 2:07 PM
anlambert created P1178 swh-web config.
Sep 28 2021, 2:07 PM
swh-public-ci added a comment to D6318: opam: Allow shared state between loader runs using multi-instance opam root.

Build is green

Sep 28 2021, 1:55 PM
swh-public-ci added a comment to D6340: opam: Define a initialize_opam_root parameter for opam loader.

Build is green

Sep 28 2021, 1:55 PM
swh-public-ci added a comment to D6318: opam: Allow shared state between loader runs using multi-instance opam root.

Build is green

Sep 28 2021, 1:54 PM
ardumont updated the diff for D6318: opam: Allow shared state between loader runs using multi-instance opam root.

Fix diff

Sep 28 2021, 1:51 PM
swh-public-ci added a comment to D6342: loader: Add support for dumb HTTP transfer protocol.

Build is green

Sep 28 2021, 1:51 PM
ardumont updated the diff for D6340: opam: Define a initialize_opam_root parameter for opam loader.

Use the right diff id

Sep 28 2021, 1:50 PM
ardumont updated the diff for D6318: opam: Allow shared state between loader runs using multi-instance opam root.

Actually update the diff?

Sep 28 2021, 1:50 PM
swh-public-ci added a comment to D6318: opam: Allow shared state between loader runs using multi-instance opam root.

Build is green

Sep 28 2021, 1:49 PM
ardumont retitled D6340: opam: Define a initialize_opam_root parameter for opam loader from opam: Define a production mode (default) to opam: Define a initialize_opam_root parameter for opam loader.
Sep 28 2021, 1:49 PM
anlambert updated the diff for D6342: loader: Add support for dumb HTTP transfer protocol.

Update:

  • Increase tests coverage: handle bare repo without pack files and check dumb repo can still be loaded if dulwich raises an exception in fetch_pack
  • Improve comment
Sep 28 2021, 1:48 PM
ardumont updated the diff for D6318: opam: Allow shared state between loader runs using multi-instance opam root.

Adapt according to suggestion

Sep 28 2021, 1:47 PM
jayeshv closed D6362: Broken link fix.
Sep 28 2021, 1:45 PM
jayeshv committed rDDOC766cc455bf59: Broken link fix (authored by jayeshv).
Broken link fix
Sep 28 2021, 1:45 PM
ardumont accepted D6362: Broken link fix.
Sep 28 2021, 1:34 PM
ardumont added a comment to D6340: opam: Define a initialize_opam_root parameter for opam loader.

Not a big fan of calling it production, because it implies it changes a bunch of settings in a non-granual way.

Sep 28 2021, 1:34 PM
swh-public-ci added a comment to D6361: mercurial: Rename from_disk module to the main and official loader.

Build is green

Sep 28 2021, 1:34 PM
swh-public-ci added a comment to D6360: mercurial: Drop legacy loader.

Build is green

Sep 28 2021, 1:32 PM
jayeshv requested review of D6362: Broken link fix.
Sep 28 2021, 1:32 PM
ardumont updated the diff for D6361: mercurial: Rename from_disk module to the main and official loader.

Rebase and adapt docstring according to suggestion

Sep 28 2021, 1:31 PM
ardumont updated the diff for D6360: mercurial: Drop legacy loader.

Adapt commit message

Sep 28 2021, 1:30 PM
ardumont retitled D6360: mercurial: Drop legacy loader from mercurial: Drop dead code to mercurial: Drop legacy loader.
Sep 28 2021, 1:30 PM
aeviso updated the summary of D6272: Remove remote storage based on `swh.core.api.RPCClient`.
Sep 28 2021, 1:26 PM
vlorentz accepted D6361: mercurial: Rename from_disk module to the main and official loader.
Sep 28 2021, 1:04 PM
vlorentz added a comment to D6340: opam: Define a initialize_opam_root parameter for opam loader.

Not a big fan of calling it production, because it implies it changes a bunch of settings in a non-granual way.

Sep 28 2021, 1:02 PM
vlorentz accepted D6357: Split `Provenance::flush` method in two (one per layer).
Sep 28 2021, 12:58 PM
vlorentz accepted D6360: mercurial: Drop legacy loader.

s/dead code/the legacy loader/ in commit/diff title

Sep 28 2021, 12:58 PM
ardumont added a comment to T3613: svn: An error occurred when running svnrdump and no exploitable dump file has been generated..

I was looking into it a bit more and realize that it's related to what you said
(origin not found).

Sep 28 2021, 12:41 PM · SVN Loader
ardumont updated the task description for T3487: Installation of the new provenance server.
Sep 28 2021, 12:02 PM · System administration
swh-public-ci added a comment to D6341: model: Replace attrs-strict with stricter validation.

Build is green

Sep 28 2021, 11:55 AM
vlorentz updated the diff for D6341: model: Replace attrs-strict with stricter validation.
  • add extensive testing
  • remove special-casing of IntEnum and add converter for Directory.perms
  • replace origin not in (Union,)
  • fix a typo (raise False)
  • add comment explaining why we don't check for dict and list
Sep 28 2021, 11:53 AM
ardumont moved T3470: lister-sourceforge: Activate sourceforge origins when listed from Backlog to Weekly backlog on the System administration board.
Sep 28 2021, 11:47 AM · System administration, Archive coverage, Origin-SourceForge
ardumont moved T3487: Installation of the new provenance server from Weekly backlog to in-progress on the System administration board.
Sep 28 2021, 11:47 AM · System administration
ardumont moved T3487: Installation of the new provenance server from Backlog to Weekly backlog on the System administration board.
Sep 28 2021, 11:47 AM · System administration
ardumont closed T3568: Deploy opam lister/loader to production, a subtask of T3424: Opam support, as Resolved.
Sep 28 2021, 11:46 AM · Archive coverage, Opam
ardumont closed T3568: Deploy opam lister/loader to production as Resolved.
Sep 28 2021, 11:46 AM · System administration, Archive coverage, Opam
ardumont moved T3568: Deploy opam lister/loader to production from in-progress to deployed/landed/monitoring on the System administration board.
Sep 28 2021, 11:46 AM · System administration, Archive coverage, Opam
ardumont changed the status of T3568: Deploy opam lister/loader to production, a subtask of T3424: Opam support, from Open to Work in Progress.
Sep 28 2021, 11:46 AM · Archive coverage, Opam
ardumont changed the status of T3568: Deploy opam lister/loader to production from Open to Work in Progress.
Sep 28 2021, 11:46 AM · System administration, Archive coverage, Opam
ardumont added a project to T3568: Deploy opam lister/loader to production: System administration.
Sep 28 2021, 11:46 AM · System administration, Archive coverage, Opam
ardumont added a comment to T3568: Deploy opam lister/loader to production.

That's done. The remaining part is about optimization. So closing.

Sep 28 2021, 11:46 AM · System administration, Archive coverage, Opam
vsellier added a comment to T3487: Installation of the new provenance server.

The zfs pool and dataset are configured:

  • pool configuration
## nvme drives pool
#zpool create data mirror nvme-eui.36315030525005540025384500000003 nvme-eui.36315030525005800025384500000003 mirror nvme-eui.36315030525005620025384500000003 nvme-eui.36315030525005890025384500000003
Sep 28 2021, 11:45 AM · System administration
ardumont updated the task description for T3487: Installation of the new provenance server.
Sep 28 2021, 11:44 AM · System administration
ardumont closed T3457: Some git repositories are failing to be ingested because of MemoryError as Resolved.

I've deployed dulwich on our workers.
As a bonus, upstream merged the patch \o/.

Sep 28 2021, 11:42 AM · Git loader
swh-public-ci added a comment to D6361: mercurial: Rename from_disk module to the main and official loader.

Build is green

Sep 28 2021, 11:30 AM
ardumont updated the diff for D6361: mercurial: Rename from_disk module to the main and official loader.

Fix missing old from_disk reference

Sep 28 2021, 11:28 AM
ardumont requested review of D6361: mercurial: Rename from_disk module to the main and official loader.
Sep 28 2021, 11:26 AM
ardumont added a revision to T3612: Clean up mercurial loader code: D6361: mercurial: Rename from_disk module to the main and official loader.
Sep 28 2021, 11:24 AM · Mercurial loader
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 11:20 AM
vlorentz committed rDSNIPd8af1457ddb7: check_consistency.py: Add support for releases (authored by vlorentz).
check_consistency.py: Add support for releases
Sep 28 2021, 11:18 AM
anlambert closed D6343: misc/coverage: Add heptapod to listed origins.
Sep 28 2021, 11:16 AM