Page MenuHomeSoftware Heritage
Feed All Stories

Nov 29 2021

swh-public-ci added a comment to D6165: Add new RabbitMQ-based client/server API.

Build is green

Nov 29 2021, 2:48 PM
aeviso updated the diff for D6697: Add tests for conflict resolution functions.

rebase

Nov 29 2021, 2:46 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 29 2021, 2:45 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Nov 29 2021, 2:45 PM
anlambert closed D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 2:37 PM
anlambert committed rDLDSVNd0b14d9d08c8: ra: Fix parsing of svn link with multiple lines (authored by anlambert).
ra: Fix parsing of svn link with multiple lines
Nov 29 2021, 2:37 PM
stsp committed rDLDCVSbc00d6b16979: add a test for conversion of a file which contains a Header keyword (authored by stsp).
add a test for conversion of a file which contains a Header keyword
Nov 29 2021, 2:36 PM
stsp closed D6678: attempt to avoid content differences due to paths in keywords.
Nov 29 2021, 2:36 PM
stsp committed rDLDCVS5539ccb67b2a: attempt to avoid content differences due to paths in keywords (authored by stsp).
attempt to avoid content differences due to paths in keywords
Nov 29 2021, 2:36 PM
anlambert added inline comments to D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 2:35 PM
ardumont accepted D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 2:23 PM
anlambert requested review of D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 1:31 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6704: ra: Fix parsing of svn link with multiple lines.
Nov 29 2021, 1:27 PM · SVN Loader
anlambert closed D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 1:21 PM
anlambert committed rDLDSVNc2c27f1de847: ra: Persist link flag in FileState when replaying revisions (authored by anlambert).
ra: Persist link flag in FileState when replaying revisions
Nov 29 2021, 1:21 PM
swh-public-ci added a comment to D6702: ra: Persist link flag in FileState when replaying revisions.

Build is green

Nov 29 2021, 1:18 PM
zack changed the visibility for F5047255: sched.tar.gz.
Nov 29 2021, 1:16 PM
anlambert updated the diff for D6702: ra: Persist link flag in FileState when replaying revisions.

Use variable to store if path is a link

Nov 29 2021, 1:16 PM
zack added a comment to T3755: misleading 100% known summary in sunburst rendering.

I've tried replacing the content of foo.txt with something unknown to the archive (random garbage) and the sunburst rendering still shows 100.0%.
So it could also be a rounding error instead.
Either way, it is misleading and should be fixed.

Nov 29 2021, 1:14 PM · Code scanner
zack triaged T3755: misleading 100% known summary in sunburst rendering as Low priority.
Nov 29 2021, 1:10 PM · Code scanner
zack triaged T3754: scanning sunburst rendering fail with "ValueError: Empty data passed with indices specified." as Normal priority.
Nov 29 2021, 1:04 PM · Code scanner
zack created T3754: scanning sunburst rendering fail with "ValueError: Empty data passed with indices specified.".
Nov 29 2021, 1:04 PM · Code scanner
swh-public-ci added a comment to D6696: archive-changelog: Mention git integrity checks and package loaders writing releases.

Build has FAILED

Nov 29 2021, 12:44 PM
Harbormaster failed remote builds in B25223: Diff 24349 for D6696: archive-changelog: Mention git integrity checks and package loaders writing releases!
Nov 29 2021, 12:44 PM
anlambert added inline comments to D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 12:29 PM
vlorentz closed D6696: archive-changelog: Mention git integrity checks and package loaders writing releases.
Nov 29 2021, 12:26 PM
vlorentz committed rDDOC9304ba7f479f: archive-changelog: Mention git integrity checks and package loaders writing… (authored by vlorentz).
archive-changelog: Mention git integrity checks and package loaders writing…
Nov 29 2021, 12:26 PM
ardumont accepted D6696: archive-changelog: Mention git integrity checks and package loaders writing releases.
Nov 29 2021, 12:24 PM
Harbormaster failed to build B25221: rDWAPPSd7f3a3a4f8ce: common/archive: Add lookup_origin_snapshots function for rDWAPPSd7f3a3a4f8ce: common/archive: Add lookup_origin_snapshots function!
Nov 29 2021, 12:22 PM
ardumont closed D6703: Decomission old vault nodes (orangerie and orangeriedev).
Nov 29 2021, 12:16 PM
ardumont committed rSPSITE0d2ab8de6b5d: Decomission old vault nodes (orangerie and orangeriedev) (authored by ardumont).
Decomission old vault nodes (orangerie and orangeriedev)
Nov 29 2021, 12:15 PM
ardumont added a comment to D6702: ra: Persist link flag in FileState when replaying revisions.

One suggestion and one question inline though.m

Nov 29 2021, 12:14 PM
ardumont added inline comments to D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 12:14 PM
vlorentz updated the diff for D6696: archive-changelog: Mention git integrity checks and package loaders writing releases.

fix typo

Nov 29 2021, 12:11 PM
vlorentz requested review of D6696: archive-changelog: Mention git integrity checks and package loaders writing releases.
Nov 29 2021, 12:11 PM
vsellier accepted D6703: Decomission old vault nodes (orangerie and orangeriedev).

LGTM

Nov 29 2021, 12:09 PM
douardda added a comment to D6697: Add tests for conflict resolution functions.

When I did so with other tests your claim was that they were too difficult to follow and that tests should be as explicit as possible. These ones have a declarative function name for each case. What's the criteria after all?

Nov 29 2021, 12:08 PM
ardumont requested review of D6703: Decomission old vault nodes (orangerie and orangeriedev).
Nov 29 2021, 12:06 PM
ardumont added a revision to T3579: Meta-task: upgrade infrastructure to Debian Bullseye: D6703: Decomission old vault nodes (orangerie and orangeriedev).
Nov 29 2021, 12:06 PM · System administration (Component upgrades)
anlambert requested review of D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 11:54 AM
Harbormaster failed remote builds in B25217: Diff 24343 for D6691: common/archive: Add lookup_origin_snapshots function!
Nov 29 2021, 11:53 AM
swh-public-ci added a comment to D6691: common/archive: Add lookup_origin_snapshots function.

Build was aborted

Nov 29 2021, 11:53 AM
anlambert closed D6691: common/archive: Add lookup_origin_snapshots function.
Nov 29 2021, 11:48 AM
anlambert committed rDWAPPSd7f3a3a4f8ce: common/archive: Add lookup_origin_snapshots function (authored by anlambert).
common/archive: Add lookup_origin_snapshots function
Nov 29 2021, 11:47 AM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6702: ra: Persist link flag in FileState when replaying revisions.
Nov 29 2021, 11:43 AM · SVN Loader
dachary added a comment to D6701: objectstorage: http backend: test cannonicalization of URL.

The previous jenkins run shows the line was not covered by a test

Nov 29 2021, 11:41 AM
anlambert updated the diff for D6691: common/archive: Add lookup_origin_snapshots function.

Rebase

Nov 29 2021, 11:27 AM
swh-public-ci added a comment to D6691: common/archive: Add lookup_origin_snapshots function.

Build is green

Nov 29 2021, 11:22 AM
dachary requested review of D6701: objectstorage: http backend: test cannonicalization of URL.
Nov 29 2021, 11:09 AM
anlambert updated the diff for D6691: common/archive: Add lookup_origin_snapshots function.

Update docstring

Nov 29 2021, 10:59 AM
vlorentz accepted D6691: common/archive: Add lookup_origin_snapshots function.
Nov 29 2021, 10:55 AM
vlorentz accepted D6693: Add support for a redis-based reporter for failed replayed objects.

there is no easy solution (that I can see).

Nov 29 2021, 10:54 AM
vlorentz added inline comments to D6396: Implement maven jar source files loader.
Nov 29 2021, 10:52 AM
vlorentz requested changes to D6396: Implement maven jar source files loader.
Nov 29 2021, 10:36 AM
aeviso added a comment to D6697: Add tests for conflict resolution functions.

When I did so with other tests your claim was that they were too difficult to follow and that tests should be as explicit as possible. These ones have a declarative function name for each case. What's the criteria after all?

Nov 29 2021, 10:32 AM
ardumont added a comment to D6395: lister: Add new maven lister.

To land this, you just need to push

Nov 29 2021, 10:08 AM
ardumont accepted D6396: Implement maven jar source files loader.

Thanks for the last adaptations.

Nov 29 2021, 10:06 AM
douardda accepted D6697: Add tests for conflict resolution functions.

Fine for me; these tests could be written as parametrized tests (https://docs.pytest.org/en/6.2.x/parametrize.html#parametrize-basics) but not a big deal.

Nov 29 2021, 10:04 AM
douardda accepted D6699: Stop writing swhid2node.bin maps.

Looks overall ok to me, but I miss a few "why?" here:

  • the "why stop writing this file" should be in the commit message,
  • why the need for SortOutputHandler attributes to become final?
Nov 29 2021, 10:00 AM
dachary added a comment to T3634: Create swh-perfecthash module.

I pushed https://forge.softwareheritage.org/D6700 for inclusion in the documentation and from the output of

Nov 29 2021, 9:52 AM · Object storage
dachary added a revision to T3634: Create swh-perfecthash module: D6700: add swh-perfecthash.
Nov 29 2021, 9:48 AM · Object storage
dachary added a comment to T3634: Create swh-perfecthash module.

For the record, the documentation is disabled for now (see 1 and 2). I'll try to get it to build.

Nov 29 2021, 8:59 AM · Object storage
dachary updated the task description for T3634: Create swh-perfecthash module.
Nov 29 2021, 8:55 AM · Object storage

Nov 28 2021

rdicosmo committed rMSLD63c1ce1f04f7: Add stroke, and make consistent two dataflow images (authored by rdicosmo).
Add stroke, and make consistent two dataflow images
Nov 28 2021, 6:30 PM
swh-public-ci added a comment to D6396: Implement maven jar source files loader.

Build is green

Nov 28 2021, 12:31 PM
borisbaldassari updated the diff for D6396: Implement maven jar source files loader.
  • maven-loader: set the pom as metadata
  • maven-loader: fix after final review (ardumont, vlorentz)
Nov 28 2021, 12:29 PM

Nov 27 2021

steve088smith updated steve088smith.
Nov 27 2021, 1:51 PM

Nov 26 2021

vlorentz requested changes to D6396: Implement maven jar source files loader.
Nov 26 2021, 7:38 PM
vlorentz added inline comments to D6396: Implement maven jar source files loader.
Nov 26 2021, 7:38 PM
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Nov 26 2021, 6:52 PM · System administration (Component upgrades)
ardumont accepted D6395: lister: Add new maven lister.
Nov 26 2021, 6:18 PM
swh-public-ci added a comment to D6395: lister: Add new maven lister.

Build is green

Nov 26 2021, 6:06 PM
borisbaldassari updated the diff for D6395: lister: Add new maven lister.

Fix timezone issue, rebase.

Nov 26 2021, 6:04 PM
vsellier closed T3751: Upgrade swh-search elasticsearch servers to bullseye , a subtask of T3579: Meta-task: upgrade infrastructure to Debian Bullseye, as Resolved.
Nov 26 2021, 5:52 PM · System administration (Component upgrades)
vsellier closed T3751: Upgrade swh-search elasticsearch servers to bullseye as Resolved.

All the production nodes (`search-esnode[4-6]') are upgraded to bullseye

Nov 26 2021, 5:52 PM · System administration (Component upgrades)
ardumont accepted D6396: Implement maven jar source files loader.

@vlorentz you ok?

Nov 26 2021, 5:47 PM
swh-public-ci added a comment to D6396: Implement maven jar source files loader.

Build is green

Nov 26 2021, 5:45 PM
borisbaldassari updated the diff for D6396: Implement maven jar source files loader.

Rebase diff.

Nov 26 2021, 5:43 PM
swh-public-ci added a comment to D6396: Implement maven jar source files loader.

Build is green

Nov 26 2021, 5:41 PM
Harbormaster failed remote builds in B25209: Diff 24335 for D6395: lister: Add new maven lister!
Nov 26 2021, 5:41 PM
swh-public-ci added a comment to D6395: lister: Add new maven lister.

Build has FAILED

Nov 26 2021, 5:41 PM
borisbaldassari updated the diff for D6396: Implement maven jar source files loader.
  • maven-lister: fix datetime for time
Nov 26 2021, 5:38 PM
borisbaldassari updated the diff for D6395: lister: Add new maven lister.
  • maven-lister: set time to be iso8601 date str
Nov 26 2021, 5:38 PM
seirl requested review of D6699: Stop writing swhid2node.bin maps.
Nov 26 2021, 5:36 PM
seirl closed T3740: swh-graph: Translate node IDs on the Java side, not Python side, a subtask of T3739: swh-graph: Remove SWHID -> Node ID mapping, use MPH instead, as Resolved.
Nov 26 2021, 5:33 PM · Compressed graph service
seirl closed T3740: swh-graph: Translate node IDs on the Java side, not Python side as Resolved.
Nov 26 2021, 5:33 PM · Compressed graph service
vlorentz added a task to D6673: Add an introduction to the vault documentation: T3605: Document the vault architecture.
Nov 26 2021, 5:21 PM
vlorentz added a revision to T3605: Document the vault architecture: D6673: Add an introduction to the vault documentation.
Nov 26 2021, 5:21 PM · Vault, Documentation
vlorentz removed a project from T3752: Store/represent time offsets as strings: meta-task.
Nov 26 2021, 5:19 PM · Data Model, Storage manager
vlorentz removed a project from T3753: Store original git manifests: meta-task.
Nov 26 2021, 5:19 PM · Data Model, Storage manager
anlambert closed D6698: ra: Persist path executable flag in FileState when replaying revisions.
Nov 26 2021, 5:14 PM
anlambert committed rDLDSVN4bae0f9315d8: ra: Persist path executable flag in FileState when replaying revisions (authored by anlambert).
ra: Persist path executable flag in FileState when replaying revisions
Nov 26 2021, 5:14 PM
aeviso requested review of D6697: Add tests for conflict resolution functions.
Nov 26 2021, 5:14 PM
swh-public-ci added a comment to D6339: Add support for remote backend on existing storage tests.

Build is green

Nov 26 2021, 5:13 PM
ardumont accepted D6698: ra: Persist path executable flag in FileState when replaying revisions.

Nice catch.

Nov 26 2021, 5:12 PM
anlambert requested review of D6698: ra: Persist path executable flag in FileState when replaying revisions.
Nov 26 2021, 5:10 PM
swh-public-ci added a comment to D6165: Add new RabbitMQ-based client/server API.

Build is green

Nov 26 2021, 5:10 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6698: ra: Persist path executable flag in FileState when replaying revisions.
Nov 26 2021, 5:08 PM · SVN Loader
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 26 2021, 5:07 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Nov 26 2021, 5:07 PM