Page MenuHomeSoftware Heritage
Feed All Stories

Oct 24 2022

zack created P1505 (An Untitled Masterwork).
Oct 24 2022, 4:46 PM
swh-public-ci added a comment to D8757: Add support for more tarball/zip extensions.

Build is green

Oct 24 2022, 4:46 PM
zack created P1504 (An Untitled Masterwork).
Oct 24 2022, 4:45 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Fix missing comma

Oct 24 2022, 4:41 PM
vlorentz requested changes to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:40 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Fix typos

Oct 24 2022, 4:40 PM
vlorentz requested changes to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:39 PM
ardumont added inline comments to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:39 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8758: swh.core.tarball: Wire support to existing tarball.
Oct 24 2022, 4:38 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Checks that newly detected extensions are actually supported already.
Summary [1] and the actual checks [2]:

Oct 24 2022, 4:36 PM · Data Model, Nixguix loader
anlambert added inline comments to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:34 PM
swh-public-ci added a comment to D8757: Add support for more tarball/zip extensions.

Build is green

Oct 24 2022, 4:33 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Fix test comment

Oct 24 2022, 4:28 PM
ardumont added inline comments to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:26 PM
anlambert accepted D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:16 PM
swh-public-ci added a comment to D8757: Add support for more tarball/zip extensions.

Build is green

Oct 24 2022, 4:15 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Update test too

Oct 24 2022, 4:09 PM
Harbormaster failed remote builds in B32526: Diff 31572 for D8704: [WIP] Move targets to separate objects with type and identifier!
Oct 24 2022, 4:03 PM
swh-public-ci added a comment to D8704: [WIP] Move targets to separate objects with type and identifier.

Build has FAILED

Oct 24 2022, 4:03 PM
jayeshv updated the diff for D8704: [WIP] Move targets to separate objects with type and identifier.

Use a generic identifier

Oct 24 2022, 4:00 PM
ardumont requested review of D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 3:59 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 3:53 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

I had a pass on extensions to further check what's a tarball or not [1]

Oct 24 2022, 3:19 PM · Data Model, Nixguix loader
ardumont created P1503 check extensions are actual tarballs or not.
Oct 24 2022, 3:18 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 24 2022, 3:17 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Improved version with noisy urls printed alongside the hash output [1] [2]:

Oct 24 2022, 3:16 PM · Data Model, Nixguix loader
vlorentz added a revision to T2309: Add support for other hash algo than sha1 in current objstorage implementation: D8756: azure: Add tests based on Azurite in addition to mocks.
Oct 24 2022, 2:45 PM · Object storage
lunar added a comment to D8634: Prepare the tests to run in Jenkins.

with the same idea as the inline comment, it would be better to rename the network like 'swh-mirror' rather than 'swhtest-mirror'.

Oct 24 2022, 2:40 PM
lunar updated the diff for D8634: Prepare the tests to run in Jenkins.
  • Rename swhtest-mirror network to swh-mirror
  • Re-add monitoring nodes to the required services to run the tests
  • Add missing label to troubleshooting section
Oct 24 2022, 2:38 PM
swh-public-ci added a comment to D8747: conda: Yield listed origins after all artifacts in a page are processed.

Build is green

Oct 24 2022, 1:45 PM
anlambert updated the diff for D8747: conda: Yield listed origins after all artifacts in a page are processed.

Rebase and address @vlorentz comments

Oct 24 2022, 1:40 PM
anlambert added inline comments to D8747: conda: Yield listed origins after all artifacts in a page are processed.
Oct 24 2022, 1:36 PM
anlambert added inline comments to D8747: conda: Yield listed origins after all artifacts in a page are processed.
Oct 24 2022, 1:33 PM
anlambert added inline comments to D8379: Hackage: Loads Hackage Listed origins.
Oct 24 2022, 1:29 PM
vlorentz closed D8754: Fix documentation build.
Oct 24 2022, 12:54 PM
vlorentz committed rDSTO82ad28bb29f5: Fix documentation build (authored by vlorentz).
Fix documentation build
Oct 24 2022, 12:54 PM
swh-public-ci added a comment to D8748: Nuget: Implement incremental listing.

Build is green

Oct 24 2022, 11:54 AM
franckbret updated the diff for D8748: Nuget: Implement incremental listing.

Improve documentation section related to incremental listing

Oct 24 2022, 11:48 AM
ardumont closed D8752: gogs/lister: Allow public gogs instance listing.
Oct 24 2022, 11:41 AM
ardumont committed rDLS8a82bbf95fd2: gogs/lister: Allow public gogs instance listing (authored by ardumont).
gogs/lister: Allow public gogs instance listing
Oct 24 2022, 11:41 AM
vlorentz edited projects for T4654: swh-indexer produces dates not supported by swh-search/ElasticSearch, added: Archive search; removed Restricted Project.
Oct 24 2022, 10:49 AM · Archive search, Indexer
vsellier closed T4642: swh.journal.indexed.origin_extrinsic_metadata topic has a single partition as Invalid.

Task moved on gitlab: https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4653

Oct 24 2022, 10:49 AM · System administration, Journal
vlorentz triaged T4654: swh-indexer produces dates not supported by swh-search/ElasticSearch as High priority.
Oct 24 2022, 10:49 AM · Archive search, Indexer
swh-sentry-integration assigned T4654: swh-indexer produces dates not supported by swh-search/ElasticSearch to vlorentz.
Oct 24 2022, 10:49 AM · Archive search, Indexer
vlorentz requested review of D8755: Reset Sentry tags when leaving an object's context.
Oct 24 2022, 10:42 AM
swh-public-ci added a comment to D8690: docs/grpc-api.rst: Update to match to current code.

Build is green

Oct 24 2022, 10:42 AM
vlorentz requested changes to D8747: conda: Yield listed origins after all artifacts in a page are processed.

Could you add docstrings to the test? I don't understand what they are expected to test

Oct 24 2022, 10:40 AM
ardumont accepted D8754: Fix documentation build.
Oct 24 2022, 10:39 AM
Harbormaster failed remote builds in B32515: Diff 31561 for D8691: docs/grpc-api.rst: Add Python examples!
Oct 24 2022, 10:38 AM
swh-public-ci added a comment to D8691: docs/grpc-api.rst: Add Python examples.

Build has FAILED

Oct 24 2022, 10:38 AM
vlorentz closed D8691: docs/grpc-api.rst: Add Python examples.
Oct 24 2022, 10:33 AM
vlorentz closed D8690: docs/grpc-api.rst: Update to match to current code.
Oct 24 2022, 10:33 AM
vlorentz committed rDGRPHedcca81a60fb: docs/grpc-api.rst: Add Python examples (authored by vlorentz).
docs/grpc-api.rst: Add Python examples
Oct 24 2022, 10:33 AM
vlorentz committed rDGRPH76a57eda9e90: docs/grpc-api.rst: Update to match to current code (authored by vlorentz).
docs/grpc-api.rst: Update to match to current code
Oct 24 2022, 10:33 AM
vlorentz updated the diff for D8691: docs/grpc-api.rst: Add Python examples.

rebase

Oct 24 2022, 10:33 AM
vlorentz updated the diff for D8690: docs/grpc-api.rst: Update to match to current code.

rebase

Oct 24 2022, 10:33 AM
vlorentz closed T4451: Fetch extrinsic metadata from Gitea/Gogs, a subtask of T4457: Index metadata from Gitea/Gogs, as Resolved.
Oct 24 2022, 10:13 AM · Origin-Gitea/Gogs, Extrinsic metadata, Indexer
vlorentz closed T4451: Fetch extrinsic metadata from Gitea/Gogs, a subtask of T2202: Collect extrinsic metadata, as Resolved.
Oct 24 2022, 10:13 AM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata
vlorentz closed T4451: Fetch extrinsic metadata from Gitea/Gogs as Resolved.
Oct 24 2022, 10:13 AM · Origin-Gitea/Gogs, Extrinsic metadata
vlorentz added inline comments to D8379: Hackage: Loads Hackage Listed origins.
Oct 24 2022, 10:06 AM
swh-public-ci added a comment to D8691: docs/grpc-api.rst: Add Python examples.

Build is green

Oct 24 2022, 10:06 AM
swh-public-ci added a comment to D8691: docs/grpc-api.rst: Add Python examples.

Build is green

Oct 24 2022, 10:04 AM
swh-public-ci added a comment to D8691: docs/grpc-api.rst: Add Python examples.

Build is green

Oct 24 2022, 10:04 AM
vlorentz added inline comments to D8691: docs/grpc-api.rst: Add Python examples.
Oct 24 2022, 10:00 AM
vlorentz updated the diff for D8691: docs/grpc-api.rst: Add Python examples.

Blacken example

Oct 24 2022, 10:00 AM
vlorentz updated the diff for D8691: docs/grpc-api.rst: Add Python examples.

fix commit set

Oct 24 2022, 9:58 AM
vlorentz updated the diff for D8691: docs/grpc-api.rst: Add Python examples.

repeat semantics of FieldMasks in Python examples

Oct 24 2022, 9:58 AM
swh-public-ci added a comment to D8379: Hackage: Loads Hackage Listed origins.

Build is green

Oct 24 2022, 9:45 AM
franckbret added inline comments to D8379: Hackage: Loads Hackage Listed origins.
Oct 24 2022, 9:44 AM
franckbret closed D8566: Conda: Anaconda packages archive loader.
Oct 24 2022, 9:43 AM
franckbret committed rDLDBASEe7ba6316315d: Conda: Anaconda packages archive loader (authored by franckbret).
Conda: Anaconda packages archive loader
Oct 24 2022, 9:43 AM
franckbret updated the diff for D8379: Hackage: Loads Hackage Listed origins.

fix issue with hexadecimal representation of the checksum md5 hash

Oct 24 2022, 9:41 AM
vlorentz closed T4527: scrubber: keep a state file for postgresql datastores as Resolved.
Oct 24 2022, 9:34 AM · Datastore Scrubber

Oct 23 2022

vlorentz requested review of D8754: Fix documentation build.
Oct 23 2022, 5:54 PM
KShivendu added a revision to T4648: Introduce RPM Loader: D8753: feat: Introduce RPM loader.
Oct 23 2022, 8:23 AM · RPM loader

Oct 22 2022

vlorentz added a comment to T4480: NpmMapping: Add basic support of SPDX expressions.

oops, not the same issue

Oct 22 2022, 4:51 PM · Indexer, Easy hack
swh-sentry-integration added a comment to T4480: NpmMapping: Add basic support of SPDX expressions.

Sentry issue: SWH-INDEXER-HB

Oct 22 2022, 4:51 PM · Indexer, Easy hack
vlorentz added a comment to T4651: indexer/extrinsic_metadata: ParseError: syntax error: line 1, column 0.

This happens on staging from that time we accidentally created N one-byte documents instead of one document with N bytes.

Oct 22 2022, 4:47 PM · Indexer
olasd committed R263:2b12c984f5f7: Implement new "migrated" status in Phabricator (authored by olasd).
Implement new "migrated" status in Phabricator
Oct 22 2022, 2:36 PM
olasd committed R263:2d85b319fbba: Implement new "migrated" status in Phabricator (authored by olasd).
Implement new "migrated" status in Phabricator
Oct 22 2022, 2:35 PM
olasd committed R263:a9dcd5176446: Add a bunch more statuses recorded in Phabricator revisions (authored by olasd).
Add a bunch more statuses recorded in Phabricator revisions
Oct 22 2022, 2:12 PM
zimoun added a comment to T4538: Consider archiving NAR hashes.

Oh awesome! Thanks for pushing forward. :-)

Oct 22 2022, 12:46 PM · SVN Loader, Tarball loader, Nixguix loader

Oct 21 2022

swh-public-ci added a comment to D8752: gogs/lister: Allow public gogs instance listing.

Build is green

Oct 21 2022, 6:27 PM
anlambert accepted D8752: gogs/lister: Allow public gogs instance listing.

LGTM

Oct 21 2022, 6:27 PM
ardumont updated the diff for D8752: gogs/lister: Allow public gogs instance listing.

Right you are

Oct 21 2022, 6:22 PM
anlambert added inline comments to D8752: gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:18 PM
swh-public-ci added a comment to D8752: gogs/lister: Allow public gogs instance listing.

Build is green

Oct 21 2022, 6:17 PM
swh-public-ci added a comment to D8752: gogs/lister: Allow public gogs instance listing.

Build is green

Oct 21 2022, 6:15 PM
ardumont triaged T4651: indexer/extrinsic_metadata: ParseError: syntax error: line 1, column 0 as Normal priority.
Oct 21 2022, 6:13 PM · Indexer
ardumont updated the diff for D8752: gogs/lister: Allow public gogs instance listing.

Amend commit message

Oct 21 2022, 6:12 PM
ardumont retitled D8752: gogs/lister: Allow public gogs instance listing from gogs/lister: Allow listing on public gogs instance to gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:11 PM
ardumont added inline comments to D8752: gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:10 PM
ardumont updated the diff for D8752: gogs/lister: Allow public gogs instance listing.

Adapt according to suggestion

Oct 21 2022, 6:10 PM
ardumont requested review of D8752: gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:08 PM
vsellier added a comment to T4587: Add forge now - process https://gitweb.gentoo.org/.

task will be handled in gitlab: https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4648

Oct 21 2022, 5:53 PM · Unknown Object (Project)
douardda closed D8740: tests: only flush() the kafka journal writer once per test.
Oct 21 2022, 5:48 PM
douardda committed rDSTO0e8da810ac96: tests: only flush() the kafka journal writer once per test (authored by douardda).
tests: only flush() the kafka journal writer once per test
Oct 21 2022, 5:48 PM
ardumont accepted D8740: tests: only flush() the kafka journal writer once per test.
Oct 21 2022, 5:45 PM
douardda added a comment to D8740: tests: only flush() the kafka journal writer once per test.

On the outstanding sample of one execution on jenkins: 11min 44s vs 13min 39s (previous execution, before this diff)

Oct 21 2022, 5:43 PM
douardda requested review of D8740: tests: only flush() the kafka journal writer once per test.
Oct 21 2022, 5:38 PM