Page MenuHomeSoftware Heritage
Feed All Stories

All Stories
Use Results
Edit Query

Oct 18 2022

swh-sentry-integration assigned T4644: replayer crashes on invalid directory entry name (b'gitter/gitter.xml') to vlorentz.
Oct 18 2022, 3:39 PM · Archive integrity, Object storage, Data Model
swh-public-ci added a comment to D8691: docs/grpc-api.rst: Add Python examples.

Build is green

Oct 18 2022, 3:31 PM
jayeshv requested review of D8704: [WIP] Move targets to separate objects with type and identifier.
Oct 18 2022, 2:58 PM
vlorentz requested review of D8703: Subscribe swh-search's journal client to indexed extrinsic metadata.
Oct 18 2022, 2:52 PM
vlorentz added a revision to T4599: Github descriptions are not used to search origins: D8703: Subscribe swh-search's journal client to indexed extrinsic metadata.
Oct 18 2022, 2:52 PM · Metadata workflow, Archive search
olasd committed rDSNIP2db58046fb27: gitlab: Testing before pushing considered good, actually. (authored by olasd).
gitlab: Testing before pushing considered good, actually.
Oct 18 2022, 2:38 PM
vlorentz added a comment to T4599: Github descriptions are not used to search origins.

I just checked with another project, and it is indeed in the journal:

Oct 18 2022, 2:37 PM · Metadata workflow, Archive search
anlambert added a comment to T4641: Jenkins jobs for swh-graph time out while cloning repository.

Passing --single-branch option to git clone do not result in a timeout:

$ git clone https://forge.softwareheritage.org/source/swh-graph.git
Cloning into 'swh-graph'...
error: RPC failed; HTTP 504 curl 22 The requested URL returned error: 504
fatal: the remote end hung up unexpectedly
Oct 18 2022, 2:32 PM · Compressed graph service, System administration, Continuous Integration
olasd committed rDSNIPdac6ea41a3d7: Add a simple script to manage gitlab group memberships (authored by olasd).
Add a simple script to manage gitlab group memberships
Oct 18 2022, 2:23 PM
anlambert requested review of D8702: tests: Simplify mercurial loading task creation tests implementation.
Oct 18 2022, 2:14 PM
anlambert requested review of D8701: tests: Simplify bzr loading task creation test implementation.
Oct 18 2022, 2:06 PM
swh-public-ci added a comment to D8700: tests: Simplify cvs loading task creation test implementation.

Build is green

Oct 18 2022, 1:57 PM
swh-public-ci added a comment to D8699: tests: Simplify svn loading tasks creation tests implementation.

Build is green

Oct 18 2022, 1:55 PM
anlambert updated the diff for D8700: tests: Simplify cvs loading task creation test implementation.

Parametrize test with extra loader arguments

Oct 18 2022, 1:54 PM
anlambert updated the diff for D8699: tests: Simplify svn loading tasks creation tests implementation.

Parametrize tests with extra loader arguments

Oct 18 2022, 1:52 PM
swh-public-ci added a comment to D8698: tests: Simplify git loading tasks creation tests implementation.

Build is green

Oct 18 2022, 1:49 PM
anlambert updated the diff for D8698: tests: Simplify git loading tasks creation tests implementation.

Parametrize tests with extra loader aguments

Oct 18 2022, 1:46 PM
anlambert requested review of D8700: tests: Simplify cvs loading task creation test implementation.
Oct 18 2022, 1:37 PM
anlambert added a comment to T4625: staging: ingest netbsd.org cvs forge.

@vsellier, I landed all optimizations for the CVS loader and tagged a new version v0.5.0 so you can retry the NetBSD repository loading on staging.

Oct 18 2022, 1:32 PM · System administration, Archive coverage
anlambert requested review of D8699: tests: Simplify svn loading tasks creation tests implementation.
Oct 18 2022, 1:28 PM
anlambert requested review of D8698: tests: Simplify git loading tasks creation tests implementation.
Oct 18 2022, 1:26 PM
vlorentz updated the task description for T4643: Cassandra: Use lower consistency level in `*_missing` methods when called from `*_add`.
Oct 18 2022, 12:34 PM · Storage manager
vlorentz updated the task description for T4643: Cassandra: Use lower consistency level in `*_missing` methods when called from `*_add`.
Oct 18 2022, 12:33 PM · Storage manager
vlorentz triaged T4643: Cassandra: Use lower consistency level in `*_missing` methods when called from `*_add` as Low priority.
Oct 18 2022, 12:32 PM · Storage manager
jayeshv closed D8694: Improve directory entry name filtering uisng casefolded strings.
Oct 18 2022, 12:22 PM
jayeshv committed rDGQLc6d410118d07: Improve directory entry name filtering uisng casefolded strings (authored by jayeshv).
Improve directory entry name filtering uisng casefolded strings
Oct 18 2022, 12:22 PM
anlambert accepted D8694: Improve directory entry name filtering uisng casefolded strings.

Looks good to me.

Oct 18 2022, 12:17 PM
swh-public-ci added a comment to D8694: Improve directory entry name filtering uisng casefolded strings.

Build is green

Oct 18 2022, 12:16 PM
jayeshv updated the diff for D8694: Improve directory entry name filtering uisng casefolded strings.

address review commnets

Oct 18 2022, 12:13 PM
anlambert added inline comments to D8694: Improve directory entry name filtering uisng casefolded strings.
Oct 18 2022, 12:01 PM
jayeshv added inline comments to D8694: Improve directory entry name filtering uisng casefolded strings.
Oct 18 2022, 11:58 AM
douardda created P1501 (An Untitled Masterwork).
Oct 18 2022, 11:53 AM
anlambert requested changes to D8694: Improve directory entry name filtering uisng casefolded strings.
Oct 18 2022, 11:49 AM
anlambert committed rDDOC14a934fd06df: user/listers,loaders: Remove links to apidocs (authored by anlambert).
user/listers,loaders: Remove links to apidocs
Oct 18 2022, 11:42 AM
anlambert committed rDDOC25e2498c265f: user/loaders: Add new loaders and update some links and statuses (authored by anlambert).
user/loaders: Add new loaders and update some links and statuses
Oct 18 2022, 11:42 AM
anlambert closed D8669: Update user documentation for listers and loaders.
Oct 18 2022, 11:42 AM
anlambert committed rDDOC2b88e3344edf: user/listers: Add conda lister and update some links and statuses (authored by anlambert).
user/listers: Add conda lister and update some links and statuses
Oct 18 2022, 11:42 AM
anlambert added a comment to D8669: Update user documentation for listers and loaders.
In D8669#225737, @vlorentz wrote:

apidoc links are sometimes useful. eg. https://docs.softwareheritage.org/devel/apidoc/swh.lister.crates.html documents the lister's design

Oct 18 2022, 11:41 AM
anlambert closed D8693: replay: Use swh.model.from_disk.Directory.collect.
Oct 18 2022, 11:37 AM
anlambert committed rDLDSVNaaa82617befc: replay: Use swh.model.from_disk.Directory.collect (authored by anlambert).
replay: Use swh.model.from_disk.Directory.collect
Oct 18 2022, 11:37 AM
ardumont moved T4639: Deploy swh-scrubber v0.1.1 from Weekly backlog to deployed/landed/monitoring on the System administration board.
Oct 18 2022, 11:22 AM · System administration, Datastore Scrubber
vlorentz updated the task description for T4642: swh.journal.indexed.origin_extrinsic_metadata topic has a single partition.
Oct 18 2022, 11:14 AM · System administration, Journal
vlorentz triaged T4642: swh.journal.indexed.origin_extrinsic_metadata topic has a single partition as Low priority.
Oct 18 2022, 11:14 AM · System administration, Journal
ardumont updated the task description for T4639: Deploy swh-scrubber v0.1.1.
Oct 18 2022, 11:11 AM · System administration, Datastore Scrubber
vlorentz accepted D8695: Move all non pytest-related functions from conftest to utils.py.
Oct 18 2022, 11:04 AM
douardda requested review of D8695: Move all non pytest-related functions from conftest to utils.py.
Oct 18 2022, 11:03 AM
vlorentz added a comment to T4599: Github descriptions are not used to search origins.

Bisecting, it seems the metadata is lost somewhere between the indexer storage:

Oct 18 2022, 10:51 AM · Metadata workflow, Archive search
ardumont updated the task description for T4639: Deploy swh-scrubber v0.1.1.
Oct 18 2022, 10:38 AM · System administration, Datastore Scrubber
vlorentz added a project to T4641: Jenkins jobs for swh-graph time out while cloning repository: Compressed graph service.
Oct 18 2022, 10:34 AM · Compressed graph service, System administration, Continuous Integration
vlorentz triaged T4641: Jenkins jobs for swh-graph time out while cloning repository as High priority.
Oct 18 2022, 10:34 AM · Compressed graph service, System administration, Continuous Integration
swh-public-ci added a comment to D8664: Raise 400 instead of 500 on 'incomplete' multipart request.

Build is green

Oct 18 2022, 10:33 AM
vlorentz requested review of D8691: docs/grpc-api.rst: Add Python examples.
Oct 18 2022, 10:32 AM
vlorentz added inline comments to D8664: Raise 400 instead of 500 on 'incomplete' multipart request.
Oct 18 2022, 10:26 AM
vlorentz updated the diff for D8664: Raise 400 instead of 500 on 'incomplete' multipart request.

rebase + remove redundant assertion

Oct 18 2022, 10:26 AM
ardumont moved T4639: Deploy swh-scrubber v0.1.1 from Backlog to Weekly backlog on the System administration board.
Oct 18 2022, 10:23 AM · System administration, Datastore Scrubber
ardumont accepted D8693: replay: Use swh.model.from_disk.Directory.collect.

Great! Simplification and convergence!

Oct 18 2022, 10:21 AM
ardumont accepted D8669: Update user documentation for listers and loaders.
Oct 18 2022, 10:18 AM
ardumont added inline comments to D8664: Raise 400 instead of 500 on 'incomplete' multipart request.
Oct 18 2022, 10:16 AM
ardumont accepted D8690: docs/grpc-api.rst: Update to match to current code.
Oct 18 2022, 10:05 AM
douardda abandoned D8692: tox: run grpc-related tests in a dedicated pytest session.

nope, does not work (as expected, actually)

Oct 18 2022, 10:00 AM
lunar added inline comments to D8664: Raise 400 instead of 500 on 'incomplete' multipart request.
Oct 18 2022, 9:20 AM
jayeshv requested review of D8694: Improve directory entry name filtering uisng casefolded strings.
Oct 18 2022, 9:15 AM

Oct 17 2022

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVSa17b458de938: Merge tag 'debian/0.5.1-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.5.1-1_swh1' into debian/buster-swh
Oct 17 2022, 7:53 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVS6e272157474d: Updated backport on buster-swh from debian/0.5.1-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.5.1-1_swh1 (unstable-swh)
Oct 17 2022, 7:53 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVSe5d228a27e5e: pristine-tar data for swh-loader-cvs_0.5.1.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-loader-cvs_0.5.1.orig.tar.gz
Oct 17 2022, 7:52 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVS70f98d2fc0d4: Updated debian changelog for version 0.5.1 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.5.1
Oct 17 2022, 7:52 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVSec55779cf6cb: Update upstream source from tag 'debian/upstream/0.5.1' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.5.1'
Oct 17 2022, 7:52 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVS3be7939dc5d7: New upstream version 0.5.1 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.5.1
Oct 17 2022, 7:52 PM
anlambert committed rDLDCVS3bf543ba318f: test_cvsclient: Mock subprocess (authored by anlambert).
test_cvsclient: Mock subprocess
Oct 17 2022, 7:48 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVS01622ba8c98e: pristine-tar data for swh-loader-cvs_0.5.0.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-loader-cvs_0.5.0.orig.tar.gz
Oct 17 2022, 7:30 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVSb58dfe6e0fdd: Updated debian changelog for version 0.5.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.5.0
Oct 17 2022, 7:30 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVS363097887a54: Update upstream source from tag 'debian/upstream/0.5.0' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.5.0'
Oct 17 2022, 7:30 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLDCVSd3520d3169df: New upstream version 0.5.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.5.0
Oct 17 2022, 7:30 PM
anlambert committed rDLDCVSc23d42501546: loader: Yield only modified objects in process_cvs_changesets (authored by anlambert).
loader: Yield only modified objects in process_cvs_changesets
Oct 17 2022, 7:26 PM
anlambert closed D8682: Improve CVS loader performances.
Oct 17 2022, 7:26 PM
anlambert committed rDLDCVSb976aa6a1f80: loader: Reconstruct repo filesystem incrementally at each revision (authored by anlambert).
loader: Reconstruct repo filesystem incrementally at each revision
Oct 17 2022, 7:26 PM
anlambert committed rDLDCVS4c72bb7e3e89: debian/control: Bump python3-swh.model (authored by anlambert).
debian/control: Bump python3-swh.model
Oct 17 2022, 7:25 PM
anlambert requested review of D8693: replay: Use swh.model.from_disk.Directory.collect.
Oct 17 2022, 7:25 PM
anlambert closed D8689: docs: Add info about CPAN extrinsic metadata format.
Oct 17 2022, 7:22 PM
anlambert committed rDSTO17d9ad235c3e: docs: Add info about CPAN extrinsic metadata format (authored by anlambert).
docs: Add info about CPAN extrinsic metadata format
Oct 17 2022, 7:22 PM
swh-public-ci added a comment to D8682: Improve CVS loader performances.

Build is green

Oct 17 2022, 7:21 PM
swh-public-ci added a comment to D8689: docs: Add info about CPAN extrinsic metadata format.

Build is green

Oct 17 2022, 7:20 PM
anlambert updated the diff for D8682: Improve CVS loader performances.

Add assert fallback

Oct 17 2022, 7:19 PM
swh-public-ci added a comment to D8682: Improve CVS loader performances.

Build is green

Oct 17 2022, 7:15 PM
anlambert updated the diff for D8682: Improve CVS loader performances.

Bump swh.model

Oct 17 2022, 7:12 PM
anlambert closed D8688: model: Fix hypothesis integration with attr < 21.3.0.
Oct 17 2022, 7:05 PM
anlambert committed rDMODdd3bab81af29: model: Fix hypothesis integration with attr < 21.3.0 (authored by anlambert).
model: Fix hypothesis integration with attr < 21.3.0
Oct 17 2022, 7:05 PM
anlambert updated the diff for D8689: docs: Add info about CPAN extrinsic metadata format.

Remove double pasted line

Oct 17 2022, 7:04 PM
anlambert added inline comments to D8689: docs: Add info about CPAN extrinsic metadata format.
Oct 17 2022, 7:03 PM
ardumont updated subscribers of T4064: Test GitLab migration scripts.

Plenty of fixes happened again.
Multiple iterations happened on bespin to further check the resulting scripts.

Oct 17 2022, 6:37 PM · System administration, GitLab migration, Roadmap 2020
vlorentz accepted D8692: tox: run grpc-related tests in a dedicated pytest session.

meh, but ok

Oct 17 2022, 6:36 PM
ardumont closed T4615: jenkins: Unstuck buster-swh image build as Resolved.
Oct 17 2022, 6:35 PM · System administration
ardumont closed T4614: Deploy swh-search v0.16.4 as Resolved.
Oct 17 2022, 6:35 PM · System administration, Archive search
ardumont closed T4614: Deploy swh-search v0.16.4, a subtask of T4599: Github descriptions are not used to search origins, as Resolved.
Oct 17 2022, 6:35 PM · Metadata workflow, Archive search
ardumont closed T4618: Migrate large workers (worker17-18) to elastic workers as Resolved.
Oct 17 2022, 6:35 PM · System administration
ardumont accepted D8664: Raise 400 instead of 500 on 'incomplete' multipart request.
Oct 17 2022, 6:35 PM
Harbormaster failed remote builds in B32336: Diff 31389 for D8692: tox: run grpc-related tests in a dedicated pytest session!
Oct 17 2022, 6:26 PM
swh-public-ci added a comment to D8692: tox: run grpc-related tests in a dedicated pytest session.

Build was aborted

Oct 17 2022, 6:26 PM
douardda requested review of D8692: tox: run grpc-related tests in a dedicated pytest session.
Oct 17 2022, 6:20 PM
Harbormaster failed to build B32335: rDPROV022b6f76614e: Add a 'swh provenance replay' cli command for rDPROV022b6f76614e: Add a 'swh provenance replay' cli command!
Oct 17 2022, 6:15 PM
First
Prev
Next
About · Developer information · Legal