Page MenuHomeSoftware Heritage
Feed All Stories

Oct 18 2021

dachary changed the status of T3104: Persistent readonly perfect hash table from Open to Work in Progress.
Oct 18 2021, 9:02 PM · Object storage (RedHat collaboration)
dachary closed T3519: Persistent readonly perfect hash table: CI and package, a subtask of T3104: Persistent readonly perfect hash table, as Wontfix.
Oct 18 2021, 9:00 PM · Object storage (RedHat collaboration)
dachary closed T3519: Persistent readonly perfect hash table: CI and package as Wontfix.

This is a duplicate of T3634

Oct 18 2021, 9:00 PM · Object storage
dachary added a comment to T3520: Persistent readonly perfect hash table: implementation.

The draft implementation is available publicly at https://git.easter-eggs.org/biceps/swh-perfecthash/-/tree/wip-hash while D6424 is under review.

Oct 18 2021, 8:58 PM · Object storage (RedHat collaboration)
dachary added a comment to T3521: Persistent readonly perfect hash table: benchmarks.

The implementation of the benchmarks is prepared at:

Oct 18 2021, 8:57 PM · Object storage (RedHat collaboration)
dachary added a revision to T3520: Persistent readonly perfect hash table: implementation: D6424: Perfect hashmap C implementation.
Oct 18 2021, 8:46 PM · Object storage (RedHat collaboration)
dachary added a task to D6424: Perfect hashmap C implementation: T3520: Persistent readonly perfect hash table: implementation.
Oct 18 2021, 8:46 PM
dachary added a comment to T3104: Persistent readonly perfect hash table.

For the record I created a "draft" repository for contributions to https://forge.softwareheritage.org/source/swh-perfecthash/ at https://git.easter-eggs.org/biceps/swh-perfecthash. It is only meant to be a publicly available sandbox.

Oct 18 2021, 8:39 PM · Object storage (RedHat collaboration)
marla.dasilva created T3669: Press release SWH.
Oct 18 2021, 5:46 PM · Unknown Object (Project)
vsellier committed rSPSITE378bad416796: fix monthly report declaration (authored by vsellier).
fix monthly report declaration
Oct 18 2021, 5:36 PM
vsellier committed rSPSITEcbb7291583de: staging: fix journal1 cname declaration (authored by vsellier).
staging: fix journal1 cname declaration
Oct 18 2021, 5:21 PM
vsellier closed D6497: staging/kafka: decommission journal0.
Oct 18 2021, 5:14 PM
vsellier committed rSPSITE4516257094e0: staging/kafka: decommission journal0 (authored by vsellier).
staging/kafka: decommission journal0
Oct 18 2021, 5:14 PM
vsellier updated the diff for D6497: staging/kafka: decommission journal0.

"rebase"

Oct 18 2021, 5:11 PM
ardumont accepted D6498: staging: Migration of journal0 to storage1.

lgtm

Oct 18 2021, 4:55 PM
ardumont accepted D6499: staging: decomission journal0 vm.
Oct 18 2021, 4:52 PM
ardumont accepted D6497: staging/kafka: decommission journal0.

lgtm

Oct 18 2021, 4:51 PM
olasd added a comment to T3627: Consider dropping pull request references from the git loader ingestion.

B3 I am not convinced a "synthetic" flag on the Snapshot branch makes sense, or at least I find this name confusing, especially considering we already have a synthetic flag on Revision: it's not synthetic in the sense of it's not object crafted by SWH, it comes from the origin.

Oct 18 2021, 4:42 PM · Git loader
ardumont moved T3666: Fix swh-scheduler debian build from Weekly backlog to done on the System administration board.
Oct 18 2021, 4:19 PM · System administration
ardumont closed T3666: Fix swh-scheduler debian build as Resolved.

Build is now green again [1] [2]

Oct 18 2021, 4:19 PM · System administration
vsellier planned changes to D6448: Deploy a read-only objstorage on moma.
Oct 18 2021, 3:39 PM
vsellier requested review of D6499: staging: decomission journal0 vm.
Oct 18 2021, 3:34 PM
vsellier added a revision to T3630: staging - journal0 needs more space: D6499: staging: decomission journal0 vm.
Oct 18 2021, 3:34 PM · System administration
douardda triaged T3668: Improve the seaweedfs backend as Normal priority.
Oct 18 2021, 3:34 PM · Object storage
douardda created T3668: Improve the seaweedfs backend.
Oct 18 2021, 3:33 PM · Object storage
vsellier requested review of D6498: staging: Migration of journal0 to storage1.
Oct 18 2021, 3:28 PM
vsellier added a revision to T3630: staging - journal0 needs more space: D6498: staging: Migration of journal0 to storage1.
Oct 18 2021, 3:28 PM · System administration
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH7a6032201e61: Updated backport on buster-swh from debian/0.18.2-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.18.2-1_swh1 (unstable-swh)
Oct 18 2021, 3:21 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH1502e1b261bc: Merge tag 'debian/0.18.2-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.18.2-1_swh1' into debian/buster-swh
Oct 18 2021, 3:21 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH137d8c9f5622: pristine-tar data for swh-scheduler_0.18.2.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-scheduler_0.18.2.orig.tar.gz
Oct 18 2021, 3:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH628c955dcff3: Updated debian changelog for version 0.18.2 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.18.2
Oct 18 2021, 3:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH4241b214d6e2: New upstream version 0.18.2 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.18.2
Oct 18 2021, 3:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH9b989a85eb30: Update upstream source from tag 'debian/upstream/0.18.2' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.18.2'
Oct 18 2021, 3:19 PM
vsellier updated the diff for D6497: staging/kafka: decommission journal0.

Remove the journal0 alias for vagrant

Oct 18 2021, 3:16 PM
vsellier requested review of D6497: staging/kafka: decommission journal0.
Oct 18 2021, 3:14 PM
vsellier added a revision to T3630: staging - journal0 needs more space: D6497: staging/kafka: decommission journal0.
Oct 18 2021, 3:14 PM · System administration
ardumont closed D6496: Use swh_storage fixture for cli tests.
Oct 18 2021, 3:11 PM
ardumont committed rDSCH3aed6887fcb2: Use swh_storage fixture for cli tests (authored by ardumont).
Use swh_storage fixture for cli tests
Oct 18 2021, 3:11 PM
ardumont added a comment to D6496: Use swh_storage fixture for cli tests.

indeed ;)
Thanks.

Oct 18 2021, 3:11 PM
ardumont updated the task description for T3667: Orchestrate origins scheduling according to scheduler metrics feedback.
Oct 18 2021, 3:09 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
vlorentz added a comment to T3623: Run swh-graph with gunicorn to support multiple/parallel requests.

actually, before it starts leaking RAM, the Java process only uses 10% of the memory, so there is room to start a few more.

Oct 18 2021, 3:08 PM · Compressed graph service, System administration
anlambert accepted D6496: Use swh_storage fixture for cli tests.

Looks good to me, plus it aligns the tests with production settings.

Oct 18 2021, 3:06 PM
seirl closed T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet, a subtask of T3623: Run swh-graph with gunicorn to support multiple/parallel requests, as Resolved.
Oct 18 2021, 3:01 PM · Compressed graph service, System administration
seirl closed T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet as Resolved.

Done

Oct 18 2021, 3:01 PM · Compressed graph service, System administration
moranegg added a subtask for T3128: Improve deposit integration, management and display: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg added a parent task for T3174: Filter deposit-admin view by deposit client on admin (moderation) page: T3128: Improve deposit integration, management and display.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3173: Provide access to deposit-clients to view dedicated moderation page: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3375: Add column 'client' in moderation view: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg removed parent tasks for T3174: Filter deposit-admin view by deposit client on admin (moderation) page: T3375: Add column 'client' in moderation view, T3173: Provide access to deposit-clients to view dedicated moderation page.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg renamed T3173: Provide access to deposit-clients to view dedicated moderation page from Create profiles in keycloak for the deposit-client to view dedicated moderation page to Provide access to deposit-clients to view dedicated moderation page.
Oct 18 2021, 2:52 PM · Monitoring, SWORD deposit, Web app
moranegg updated subscribers of T1274: Web-app: deposit moderation view- use origin url for external-id.

this is old. I think this is resolved..
@ardumont , @anlambert ?

Oct 18 2021, 2:48 PM · Web app, SWORD deposit
douardda created P1202 (An Untitled Masterwork).
Oct 18 2021, 2:47 PM
ardumont updated the task description for T3667: Orchestrate origins scheduling according to scheduler metrics feedback.
Oct 18 2021, 2:37 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont updated the summary of D6496: Use swh_storage fixture for cli tests.
Oct 18 2021, 2:27 PM
ardumont updated the task description for T3666: Fix swh-scheduler debian build.
Oct 18 2021, 2:22 PM · System administration
ardumont requested review of D6496: Use swh_storage fixture for cli tests.
Oct 18 2021, 2:20 PM
ardumont added a revision to T3666: Fix swh-scheduler debian build: D6496: Use swh_storage fixture for cli tests.
Oct 18 2021, 2:17 PM · System administration
Harbormaster failed remote builds in B24491: Diff 23596 for D6494: cassandra: Fix incomplete check of content existence in object_find_by_sha1_git!
Oct 18 2021, 1:21 PM
swh-public-ci added a comment to D6494: cassandra: Fix incomplete check of content existence in object_find_by_sha1_git.

Build was aborted

Oct 18 2021, 1:21 PM
vlorentz requested review of D6494: cassandra: Fix incomplete check of content existence in object_find_by_sha1_git.
Oct 18 2021, 1:18 PM
ardumont closed T3665: Fix swh-docs builds (publish and dev) as Resolved.

Both build are now fixed.

Oct 18 2021, 1:11 PM · Documentation
moranegg added a comment to T3375: Add column 'client' in moderation view.

@anlambert here is another task to improve the deposit moderation/admin view

Oct 18 2021, 12:30 PM · Monitoring, SWORD deposit, Web app
ardumont closed D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.
Oct 18 2021, 12:29 PM
ardumont committed rDFUSEa300deca15eb: docs/images/Makefile: Drop unused pdf generation from the build (authored by ardumont).
docs/images/Makefile: Drop unused pdf generation from the build
Oct 18 2021, 12:29 PM
moranegg added a comment to T3376: Visualize metadata of a deposit in the admin (moderation) view.

@anlambert here is the task we have briefly discussed as step 2 this morning

Oct 18 2021, 12:29 PM · Monitoring, SWORD deposit, Web app
ardumont updated the task description for T3667: Orchestrate origins scheduling according to scheduler metrics feedback.
Oct 18 2021, 12:25 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont triaged T3667: Orchestrate origins scheduling according to scheduler metrics feedback as High priority.
Oct 18 2021, 12:24 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
vlorentz closed D6472: Add a script for a 'monthly roadmap report' bot email.
Oct 18 2021, 12:22 PM
vlorentz committed rSPSITE5d186a2a0cdb: Add a script for a 'monthly roadmap report' bot email (authored by vlorentz).
Add a script for a 'monthly roadmap report' bot email
Oct 18 2021, 12:22 PM
vlorentz updated the diff for D6472: Add a script for a 'monthly roadmap report' bot email.

rebase

Oct 18 2021, 12:22 PM
moranegg added a comment to T2624: Create strategy for documentation with a map or a full table of content.

https://docs.softwareheritage.org/devel/contributing/tutorial-docs-contribution.html#doc-contribution

Oct 18 2021, 12:16 PM · Roadmap 2021, meta-task, Documentation
moranegg moved T2624: Create strategy for documentation with a map or a full table of content from Pending validation to Done on the Roadmap 2021 board.
Oct 18 2021, 12:16 PM · Roadmap 2021, meta-task, Documentation
ardumont updated the task description for T3658: Reference bitbucket mercurial origins.
Oct 18 2021, 12:09 PM · System administration, Mercurial loader
ardumont updated the task description for T3658: Reference bitbucket mercurial origins.
Oct 18 2021, 12:09 PM · System administration, Mercurial loader
ardumont moved T3666: Fix swh-scheduler debian build from Backlog to Weekly backlog on the System administration board.
Oct 18 2021, 12:06 PM · System administration
ardumont added a project to T3666: Fix swh-scheduler debian build: System administration.
Oct 18 2021, 12:06 PM · System administration
ardumont triaged T3666: Fix swh-scheduler debian build as Normal priority.
Oct 18 2021, 12:05 PM · System administration
zack accepted D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.
Oct 18 2021, 12:01 PM
ardumont updated the task description for T3665: Fix swh-docs builds (publish and dev).
Oct 18 2021, 12:01 PM · Documentation
ardumont renamed T3665: Fix swh-docs builds (publish and dev) from Fix swh-docs publish build to Fix swh-docs builds (publish and dev).
Oct 18 2021, 12:00 PM · Documentation
douardda added a comment to T3627: Consider dropping pull request references from the git loader ingestion.

B3 I am not convinced a "synthetic" flag on the Snapshot branch makes sense, or at least I find this name confusing, especially considering we already have a synthetic flag on Revision: it's not synthetic in the sense of it's not object crafted by SWH, it comes from the origin.

Oct 18 2021, 11:59 AM · Git loader
ardumont accepted D6472: Add a script for a 'monthly roadmap report' bot email.

Thanks.

Oct 18 2021, 11:57 AM
swh-public-ci added a comment to D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.

Build is green

Oct 18 2021, 11:54 AM
olasd added a comment to T3661: docs: Activate build on docs diff.

I think the main challenge here will be doing this in such a way that we don't have to do a fresh clone of swh-environment (and all associated repos) every time we build.

Oct 18 2021, 11:53 AM · Documentation
ardumont retitled D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build from fuse: docs/images/Makefile: Drop unused pdf generation to fuse: docs/images/Makefile: Drop unused pdf generation from the build.
Oct 18 2021, 11:50 AM
ardumont updated the diff for D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.

Adapt according to review (commit msg adapted accordingly as well)

Oct 18 2021, 11:49 AM
ardumont added a comment to D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.

ok, thanks.

Oct 18 2021, 11:47 AM
zack requested changes to D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.
Oct 18 2021, 11:40 AM
olasd added a comment to T3627: Consider dropping pull request references from the git loader ingestion.

I would like us to conclude this discussion soon.

Oct 18 2021, 11:29 AM · Git loader
ardumont requested review of D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.
Oct 18 2021, 10:59 AM
ardumont added a revision to T3665: Fix swh-docs builds (publish and dev): D6493: fuse: docs/images/Makefile: Drop unused pdf generation from the build.
Oct 18 2021, 10:55 AM · Documentation
vsellier claimed T3665: Fix swh-docs builds (publish and dev).

Thanks, it's probably a regression of T3407. I will look at it.

Oct 18 2021, 10:00 AM · Documentation
ardumont updated the task description for T3665: Fix swh-docs builds (publish and dev).
Oct 18 2021, 9:54 AM · Documentation
ardumont added a comment to T3665: Fix swh-docs builds (publish and dev).

Someone opened an issue about this [1]. following breadcrumbs [1], it's apparently
because the defaut plantuml.jar used not have everything packaged within. As pdf support
is extra, we need to update the dependencies with it [2].

Oct 18 2021, 9:51 AM · Documentation
ardumont added a comment to T3665: Fix swh-docs builds (publish and dev).

fwiw, reproduced locally:

$ cd swh-fuse && git pull && cd docs/images
$ plantuml -version | head -1
PlantUML version 1.2021.9 (Sun Jul 25 12:13:56 CEST 2021)
$ plantuml -Tpdf arch-context.puml
java.lang.ClassNotFoundException: org.apache.batik.apps.rasterizer.SVGConverter
        at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:636)
        at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:182)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:519)
        at java.base/java.lang.Class.forName0(Native Method)
        at java.base/java.lang.Class.forName(Class.java:375)
        at net.sourceforge.plantuml.pdf.PdfConverter.convert(PdfConverter.java:57)
        at net.sourceforge.plantuml.UmlDiagram.exportDiagramInternalPdf(UmlDiagram.java:288)
        at net.sourceforge.plantuml.UmlDiagram.exportDiagramNow(UmlDiagram.java:140)
        at net.sourceforge.plantuml.AbstractPSystem.exportDiagram(AbstractPSystem.java:157)
        at net.sourceforge.plantuml.PSystemUtils.exportDiagramsCuca(PSystemUtils.java:233)
        at net.sourceforge.plantuml.PSystemUtils.exportDiagrams(PSystemUtils.java:89)
        at net.sourceforge.plantuml.SourceFileReaderAbstract.getGeneratedImages(SourceFileReaderAbstract.java:171)
        at net.sourceforge.plantuml.Run.manageFileInternal(Run.java:527)
        at net.sourceforge.plantuml.Run.processArgs(Run.java:410)
        at net.sourceforge.plantuml.Run.manageAllFiles(Run.java:377)
        at net.sourceforge.plantuml.Run.main(Run.java:205)
Exception in thread "main" java.lang.UnsupportedOperationException
        at net.sourceforge.plantuml.pdf.PdfConverter.convert(PdfConverter.java:76)
        at net.sourceforge.plantuml.UmlDiagram.exportDiagramInternalPdf(UmlDiagram.java:288)
        at net.sourceforge.plantuml.UmlDiagram.exportDiagramNow(UmlDiagram.java:140)
        at net.sourceforge.plantuml.AbstractPSystem.exportDiagram(AbstractPSystem.java:157)
        at net.sourceforge.plantuml.PSystemUtils.exportDiagramsCuca(PSystemUtils.java:233)
        at net.sourceforge.plantuml.PSystemUtils.exportDiagrams(PSystemUtils.java:89)
        at net.sourceforge.plantuml.SourceFileReaderAbstract.getGeneratedImages(SourceFileReaderAbstract.java:171)
        at net.sourceforge.plantuml.Run.manageFileInternal(Run.java:527)
        at net.sourceforge.plantuml.Run.processArgs(Run.java:410)
        at net.sourceforge.plantuml.Run.manageAllFiles(Run.java:377)
        at net.sourceforge.plantuml.Run.main(Run.java:205)
Oct 18 2021, 9:46 AM · Documentation
ardumont triaged T3665: Fix swh-docs builds (publish and dev) as Normal priority.
Oct 18 2021, 9:41 AM · Documentation
ardumont created T3665: Fix swh-docs builds (publish and dev).
Oct 18 2021, 9:41 AM · Documentation

Oct 17 2021

rdicosmo committed rMSLD5cd84cb4d4c3: Add PNSO2 en (authored by rdicosmo).
Add PNSO2 en
Oct 17 2021, 5:45 PM
rdicosmo committed rMSLD1e3f0b3fe482: Update policy module (authored by rdicosmo).
Update policy module
Oct 17 2021, 5:22 PM
rdicosmo committed rMSLD2f9036035df0: Add new support images (authored by rdicosmo).
Add new support images
Oct 17 2021, 5:22 PM