Page MenuHomeSoftware Heritage
Feed All Stories

Oct 11 2021

Harbormaster failed remote builds in B24362: Diff 23445 for D6424: Perfect hashmap C implementation!
Oct 11 2021, 4:10 PM
swh-public-ci added a comment to D6424: Perfect hashmap C implementation.

Build has FAILED

Oct 11 2021, 4:10 PM
dachary updated the diff for D6424: Perfect hashmap C implementation.

skeleton

Oct 11 2021, 4:10 PM
vlorentz committed rDDATASET7b883f16aea4: Rename remaining references to swh.model.identifiers. (authored by vlorentz).
Rename remaining references to swh.model.identifiers.
Oct 11 2021, 4:07 PM
anlambert retitled D6441: Deprecate /browse/origin/log/ URLs from Deprecate most of the /browse/origin/.* URLs to Deprecate /browse/origin/log/ URLs.
Oct 11 2021, 3:48 PM
anlambert requested changes to D6441: Deprecate /browse/origin/log/ URLs.

It seems that the browse-snapshot-log view is missing tests so we should create the file swh/web/tests/browse/views/test_snapshot.py
and implement tests here.

Oct 11 2021, 3:47 PM
jayeshv added inline comments to D6441: Deprecate /browse/origin/log/ URLs.
Oct 11 2021, 3:44 PM
jayeshv closed T3644: Code (directory) link is broken in snapshot view as Resolved by committing rDWAPPSd7c16735a46d: Fix navigation to directory(code) in snapshot view..
Oct 11 2021, 3:40 PM · Web app
jayeshv closed D6449: Navigation to directory(code) is broken in snapshot view.
Oct 11 2021, 3:39 PM
jayeshv committed rDWAPPSd7c16735a46d: Fix navigation to directory(code) in snapshot view. (authored by jayeshv).
Fix navigation to directory(code) in snapshot view.
Oct 11 2021, 3:39 PM
swh-public-ci added a comment to D6449: Navigation to directory(code) is broken in snapshot view.

Build is green

Oct 11 2021, 3:36 PM
anlambert accepted D6449: Navigation to directory(code) is broken in snapshot view.

Looks good to me, thanks !

Oct 11 2021, 3:35 PM
swh-public-ci added a comment to D6449: Navigation to directory(code) is broken in snapshot view.

Build is green

Oct 11 2021, 3:31 PM
jayeshv updated the diff for D6449: Navigation to directory(code) is broken in snapshot view.

Commit message changes to include "Fixes <ticket>"

Oct 11 2021, 3:20 PM
swh-public-ci added a comment to D6441: Deprecate /browse/origin/log/ URLs.

Build is green

Oct 11 2021, 3:17 PM
jayeshv updated the diff for D6449: Navigation to directory(code) is broken in snapshot view.

Review changes and changes to the commit message

Oct 11 2021, 3:15 PM
vlorentz added a comment to T75: Check integrity of directories, revisions, and releases.

this commit has lots of one-line "gpgsig" headers instead of a single "gpgsig" header with a multiline value: https://github.com/git-for-windows/git/commit/5f549aa2f78314ac37bbd436c8f80aea4c752e07

Oct 11 2021, 3:07 PM · Archive content, Restricted Project
jayeshv updated the diff for D6441: Deprecate /browse/origin/log/ URLs.

Review changes

Oct 11 2021, 3:01 PM
vlorentz triaged T3647: CloneFailure on non-existent hg repo hosted on phabricator as Normal priority.
Oct 11 2021, 2:56 PM · Mercurial loader
vlorentz updated the task description for T3595: Support disordered directory entries in git.
Oct 11 2021, 2:49 PM · meta-task, Data Model, Storage manager
vlorentz triaged T3646: Remove uses of valid domains from test data as Low priority.
Oct 11 2021, 2:38 PM · Easy hack
vlorentz created T3646: Remove uses of valid domains from test data.
Oct 11 2021, 2:38 PM · Easy hack
vlorentz closed D6453: converters: Prevent zero dates from being converted to null dates..
Oct 11 2021, 2:28 PM
vlorentz committed rDLDG0e824769ef86: converters: Prevent zero dates from being converted to null dates. (authored by vlorentz).
converters: Prevent zero dates from being converted to null dates.
Oct 11 2021, 2:28 PM
vlorentz closed D6433: serializers: Prepare rename of 'identifiers_enum' to 'swhids_enum'..
Oct 11 2021, 2:28 PM
vlorentz committed rDSTOe9fd74d72d0d: serializers: Prepare rename of 'identifiers_enum' to 'swhids_enum'. (authored by vlorentz).
serializers: Prepare rename of 'identifiers_enum' to 'swhids_enum'.
Oct 11 2021, 2:28 PM
vlorentz closed D6431: Rename imports of swh.model.identifiers to fix deprecation warnings..
Oct 11 2021, 2:28 PM
vlorentz committed rDSTOea86a862c043: Rename imports of swh.model.identifiers to fix deprecation warnings. (authored by vlorentz).
Rename imports of swh.model.identifiers to fix deprecation warnings.
Oct 11 2021, 2:28 PM
anlambert accepted D6453: converters: Prevent zero dates from being converted to null dates..

Looks good to me.

Oct 11 2021, 2:26 PM
Harbormaster failed remote builds in B24350: Diff 23434 for D6449: Navigation to directory(code) is broken in snapshot view!
Oct 11 2021, 2:21 PM
swh-public-ci added a comment to D6449: Navigation to directory(code) is broken in snapshot view.

Build was aborted

Oct 11 2021, 2:21 PM
vlorentz requested review of D6453: converters: Prevent zero dates from being converted to null dates..
Oct 11 2021, 2:21 PM
Harbormaster failed to build B24349: rDWAPPSdc489d1df2e5: Rename remaining references to swh.model.identifiers. for rDWAPPSdc489d1df2e5: Rename remaining references to swh.model.identifiers.!
Oct 11 2021, 2:21 PM
anlambert requested changes to D6449: Navigation to directory(code) is broken in snapshot view.

Looks good for the code but still some issues in the commit message (typo + formatting),
I would have done like this for instance.

Oct 11 2021, 2:17 PM
jayeshv added a comment to D6449: Navigation to directory(code) is broken in snapshot view.

Please use the imperative form in diff and commit titles. For example (respectively):

Fix navigation to directory(code) in snapshot view

and

Add an extra parameter called directory_url in the snapshot_context

To fix missing URL to the code (directory) view in case the snapshot is missing an origin context.

Related to T3644

or just this:

Fix missing URL to the code (directory) view in case the snapshot is missing an origin context.

Related to T3644

Two other nitpicks:

  1. it's easier for everyone to have the diff title and message match the commit message most of the time
  2. Use "Fixes Txxxx" or "Closes Txxxx" instead of "Related to Txxxx" for commits that completely fix an issue, it gives more details on the relation between the commit and the task.

See https://docs.softwareheritage.org/devel/contributing/git-style-guide.html

Oct 11 2021, 2:14 PM
swh-public-ci added a comment to D6431: Rename imports of swh.model.identifiers to fix deprecation warnings..

Build is green

Oct 11 2021, 2:10 PM
swh-public-ci added a comment to D6433: serializers: Prepare rename of 'identifiers_enum' to 'swhids_enum'..

Build is green

Oct 11 2021, 2:10 PM
vlorentz triaged T3645: cgit: handle "429 Too Many Requests" errors as Normal priority.
Oct 11 2021, 2:09 PM · Origin-CGit, CGit lister
vlorentz added a comment to D6449: Navigation to directory(code) is broken in snapshot view.

Please use the imperative form in diff and commit titles. For example (respectively):

Oct 11 2021, 2:05 PM
vlorentz updated the diff for D6433: serializers: Prepare rename of 'identifiers_enum' to 'swhids_enum'..

rebase

Oct 11 2021, 1:59 PM
vlorentz updated the diff for D6431: Rename imports of swh.model.identifiers to fix deprecation warnings..

rebase

Oct 11 2021, 1:59 PM
jayeshv updated the diff for D6449: Navigation to directory(code) is broken in snapshot view.

Review changes

Oct 11 2021, 1:58 PM
ardumont added a comment to D6452: Bootstrap new sysadm documentation instance.

You could replace conf.py's content with: from swh.docs.sphinx.conf import * # noqa

Oct 11 2021, 1:58 PM
vlorentz closed D6440: Rename remaining references to swh.model.identifiers..
Oct 11 2021, 1:58 PM
vlorentz committed rDWAPPSdc489d1df2e5: Rename remaining references to swh.model.identifiers. (authored by vlorentz).
Rename remaining references to swh.model.identifiers.
Oct 11 2021, 1:57 PM
vlorentz added a comment to D6452: Bootstrap new sysadm documentation instance.

You could replace conf.py's content with: from swh.docs.sphinx.conf import * # noqa

Oct 11 2021, 1:57 PM
anlambert closed T3618: Reschedule loading of dumb git origins submitted to "Save code now" service as Resolved.

Issues related to git dumb loading have been handled and the 5 dumb origins that were failing have been resubmitted through save code now and successfully loaded, closing this.

Oct 11 2021, 1:51 PM · Save Code Now, Archive coverage, Git loader
ardumont planned changes to D6380: Allow partial snapshot creation during ingestion.
Oct 11 2021, 1:47 PM
jayeshv added inline comments to D6441: Deprecate /browse/origin/log/ URLs.
Oct 11 2021, 1:47 PM
ardumont requested review of D6452: Bootstrap new sysadm documentation instance.
Oct 11 2021, 1:46 PM
ardumont added a revision to T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs: D6452: Bootstrap new sysadm documentation instance.
Oct 11 2021, 1:46 PM · System administration, Documentation
anlambert added inline comments to D6441: Deprecate /browse/origin/log/ URLs.
Oct 11 2021, 1:44 PM
ardumont requested review of D6451: swh-workers: Update pipeline configuration with new buffer setup.
Oct 11 2021, 1:40 PM
jayeshv added inline comments to D6441: Deprecate /browse/origin/log/ URLs.
Oct 11 2021, 1:38 PM
anlambert requested changes to D6449: Navigation to directory(code) is broken in snapshot view.

Looks good but some small changes are required.

Oct 11 2021, 1:33 PM
jayeshv requested review of D6449: Navigation to directory(code) is broken in snapshot view.
Oct 11 2021, 1:26 PM
ardumont added a comment to T3338: Load the archived bitbucket mercurial repositories.

The last origins are still ongoing. They are taking their time...

Oct 11 2021, 1:25 PM · System administration, Mercurial loader
vsellier closed T3616: Create a prometheus-statsd-exporter package for bullseye, a subtask of T3487: Installation of the new provenance server, as Resolved.
Oct 11 2021, 1:23 PM · System administration
vsellier closed T3616: Create a prometheus-statsd-exporter package for bullseye as Resolved.

solved by T3487#71814

Oct 11 2021, 1:23 PM · System administration
ardumont closed T3192: Add possibility to fetch last SWHID for a deposit using an origin on deposit cli, a subtask of T2996: Add possibility to fetch a list of deposits on the deposit cli, as Resolved.
Oct 11 2021, 1:23 PM · SWORD deposit
ardumont closed T3192: Add possibility to fetch last SWHID for a deposit using an origin on deposit cli as Resolved.
Oct 11 2021, 1:23 PM · Easy hack, SWORD deposit
ardumont moved T3192: Add possibility to fetch last SWHID for a deposit using an origin on deposit cli from In code review to Landed/Tests/Validations (staging) on the SWORD deposit board.
Oct 11 2021, 1:23 PM · Easy hack, SWORD deposit
vsellier closed T3617: Create a journalbeat package for bulleye, a subtask of T3487: Installation of the new provenance server, as Resolved.
Oct 11 2021, 1:23 PM · System administration
vsellier closed T3617: Create a journalbeat package for bulleye as Resolved.

solved by T3487#71814

Oct 11 2021, 1:23 PM · System administration
anlambert requested changes to D6441: Deprecate /browse/origin/log/ URLs.

I added some inline comments to handle.

Oct 11 2021, 1:22 PM
ardumont updated the summary of D6450: Let sourceforge origins be enabled by default.
Oct 11 2021, 1:21 PM
ardumont added a comment to D6424: Perfect hashmap C implementation.

I'll make sure to do that in the upcoming patches. As @olasd wrote, the merit of this patch is merely to set the stage and make sure the module can be compiled against the cmph library. The code between #if 0 is irrelevant and I can remove it to avoid confusion if you think it is better. Just let me know :-)

Oct 11 2021, 1:19 PM
ardumont abandoned D6410: Allow application/x-msgpack deserialization again.
Oct 11 2021, 1:18 PM
ardumont requested review of D6450: Let sourceforge origins be enabled by default.
Oct 11 2021, 1:11 PM
ardumont added a revision to T3470: lister-sourceforge: Activate sourceforge origins when listed: D6450: Let sourceforge origins be enabled by default.
Oct 11 2021, 1:06 PM · System administration, Archive coverage, Origin-SourceForge
jayeshv added a revision to T3641: Top level tabs not working in snapshot view: D6449: Navigation to directory(code) is broken in snapshot view.
Oct 11 2021, 1:05 PM · Web app
jayeshv triaged T3644: Code (directory) link is broken in snapshot view as Normal priority.
Oct 11 2021, 1:03 PM · Web app
douardda added a comment to T3627: Consider dropping pull request references from the git loader ingestion.

An alternative to annotating synthetic refs: add a "type" or "forge_type" attribute to snapshots.

Oct 11 2021, 12:33 PM · Git loader
jayeshv added a comment to T3641: Top level tabs not working in snapshot view.

Looks like the bug comes from that piece of javascript code. We should test if the pathname ends with /branches/ or /releases/ instead to activate the correct tab.

Oct 11 2021, 12:17 PM · Web app
zack added a comment to T3621: Create a production read-only objstorage.

Aside from the specific needs of the mirroring stack, the question at hand is whether the read-only object storage should be by default open to the public or not.

Oct 11 2021, 12:16 PM · System administration
douardda added a comment to T3632: Investigate the ContentDisallowed exception.

What's the difference in deployed dependencies versions (staging vs. prod)?

Oct 11 2021, 12:15 PM · Scheduling utilities
douardda added a comment to T3621: Create a production read-only objstorage.

For ENEA I'd llike to test different scenarios for the source objstorage:

Oct 11 2021, 12:12 PM · System administration
ardumont committed rSPSITEc64edbf2f27c: Empty unneeded env variable so celery does not complain about it (authored by ardumont).
Empty unneeded env variable so celery does not complain about it
Oct 11 2021, 12:11 PM
anlambert added a comment to T3641: Top level tabs not working in snapshot view.

Looks like the bug comes from that piece of javascript code. We should test if the pathname ends with /branches/ or /releases/ instead to activate the correct tab.

Oct 11 2021, 12:00 PM · Web app
vlorentz committed rDSNIPe1d8090fe868: analyze_consistency_failures.py: various performance improvements (authored by vlorentz).
analyze_consistency_failures.py: various performance improvements
Oct 11 2021, 10:41 AM
douardda added a comment to T3592: POC elastic worker infrastructure.

just a quick remark about the scheduling of (sub)tasks of this task: IMHO the autoscaling should come last; all the supervision/monitoring/logging related tasks are much more important than the autoscaling.

Oct 11 2021, 10:29 AM · System administration
jayeshv updated the task description for T3641: Top level tabs not working in snapshot view.
Oct 11 2021, 10:19 AM · Web app
jayeshv updated the task description for T3641: Top level tabs not working in snapshot view.
Oct 11 2021, 10:16 AM · Web app
jayeshv updated the task description for T3641: Top level tabs not working in snapshot view.
Oct 11 2021, 10:16 AM · Web app
ardumont closed D6439: Make workers send task events only when required.
Oct 11 2021, 9:48 AM
ardumont committed rSPSITEc03eb030f113: Make workers send task events only when required (authored by ardumont).
Make workers send task events only when required
Oct 11 2021, 9:48 AM
ardumont updated the diff for D6439: Make workers send task events only when required.

Rebase

Oct 11 2021, 9:45 AM
jayeshv triaged T3641: Top level tabs not working in snapshot view as Normal priority.
Oct 11 2021, 9:26 AM · Web app
dachary added a comment to D6424: Perfect hashmap C implementation.

@dachary It'd be nice if you could describe what this is about in the commit message and
the diff description (if you actually provide a commit description, then when you create
the diff, the commit message is used as a description bootstrap). I know it's more work
for you but it happens that:

  1. it helps the reviewers to have some context directly here (without having to follow

between a multitude of tasks. FYI, I've followed through the task but it's not enough,
i need to also dig in that arborescence of tasks).

  1. is also how we are doing that in every other modules ;)
  1. the curious could learn a thing or 2 even if they don't do a proper review.

Please and thanks in advance.

Cheers,

Oct 11 2021, 8:41 AM

Oct 9 2021

zack committed rDGRPHc29ee2787e27: findEarliestRevision: avoid failing in case of unknown SWHIDs (authored by zack).
findEarliestRevision: avoid failing in case of unknown SWHIDs
Oct 9 2021, 3:18 PM

Oct 8 2021

ardumont added a project to T3640: Make long running task stop fast when warm shutdown is triggered: System administration.
Oct 8 2021, 6:15 PM · System administration
ardumont updated subscribers of T3640: Make long running task stop fast when warm shutdown is triggered.
Oct 8 2021, 6:15 PM · System administration
ardumont updated the task description for T3640: Make long running task stop fast when warm shutdown is triggered.
Oct 8 2021, 6:12 PM · System administration
ardumont triaged T3640: Make long running task stop fast when warm shutdown is triggered as Normal priority.
Oct 8 2021, 6:11 PM · System administration
vsellier updated subscribers of T3621: Create a production read-only objstorage.

Sure, we should have authentication / rate limit on this.
But if I'm not wrong, the target is to test the mirroring with ENEA.
If we add authentication, we need to improve the objstorage-replayer / objstorage to support it.

Oct 8 2021, 6:00 PM · System administration
ardumont changed the status of T3625: Reduce git loader memory footprint from Open to Work in Progress.

btw ^

Oct 8 2021, 5:55 PM · Git loader
ardumont closed T3629: doc: Add a "how to save a forge" as in how it's currently done, a subtask of T1538: Add "forge" now, as Resolved.
Oct 8 2021, 5:55 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
ardumont closed T3629: doc: Add a "how to save a forge" as in how it's currently done as Resolved.
Oct 8 2021, 5:55 PM · Documentation
Harbormaster failed to build B24342: rDSTO3441f68985ae: buffer: add some debug logging for number of objects sent for rDSTO3441f68985ae: buffer: add some debug logging for number of objects sent!
Oct 8 2021, 5:48 PM
olasd added a comment to T3621: Create a production read-only objstorage.

Hmm, do we really want this to be open to the world with no authentication whatsoever? (which is what D6448 seems to be doing)

Oct 8 2021, 5:32 PM · System administration