Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 10 2022

ardumont updated the diff for D8825: Configure gitlab projects declaratively.
  • Manage only a list of namespaces and skip the other projects
  • Make the script outputs json (for easier parsing)
Nov 10 2022, 2:48 PM
ardumont updated the summary of D8825: Configure gitlab projects declaratively.
Nov 10 2022, 2:47 PM
ardumont added a comment to D8825: Configure gitlab projects declaratively.

Looks great, thanks.

Nov 10 2022, 2:07 PM
ardumont retitled D8825: Configure gitlab projects declaratively from gitlab projects: Unify project configuration to Allow gitlab projects configuration declaratively.
Nov 10 2022, 11:55 AM
ardumont updated the diff for D8825: Configure gitlab projects declaratively.

Adapt according to discussion and more

Nov 10 2022, 11:54 AM
ardumont added inline comments to D8825: Configure gitlab projects declaratively.
Nov 10 2022, 11:19 AM
ardumont added a comment to D8825: Configure gitlab projects declaratively.
In D8825#229537, @olasd wrote:

Looks nice!

I guess we may want to merge three levels of settings:

  • global (default) settings
  • per-namespace settings (for instance, to have all projects under infra/puppet/3rdparty have the same config overrides, e.g. disabling the issue tracker, changing the destination of webhooks to #swh-sysadm, etc.)
  • and per-repository settings (in the case of visibility, it's quite obvious)
Nov 10 2022, 11:09 AM

Nov 9 2022

ardumont added inline comments to D8825: Configure gitlab projects declaratively.
Nov 9 2022, 10:51 PM
ardumont requested review of D8825: Configure gitlab projects declaratively.
Nov 9 2022, 4:49 PM
ardumont accepted D8823: docker: Add support for incoming rpm loader.
Nov 9 2022, 3:02 PM

Nov 8 2022

ardumont accepted D8822: Makefile.sphinx: Exclude swh/*/conftest.py files from apidoc processing.
Nov 8 2022, 4:08 PM
ardumont accepted D8821: templates/stage-cypress-tests: Prevent race conditions between runners.
Nov 8 2022, 2:45 PM
ardumont accepted D8819: save_origin_webhooks: Fix tests when building debian buster package.
Nov 8 2022, 2:14 PM
ardumont accepted D8820: browse/origin-search: Ensure to encode origin URL argument in XHR calls.
Nov 8 2022, 2:14 PM
ardumont accepted D8815: tests: Reorganize test folders related to django applications.

Makes sense.

Nov 8 2022, 10:54 AM

Nov 7 2022

ardumont accepted D8811: sysadmin: document the argocd user management.

a couple of suggestions inline.

Nov 7 2022, 2:17 PM

Nov 2 2022

ardumont accepted D8801: cpan: Add extid manifest to CpanPackageInfo.
Nov 2 2022, 5:38 PM
ardumont added inline comments to D8799: codemeta: Fix crash on SWORD documents that specify an id.
Nov 2 2022, 2:25 PM

Oct 31 2022

ardumont accepted D8795: apidoc: Fix some issues regarding generated documentation links.
Oct 31 2022, 5:12 PM
ardumont accepted D8796: Revert "templates/stage-cypress-tests: Prevent race condition with support file".
Oct 31 2022, 4:17 PM
ardumont updated subscribers of D8760: Add payloads to ExtIDs.
Oct 31 2022, 2:54 PM
ardumont added a comment to D8760: Add payloads to ExtIDs.

It looks like the changes fail because CI doesn't know to use the model updates in D8759.

Oct 31 2022, 2:49 PM
ardumont accepted D8793: replay: Ensure copyfrom operations are properly handled.
Oct 31 2022, 2:38 PM
ardumont accepted D8787: loader: Compress dump file and rework truncated dump handling.

one non-blocking suggestion to explicit the compressed nature of the dump inline.

Oct 31 2022, 2:21 PM
ardumont accepted D8786: svn: Ensure to quote URLs provided as parameters to client methods.
Oct 31 2022, 2:13 PM
ardumont accepted D8791: docker/nginx: Align objstorage proxy_read_timeout value with production.
Oct 31 2022, 2:08 PM
ardumont accepted D8792: docker/conf/nginx: Remove no longer needed proxy and fix formatting.
Oct 31 2022, 2:08 PM
ardumont accepted D8794: converters, dumb: Fix errors since latest dulwich release (0.20.50).
Oct 31 2022, 12:16 PM
ardumont added a comment to T4538: Consider archiving NAR hashes.

Oh awesome! Thanks for pushing forward. :-)

Oct 31 2022, 12:14 PM · SVN Loader, Tarball loader, Nixguix loader

Oct 26 2022

ardumont accepted D8784: base/buster: add rpm2cpio dependency.
Oct 26 2022, 7:11 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 26 2022, 5:48 PM · Data Model, Nixguix loader
ardumont closed D8783: lister: Make sure lister that requires github tokens can use it.
Oct 26 2022, 5:38 PM
ardumont committed rDLS92d494261f26: lister: Make sure lister that requires github tokens can use it (authored by ardumont).
lister: Make sure lister that requires github tokens can use it
Oct 26 2022, 5:38 PM
ardumont updated the test plan for D8783: lister: Make sure lister that requires github tokens can use it.
Oct 26 2022, 5:37 PM
ardumont updated the summary of D8783: lister: Make sure lister that requires github tokens can use it.
Oct 26 2022, 5:36 PM
ardumont requested review of D8783: lister: Make sure lister that requires github tokens can use it.
Oct 26 2022, 5:35 PM
ardumont committed rDSNIPdb50b4777309: nixguix/analyze-result: Make --obj-type a multiple option (authored by ardumont).
nixguix/analyze-result: Make --obj-type a multiple option
Oct 26 2022, 2:45 PM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

With latest diffs, the filtering seems to sort properly the files and tarballs for the guix manifest:

Oct 26 2022, 2:44 PM · Data Model, Nixguix loader
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 26 2022, 2:34 PM · Data Model, Nixguix loader
ardumont closed T4662: staging: Deploy nixguix lister and loader, a subtask of T3781: Replace the Nixguix loader with a lister, as Invalid.
Oct 26 2022, 2:33 PM · Data Model, Nixguix loader
ardumont closed T4662: staging: Deploy nixguix lister and loader as Invalid.

/me sighs

Oct 26 2022, 2:33 PM · Data Model, Nixguix loader
ardumont triaged T4662: staging: Deploy nixguix lister and loader as Normal priority.
Oct 26 2022, 2:31 PM · Data Model, Nixguix loader
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 26 2022, 2:29 PM · Data Model, Nixguix loader
ardumont closed D8774: nixguix: Use content-disposition from http head request if provided.
Oct 26 2022, 2:28 PM
ardumont committed rDLS81688ca17e66: nixguix: Use content-disposition from http head request if provided (authored by ardumont).
nixguix: Use content-disposition from http head request if provided
Oct 26 2022, 2:28 PM
ardumont closed D8773: nixguix: Deal with edge case url with version instead of extension.
Oct 26 2022, 12:00 PM
ardumont committed rDLS026fea21da49: nixguix: Deal with edge case url with version instead of extension (authored by ardumont).
nixguix: Deal with edge case url with version instead of extension
Oct 26 2022, 12:00 PM
ardumont added inline comments to D8774: nixguix: Use content-disposition from http head request if provided.
Oct 26 2022, 12:00 PM
ardumont added inline comments to D8774: nixguix: Use content-disposition from http head request if provided.
Oct 26 2022, 11:59 AM
ardumont updated the diff for D8774: nixguix: Use content-disposition from http head request if provided.

Adapt according to last review

Oct 26 2022, 11:59 AM
ardumont updated the diff for D8773: nixguix: Deal with edge case url with version instead of extension.

Rebase (commit id mismatch locally and in the diff, don't recall what changed)
-> must be the commit message.

Oct 26 2022, 11:43 AM

Oct 25 2022

ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 25 2022, 6:57 PM · Data Model, Nixguix loader
ardumont updated subscribers of T3781: Replace the Nixguix loader with a lister.

Last analysis without [1]. That last diff should fix the key entries marked with the key 'only-version-should-be-tarball'.

Oct 25 2022, 6:53 PM · Data Model, Nixguix loader
ardumont committed rDSNIP4ff0739b5cae: nixguix/analyze-result: Improve extension grouping (authored by ardumont).
nixguix/analyze-result: Improve extension grouping
Oct 25 2022, 6:50 PM
ardumont committed rDSNIP5203c59a2bb3: nixguix/analyze-result: Improve command output (authored by ardumont).
nixguix/analyze-result: Improve command output
Oct 25 2022, 6:50 PM
ardumont added a comment to D8773: nixguix: Deal with edge case url with version instead of extension.

I think detecting versions is a lost cause. Here is what I had to do for PyPI:

https://forge.softwareheritage.org/source/swh-storage/browse/master/swh/storage/migrate_extrinsic_metadata.py$234-281
Oct 25 2022, 6:47 PM
ardumont updated the diff for D8774: nixguix: Use content-disposition from http head request if provided.

Rebase

Oct 25 2022, 6:16 PM
ardumont updated the diff for D8773: nixguix: Deal with edge case url with version instead of extension.

Improve the regexp version detection to be more restrictive.

Oct 25 2022, 6:16 PM
ardumont added inline comments to D8773: nixguix: Deal with edge case url with version instead of extension.
Oct 25 2022, 6:03 PM
ardumont added inline comments to D8773: nixguix: Deal with edge case url with version instead of extension.
Oct 25 2022, 6:03 PM
ardumont requested review of D8774: nixguix: Use content-disposition from http head request if provided.
Oct 25 2022, 5:56 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8774: nixguix: Use content-disposition from http head request if provided.
Oct 25 2022, 5:50 PM · Data Model, Nixguix loader
ardumont requested review of D8773: nixguix: Deal with edge case url with version instead of extension.
Oct 25 2022, 5:34 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8773: nixguix: Deal with edge case url with version instead of extension.
Oct 25 2022, 5:29 PM · Data Model, Nixguix loader
ardumont accepted D8767: replay: Ensure proper removal of external paths when deleting directory.

\o/

Oct 25 2022, 3:42 PM
ardumont committed rDSNIPca822ba76bf5: nixguix: Reference the snippet of code to check dataset result (authored by ardumont).
nixguix: Reference the snippet of code to check dataset result
Oct 25 2022, 3:03 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 25 2022, 2:50 PM · Data Model, Nixguix loader
ardumont accepted D8764: metadata: Make default tool configuration follow swh.indexer versions.

Something like this needs to happen on content indexer too (regarding their respective tools file and nomossa).

Oct 25 2022, 2:43 PM
ardumont closed D8763: nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 1:40 PM
ardumont committed rDLSca4ab7f277dc: nixguix: Allow lister to ignore specific extensions (authored by ardumont).
nixguix: Allow lister to ignore specific extensions
Oct 25 2022, 1:40 PM
ardumont closed D8761: nixguix/test: Add all supported tarball extensions to test manifest.
Oct 25 2022, 1:40 PM
ardumont committed rDLSd96a39d5b056: nixguix/test: Add all supported tarball extensions to test manifest (authored by ardumont).
nixguix/test: Add all supported tarball extensions to test manifest
Oct 25 2022, 1:40 PM
ardumont updated the diff for D8763: nixguix: Allow lister to ignore specific extensions.

Adapt according to last review (merge variable comment, drop spurious .copy)

Oct 25 2022, 12:09 PM
ardumont added inline comments to D8763: nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 12:08 PM
ardumont closed D8758: swh.core.tarball: Wire support to existing tarball.
Oct 25 2022, 11:57 AM
ardumont committed rDCORE306a74d01a99: swh.core.tarball: Add support for war files as well (authored by ardumont).
swh.core.tarball: Add support for war files as well
Oct 25 2022, 11:57 AM
ardumont updated the diff for D8763: nixguix: Allow lister to ignore specific extensions.
  • Add missing test
  • Fix another test
Oct 25 2022, 11:54 AM
ardumont updated the diff for D8763: nixguix: Allow lister to ignore specific extensions.

Rename variable parameter with a better name

Oct 25 2022, 11:41 AM
ardumont added inline comments to D8763: nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 11:41 AM
ardumont updated the diff for D8763: nixguix: Allow lister to ignore specific extensions.
  • Rebase
  • Refactor common code on extension detection
  • Adapt docstring and commit message
  • Default extensions to ignore
  • Adapt constructor to extend extension to ignore if any is passed around
Oct 25 2022, 11:38 AM
ardumont retitled D8763: nixguix: Allow lister to ignore specific extensions from nixguix: Allow lister configuration to ignore specific extensions to nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 11:37 AM
ardumont updated the diff for D8761: nixguix/test: Add all supported tarball extensions to test manifest.

Rebase

Oct 25 2022, 11:29 AM
ardumont added inline comments to D8763: nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 11:11 AM
ardumont requested review of D8763: nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 10:46 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8763: nixguix: Allow lister to ignore specific extensions.
Oct 25 2022, 10:41 AM · Data Model, Nixguix loader
ardumont updated the diff for D8761: nixguix/test: Add all supported tarball extensions to test manifest.

Rework commit message

Oct 25 2022, 10:40 AM
ardumont retitled D8761: nixguix/test: Add all supported tarball extensions to test manifest from nixguix/test: Add all supported extensions in test manifest to nixguix/test: Add all supported tarball extensions to test manifest.
Oct 25 2022, 10:40 AM
ardumont closed D8757: Add support for more tarball/zip extensions.
Oct 25 2022, 10:16 AM
ardumont committed rDLS31eb5f637f69: Add support for more tarball recognition based on extensions (authored by ardumont).
Add support for more tarball recognition based on extensions
Oct 25 2022, 10:16 AM
ardumont requested review of D8761: nixguix/test: Add all supported tarball extensions to test manifest.
Oct 25 2022, 10:14 AM
ardumont requested review of D8758: swh.core.tarball: Wire support to existing tarball.
Oct 25 2022, 10:12 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8761: nixguix/test: Add all supported tarball extensions to test manifest.
Oct 25 2022, 10:09 AM · Data Model, Nixguix loader
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Add missing new archive format in test manifest

Oct 25 2022, 10:06 AM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Add dataset around newly supported tarball formats

Oct 25 2022, 9:49 AM

Oct 24 2022

ardumont added inline comments to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 5:19 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Fix missing comma

Oct 24 2022, 4:41 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Fix typos

Oct 24 2022, 4:40 PM
ardumont added inline comments to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:39 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8758: swh.core.tarball: Wire support to existing tarball.
Oct 24 2022, 4:38 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Checks that newly detected extensions are actually supported already.
Summary [1] and the actual checks [2]:

Oct 24 2022, 4:36 PM · Data Model, Nixguix loader