Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 24 2022

ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Fix test comment

Oct 24 2022, 4:28 PM
ardumont added inline comments to D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 4:26 PM
ardumont updated the diff for D8757: Add support for more tarball/zip extensions.

Update test too

Oct 24 2022, 4:09 PM
ardumont requested review of D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 3:59 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8757: Add support for more tarball/zip extensions.
Oct 24 2022, 3:53 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

I had a pass on extensions to further check what's a tarball or not [1]

Oct 24 2022, 3:19 PM · Data Model, Nixguix loader
ardumont created P1503 check extensions are actual tarballs or not.
Oct 24 2022, 3:18 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 24 2022, 3:17 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Improved version with noisy urls printed alongside the hash output [1] [2]:

Oct 24 2022, 3:16 PM · Data Model, Nixguix loader
ardumont closed D8752: gogs/lister: Allow public gogs instance listing.
Oct 24 2022, 11:41 AM
ardumont committed rDLS8a82bbf95fd2: gogs/lister: Allow public gogs instance listing (authored by ardumont).
gogs/lister: Allow public gogs instance listing
Oct 24 2022, 11:41 AM
ardumont accepted D8754: Fix documentation build.
Oct 24 2022, 10:39 AM

Oct 21 2022

ardumont updated the diff for D8752: gogs/lister: Allow public gogs instance listing.

Right you are

Oct 21 2022, 6:22 PM
ardumont triaged T4651: indexer/extrinsic_metadata: ParseError: syntax error: line 1, column 0 as Normal priority.
Oct 21 2022, 6:13 PM · Indexer
ardumont updated the diff for D8752: gogs/lister: Allow public gogs instance listing.

Amend commit message

Oct 21 2022, 6:12 PM
ardumont retitled D8752: gogs/lister: Allow public gogs instance listing from gogs/lister: Allow listing on public gogs instance to gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:11 PM
ardumont added inline comments to D8752: gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:10 PM
ardumont updated the diff for D8752: gogs/lister: Allow public gogs instance listing.

Adapt according to suggestion

Oct 21 2022, 6:10 PM
ardumont requested review of D8752: gogs/lister: Allow public gogs instance listing.
Oct 21 2022, 6:08 PM
ardumont accepted D8740: tests: only flush() the kafka journal writer once per test.
Oct 21 2022, 5:45 PM
ardumont updated subscribers of T4538: Consider archiving NAR hashes.

fwiw, I've iterated a bit over @zimoun's code and pushed it into the snippets repository
(see commits above and their commit description message). It's also able to deal with
git, hg and svn trees (ignoring their respective top metadata folder .git, .svn, ...
without impacting the performance).

Oct 21 2022, 3:46 PM · SVN Loader, Tarball loader, Nixguix loader
ardumont committed rDSNIP36e3d021495d: nixguix/nar: Only filter on the first level (authored by ardumont).
nixguix/nar: Only filter on the first level
Oct 21 2022, 12:41 PM
ardumont committed rDSNIP9c5d75a6e74f: nixguix: Make nar ignore .hg and .svn folders as well (authored by ardumont).
nixguix: Make nar ignore .hg and .svn folders as well
Oct 21 2022, 12:16 PM
ardumont committed rDSNIPf3979ba25e52: nixguix: Document a bit the nar class (authored by ardumont).
nixguix: Document a bit the nar class
Oct 21 2022, 12:16 PM
ardumont committed rDSNIP6724ceccd446: nixguix: Make nar ignore .git folder like the guix hash command (authored by ardumont).
nixguix: Make nar ignore .git folder like the guix hash command
Oct 21 2022, 12:16 PM
ardumont committed rDSNIPd50f518335ee: nixguix: Make nar cli consistent with guix hash cli interface (authored by ardumont).
nixguix: Make nar cli consistent with guix hash cli interface
Oct 21 2022, 12:16 PM
ardumont committed rDSNIP58d139c71b58: nixguix: Add nar.py from @zimoun (authored by ardumont).
nixguix: Add nar.py from @zimoun
Oct 21 2022, 12:16 PM
ardumont accepted D8750: cvsclient: Do not abort checkout when skipping $Log$ keyword expansion.
Oct 21 2022, 10:42 AM

Oct 20 2022

ardumont accepted D8749: utils/highlightjs: Do not report pygments exception to sentry.
Oct 20 2022, 3:18 PM
ardumont added a comment to D8705: writer: make calling flush() in write_addition(s)() optional.

If it's for test speedup only, don't you want to keep the actual behavior instead?
That is, make the auto_flush be False by default, and then you explicitely set it up to True in the calling tests.

I believe that auto_flush=True is the current default, so the diff does what you're asking :-)

I'd be keen on having a warning, at least when we __del__ the object and some deliveries are still pending, because even if not perfect, that'd be the sign of a bug.

Oct 20 2022, 3:18 PM
ardumont added a comment to D8705: writer: make calling flush() in write_addition(s)() optional.

If it's for test speedup only, don't you want to keep the actual behavior instead?
That is, make the auto_flush be False by default, and then you explicitely set it up to True in the calling tests.

Oct 20 2022, 3:18 PM
ardumont accepted D8697: tests: make the kafka_server_base fixture a function scoped one.

I don't see the difference comparing the master build or the diff build times but wny not ;)

Oct 20 2022, 3:18 PM

Oct 19 2022

ardumont accepted D8746: Exclude atom tests data from pre-commit processing and fix typo.
Oct 19 2022, 2:56 PM
ardumont accepted D8745: test_retry: Use proper way to mock sleep of retryable storage methods.
Oct 19 2022, 2:37 PM
ardumont added a comment to D8703: Subscribe swh-search's journal client to indexed extrinsic metadata.

of course, i forgot to update the remote first ¯\_(ツ)_/¯

Oct 19 2022, 11:18 AM
ardumont committed rSPSITE67e3fee9cb12: Subscribe swh-search's journal client to indexed extrinsic metadata (authored by vlorentz).
Subscribe swh-search's journal client to indexed extrinsic metadata
Oct 19 2022, 11:17 AM
ardumont added a comment to D8703: Subscribe swh-search's journal client to indexed extrinsic metadata.

of course, i forgot to update the remote first ¯\_(ツ)_/¯

Oct 19 2022, 11:04 AM
ardumont added a comment to D8703: Subscribe swh-search's journal client to indexed extrinsic metadata.

I'm gonna take your commit and push it to our new migrated repository.

Oct 19 2022, 11:00 AM
ardumont accepted D8739: utils: Report svnadmin load error in init_svn_repo_from_dump.
Oct 19 2022, 9:35 AM
ardumont accepted D8707: templates/swh-pipeline: Fetch master branch only when cloning repo.
Oct 19 2022, 9:33 AM
ardumont accepted D8733: jobs/swh-environment: Only fetch master branches of swh repositories.

Makes sense.

Oct 19 2022, 9:32 AM

Oct 18 2022

ardumont accepted D8706: pre-commit, tox: Bump pre-commit, codespell, black and flake8.
Oct 18 2022, 7:20 PM
ardumont added inline comments to D8691: docs/grpc-api.rst: Add Python examples.
Oct 18 2022, 7:13 PM
ardumont committed R261:6dd36b452d23: git: Update origins for gitlab.s.o repositories (authored by ardumont).
git: Update origins for gitlab.s.o repositories
Oct 18 2022, 6:58 PM
ardumont closed T4064: Test GitLab migration scripts, a subtask of T2225: Migrate to GitLab, as Resolved.
Oct 18 2022, 5:59 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020
ardumont closed T4064: Test GitLab migration scripts as Resolved.
Oct 18 2022, 5:59 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4639: Deploy swh-scrubber v0.1.1 as Resolved.
Oct 18 2022, 4:58 PM · System administration, Datastore Scrubber
ardumont closed T4639: Deploy swh-scrubber v0.1.1, a subtask of T4527: scrubber: keep a state file for postgresql datastores, as Resolved.
Oct 18 2022, 4:58 PM · Datastore Scrubber
ardumont accepted D8691: docs/grpc-api.rst: Add Python examples.

couple of suggestions inline.

Oct 18 2022, 4:15 PM
ardumont moved T4639: Deploy swh-scrubber v0.1.1 from Weekly backlog to deployed/landed/monitoring on the System administration board.
Oct 18 2022, 11:22 AM · System administration, Datastore Scrubber
ardumont updated the task description for T4639: Deploy swh-scrubber v0.1.1.
Oct 18 2022, 11:11 AM · System administration, Datastore Scrubber
ardumont updated the task description for T4639: Deploy swh-scrubber v0.1.1.
Oct 18 2022, 10:38 AM · System administration, Datastore Scrubber
ardumont moved T4639: Deploy swh-scrubber v0.1.1 from Backlog to Weekly backlog on the System administration board.
Oct 18 2022, 10:23 AM · System administration, Datastore Scrubber
ardumont accepted D8693: replay: Use swh.model.from_disk.Directory.collect.

Great! Simplification and convergence!

Oct 18 2022, 10:21 AM
ardumont accepted D8669: Update user documentation for listers and loaders.
Oct 18 2022, 10:18 AM
ardumont added inline comments to D8664: Raise 400 instead of 500 on 'incomplete' multipart request.
Oct 18 2022, 10:16 AM
ardumont accepted D8690: docs/grpc-api.rst: Update to match to current code.
Oct 18 2022, 10:05 AM

Oct 17 2022

ardumont updated subscribers of T4064: Test GitLab migration scripts.

Plenty of fixes happened again.
Multiple iterations happened on bespin to further check the resulting scripts.

Oct 17 2022, 6:37 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4615: jenkins: Unstuck buster-swh image build as Resolved.
Oct 17 2022, 6:35 PM · System administration
ardumont closed T4614: Deploy swh-search v0.16.4 as Resolved.
Oct 17 2022, 6:35 PM · System administration, Archive search
ardumont closed T4614: Deploy swh-search v0.16.4, a subtask of T4599: Github descriptions are not used to search origins, as Resolved.
Oct 17 2022, 6:35 PM · Metadata workflow, Archive search
ardumont closed T4618: Migrate large workers (worker17-18) to elastic workers as Resolved.
Oct 17 2022, 6:35 PM · System administration
ardumont accepted D8664: Raise 400 instead of 500 on 'incomplete' multipart request.
Oct 17 2022, 6:35 PM
ardumont moved T4614: Deploy swh-search v0.16.4 from in-progress to deployed/landed/monitoring on the System administration board.
Oct 17 2022, 4:57 PM · System administration, Archive search
ardumont changed the status of T4614: Deploy swh-search v0.16.4 from Open to Work in Progress.
Oct 17 2022, 4:57 PM · System administration, Archive search
ardumont changed the status of T4614: Deploy swh-search v0.16.4, a subtask of T4599: Github descriptions are not used to search origins, from Open to Work in Progress.
Oct 17 2022, 4:57 PM · Metadata workflow, Archive search
ardumont updated the task description for T4614: Deploy swh-search v0.16.4.
Oct 17 2022, 4:57 PM · System administration, Archive search
ardumont closed D8687: Add migration node.
Oct 17 2022, 4:07 PM
ardumont committed rSPREeced918d82ba: Add migration node (authored by ardumont).
Add migration node
Oct 17 2022, 4:07 PM
ardumont updated the diff for D8687: Add migration node.

Rebase

Oct 17 2022, 4:06 PM
ardumont updated the diff for D8687: Add migration node.

Amend

Oct 17 2022, 3:50 PM
ardumont updated the diff for D8687: Add migration node.

Amend

Oct 17 2022, 3:47 PM
ardumont requested review of D8687: Add migration node.
Oct 17 2022, 3:46 PM
ardumont updated the task description for T4614: Deploy swh-search v0.16.4.
Oct 17 2022, 2:12 PM · System administration, Archive search
ardumont updated the task description for T4614: Deploy swh-search v0.16.4.
Oct 17 2022, 2:01 PM · System administration, Archive search
ardumont moved T4606: Deploy swh-indexer v2.7.0 from Backlog to Weekly backlog on the System administration board.
Oct 17 2022, 9:50 AM · System administration, Indexer
ardumont moved T4614: Deploy swh-search v0.16.4 from Backlog to Weekly backlog on the System administration board.
Oct 17 2022, 9:50 AM · System administration, Archive search
ardumont moved T4605: Deploy swh-loader-metadata v0.0.3 from Backlog to Weekly backlog on the System administration board.
Oct 17 2022, 9:50 AM · Metadata Loaders, System administration
ardumont moved T4618: Migrate large workers (worker17-18) to elastic workers from in-progress to deployed/landed/monitoring on the System administration board.
Oct 17 2022, 9:49 AM · System administration

Oct 14 2022

ardumont accepted D8683: loader, cvsclient: Read files line by line to reduce memory consumption.
Oct 14 2022, 6:59 PM
ardumont accepted D8684: rlog: Skip rlog entry with missing header in RlogConv.parse_rlog.
Oct 14 2022, 6:58 PM
ardumont edited P1497 config.lisp ending.
Oct 14 2022, 6:56 PM
ardumont edited P1497 config.lisp ending.
Oct 14 2022, 6:01 PM
ardumont edited P1497 config.lisp ending.
Oct 14 2022, 5:53 PM
ardumont edited P1497 config.lisp ending.
Oct 14 2022, 5:50 PM
ardumont abandoned D8685: phabricator/utils: Revoke the cache if it's invalid on disk.

Landed already.

Oct 14 2022, 3:42 PM
ardumont updated the diff for D8685: phabricator/utils: Revoke the cache if it's invalid on disk.

Actual good range rebase

Oct 14 2022, 3:42 PM
ardumont committed R263:db5dfecad540: phabricator/gitlab: Add reference to original paste in description (authored by ardumont).
phabricator/gitlab: Add reference to original paste in description
Oct 14 2022, 3:21 PM
ardumont committed R263:8c22b4672875: phabricator/utils: Revoke the cache if it's invalid on disk (authored by ardumont).
phabricator/utils: Revoke the cache if it's invalid on disk
Oct 14 2022, 3:21 PM
ardumont updated the diff for D8685: phabricator/utils: Revoke the cache if it's invalid on disk.

Rebase

Oct 14 2022, 3:18 PM
ardumont updated the test plan for D8685: phabricator/utils: Revoke the cache if it's invalid on disk.
Oct 14 2022, 2:13 PM
ardumont added a reviewer for D8685: phabricator/utils: Revoke the cache if it's invalid on disk: System administration.
Oct 14 2022, 2:12 PM
ardumont requested review of D8685: phabricator/utils: Revoke the cache if it's invalid on disk.
Oct 14 2022, 2:06 PM
ardumont committed R263:1336ec931b3d: phabricator: Allow purging the query cache (authored by ardumont).
phabricator: Allow purging the query cache
Oct 14 2022, 11:35 AM
ardumont committed R263:7ff86e259f94: phabricator: Add function to allow object type import separately (authored by ardumont).
phabricator: Add function to allow object type import separately
Oct 14 2022, 11:35 AM

Oct 13 2022

ardumont accepted D8679: maven: Make assertions more useful.
Oct 13 2022, 8:07 PM
ardumont accepted D8680: maven: Use requests_mock_datadir to simplify mocking..
Oct 13 2022, 8:07 PM
ardumont edited P1498 M-x sly then C-c C-l to load forgerie within emacs.
Oct 13 2022, 7:55 PM
ardumont created P1498 M-x sly then C-c C-l to load forgerie within emacs.
Oct 13 2022, 7:51 PM
ardumont closed D8676: production-worker05: Increase memory and scratch disk space.
Oct 13 2022, 4:37 PM