Page MenuHomeSoftware Heritage

ardumont (Antoine R. Dumont)
UserAdministrator

User Details

User Since
Sep 7 2015, 3:42 PM (368 w, 12 h)
Roles
Administrator

Recent Activity

Yesterday

ardumont committed R260:a46ad6ca6123: cookers: Fix typo (authored by ardumont).
cookers: Fix typo
Mon, Sep 26, 6:09 PM
ardumont committed R260:406651fd6f13: staging: Bump new loader highpriority image (authored by ardumont).
staging: Bump new loader highpriority image
Mon, Sep 26, 5:42 PM
ardumont committed R259:695eff4687ae: swh-loader-highpriority: Bump new release to match other images (authored by ardumont).
swh-loader-highpriority: Bump new release to match other images
Mon, Sep 26, 5:41 PM
ardumont updated the diff for D8534: rancher-node-production-worker*: Update nameserver entries with ns0.

Update using ip instead of fqdn

Mon, Sep 26, 5:40 PM
ardumont added a comment to D8535: docker/conf: Declare task queues for new listers and loaders.

Are those new listers landed yet?

Mon, Sep 26, 5:38 PM
ardumont accepted D8536: Update instructions for running a lister in docker.
Mon, Sep 26, 5:37 PM
ardumont committed R260:98347a15536a: staging: Bump new loader images (authored by ardumont).
staging: Bump new loader images
Mon, Sep 26, 5:31 PM
ardumont committed R260:b0d7995c17c7: staging: Bump new swh-loader-package image (authored by ardumont).
staging: Bump new swh-loader-package image
Mon, Sep 26, 5:21 PM
ardumont committed R259:0b4dc94acd64: swh-loader-mercurial: Bump release and fix entrypoint (authored by ardumont).
swh-loader-mercurial: Bump release and fix entrypoint
Mon, Sep 26, 5:19 PM
ardumont committed R259:247b040d4bc0: swh-loader-git: Bump release and fix entrypoint (authored by ardumont).
swh-loader-git: Bump release and fix entrypoint
Mon, Sep 26, 5:17 PM
ardumont committed R259:0922d567d80f: swh-loader-bzr: Bump release and fix entrypoint (authored by ardumont).
swh-loader-bzr: Bump release and fix entrypoint
Mon, Sep 26, 5:16 PM
ardumont committed R259:168682ae06cd: swh-loader-package: Bump release and fix entrypoint (authored by ardumont).
swh-loader-package: Bump release and fix entrypoint
Mon, Sep 26, 5:15 PM
ardumont committed R259:960328f70fc4: swh-loader-cvs: Bump release and fix entrypoint (authored by ardumont).
swh-loader-cvs: Bump release and fix entrypoint
Mon, Sep 26, 5:14 PM
ardumont committed R260:f8e026df8df8: staging: Release swh-loader-svn image (authored by ardumont).
staging: Release swh-loader-svn image
Mon, Sep 26, 5:09 PM
ardumont committed R259:fbc67439329e: swh-loader-svn: Bump release and fix entrypoint (authored by ardumont).
swh-loader-svn: Bump release and fix entrypoint
Mon, Sep 26, 5:09 PM
ardumont committed R260:98ed0a96e1d7: values-swh: Sort (authored by ardumont).
values-swh: Sort
Mon, Sep 26, 5:09 PM
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Mon, Sep 26, 4:50 PM · meta-task, System administration, Roadmap 2022
ardumont added a comment to T4540: staging: Migrate remaining static services to elastic workers.

Cookers migrated:

│ cookers [2022-09-26 14:48:17,948: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[722de41d-0f88-45f7-ad06-3fb65f3978e1] received                                                                                              │
│ cookers [2022-09-26 14:48:54,924: INFO/ForkPoolWorker-1] Task swh.vault.cooking_tasks.SWHCookingTask[722de41d-0f88-45f7-ad06-3fb65f3978e1] succeeded in 36.83566682902165s: None
Mon, Sep 26, 4:50 PM · meta-task, System administration, Roadmap 2022
ardumont committed R260:91e3ec89bb37: staging: Fix default vault cooker configuration (authored by ardumont).
staging: Fix default vault cooker configuration
Mon, Sep 26, 4:47 PM
ardumont committed R259:05e3ac003605: swh.vault: Fix docker image and frozen dependencies (authored by ardumont).
swh.vault: Fix docker image and frozen dependencies
Mon, Sep 26, 4:47 PM
ardumont committed R260:ed886a09cf0c: staging: Fix default vault cooker configuration (authored by ardumont).
staging: Fix default vault cooker configuration
Mon, Sep 26, 4:37 PM
ardumont committed rSPSITEc9ad6c20bf3a: staging: Migrate vault cookers to elastic workers (authored by ardumont).
staging: Migrate vault cookers to elastic workers
Mon, Sep 26, 3:31 PM
ardumont committed R260:e37a1c2dfcbd: staging: Deploy new vault cooker services (authored by ardumont).
staging: Deploy new vault cooker services
Mon, Sep 26, 3:29 PM
ardumont committed R259:28c753452dec: swh.vault: Generate new frozen requirements from v1.8 (authored by ardumont).
swh.vault: Generate new frozen requirements from v1.8
Mon, Sep 26, 3:01 PM
ardumont committed R259:405168a76920: Add new swh-vault-cookers application (authored by ardumont).
Add new swh-vault-cookers application
Mon, Sep 26, 3:01 PM
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Mon, Sep 26, 2:48 PM · meta-task, System administration, Roadmap 2022
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Migrate remaining static loader/lister services to elastic workers to staging: Migrate remaining static services to elastic workers.
Mon, Sep 26, 2:46 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 2:24 PM · System administration, Bower lister, Archive coverage
ardumont moved T4555: staging: Deploy bower lister from in-progress to deployed/landed/monitoring on the System administration board.
Mon, Sep 26, 1:55 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:54 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:51 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:48 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:47 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:47 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:46 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:45 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:43 PM · System administration, Bower lister, Archive coverage
ardumont committed R260:e3aad93b079a: staging: Deploy bower lister (authored by ardumont).
staging: Deploy bower lister
Mon, Sep 26, 1:43 PM
ardumont updated the task description for T4555: staging: Deploy bower lister.
Mon, Sep 26, 1:42 PM · System administration, Bower lister, Archive coverage
ardumont changed the status of T4555: staging: Deploy bower lister, a subtask of T4475: Ingest bower.io (Javascript package manager), from Open to Work in Progress.
Mon, Sep 26, 1:39 PM · Bower lister, Archive coverage
ardumont changed the status of T4555: staging: Deploy bower lister from Open to Work in Progress.
Mon, Sep 26, 1:39 PM · System administration, Bower lister, Archive coverage
ardumont committed R260:dd33b4df4d16: staging: Reorganize loader and sort by name (authored by ardumont).
staging: Reorganize loader and sort by name
Mon, Sep 26, 1:38 PM
ardumont committed R260:aefa576eebcb: staging: Reorganize lister and sort by names (authored by ardumont).
staging: Reorganize lister and sort by names
Mon, Sep 26, 1:37 PM
ardumont committed R260:1524f4ddc8ac: staging: Revert back to default lister loglevel (authored by ardumont).
staging: Revert back to default lister loglevel
Mon, Sep 26, 1:37 PM
ardumont added inline comments to D8521: Use a Merkle discovery algorithm with archives.
Mon, Sep 26, 1:32 PM
ardumont closed D8530: cgit/tests: Rename readme.md to readme.
Mon, Sep 26, 1:31 PM
ardumont committed rDLSfd1a4244a0a5: cgit/tests: Rename readme.md to readme (authored by ardumont).
cgit/tests: Rename readme.md to readme
Mon, Sep 26, 1:31 PM
ardumont moved T4541: Deploy git loaders dedicated to load add forge now requests from Backlog to deployed/landed/monitoring on the System administration board.
Mon, Sep 26, 1:27 PM · Add Forge Now , System administration
ardumont moved T4555: staging: Deploy bower lister from Backlog to Weekly backlog on the System administration board.
Mon, Sep 26, 1:27 PM · System administration, Bower lister, Archive coverage
ardumont added a project to T4555: staging: Deploy bower lister: System administration.
Mon, Sep 26, 1:27 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4475: Ingest bower.io (Javascript package manager).
Mon, Sep 26, 1:26 PM · Bower lister, Archive coverage
ardumont triaged T4555: staging: Deploy bower lister as Normal priority.
Mon, Sep 26, 1:26 PM · System administration, Bower lister, Archive coverage
ardumont updated the task description for T4475: Ingest bower.io (Javascript package manager).
Mon, Sep 26, 1:26 PM · Bower lister, Archive coverage
ardumont updated the diff for D8530: cgit/tests: Rename readme.md to readme.

Rebase

Mon, Sep 26, 1:22 PM
ardumont closed D8532: Set rancher-node-production worker to high load profile.
Mon, Sep 26, 1:15 PM
ardumont committed rSPSITE67575cd68986: Set rancher-node-production worker to high load profile (authored by ardumont).
Set rancher-node-production worker to high load profile
Mon, Sep 26, 1:15 PM
ardumont added a comment to D8532: Set rancher-node-production worker to high load profile.

I also don't understand why worker04 doesn't have any issue with rancher as it uses
the default 127.0.0.1 configuration

Mon, Sep 26, 1:13 PM
ardumont requested review of D8534: rancher-node-production-worker*: Update nameserver entries with ns0.
Mon, Sep 26, 1:12 PM
ardumont updated the diff for D8532: Set rancher-node-production worker to high load profile.

Add node worker04 to the mix

Mon, Sep 26, 1:11 PM
ardumont updated the test plan for D8532: Set rancher-node-production worker to high load profile.
Mon, Sep 26, 1:07 PM
ardumont requested review of D8532: Set rancher-node-production worker to high load profile.
Mon, Sep 26, 11:31 AM
ardumont committed rSENVba8c17f66fe3: Sync puppet master facts (authored by ardumont).
Sync puppet master facts
Mon, Sep 26, 11:30 AM
ardumont requested review of D8530: cgit/tests: Rename readme.md to readme.
Mon, Sep 26, 9:32 AM

Fri, Sep 23

ardumont added a comment to T4540: staging: Migrate remaining static services to elastic workers.

Remains a bunch of services not existing yet in the elastic stack (vault cooker, deposit checkers and indexer journal clients).
So the plan would be to integrate those in the elastic stack.

Fri, Sep 23, 5:50 PM · meta-task, System administration, Roadmap 2022
ardumont updated the diff for D8341: [WIP] nixguix: Boostrap lister.
  • nixguix: Keep only one url as origin and other urls as fallback ones
Fri, Sep 23, 5:08 PM
ardumont updated the diff for D8341: [WIP] nixguix: Boostrap lister.

Align file tarball listing on what we do for tarballs.

Fri, Sep 23, 4:59 PM
ardumont committed R260:0e97c5b68f1f: staging: Decrease concurrency (authored by ardumont).
staging: Decrease concurrency
Fri, Sep 23, 3:52 PM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Hum, for the 7 false, I have to check. For the 88 packages with no-origin, it is more
annoying. Well, some are metapackages as gcc-toolchain, so they can be skipped. Is it
ok for you to let this 'no-origin' type? For some others, I have to check if they are
covered elsewhere.

Fri, Sep 23, 3:48 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

For ^, something like this would do [1]

Fri, Sep 23, 3:38 PM · Data Model, Nixguix loader
ardumont updated the diff for D8341: [WIP] nixguix: Boostrap lister.
  • nixguix: Keep only one tarball origin sending along fallback urls
Fri, Sep 23, 3:37 PM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Thanks for all that ^! And great pointers!

Fri, Sep 23, 3:09 PM · Data Model, Nixguix loader
ardumont added a comment to T3294: nixguix: Add support for pseudo-URLs with a missing schema.

I've moved around the parent task as the lister should be able to do something about this.

Fri, Sep 23, 11:24 AM · Easy hack, Nixguix loader
ardumont removed a subtask for T2879: Finalize nixguix loader implementation: T3294: nixguix: Add support for pseudo-URLs with a missing schema.
Fri, Sep 23, 11:23 AM · Nixguix loader, Package Loader
ardumont edited parent tasks for T3294: nixguix: Add support for pseudo-URLs with a missing schema, added: T3781: Replace the Nixguix loader with a lister; removed: T2879: Finalize nixguix loader implementation.
Fri, Sep 23, 11:23 AM · Easy hack, Nixguix loader
ardumont added a subtask for T3781: Replace the Nixguix loader with a lister: T3294: nixguix: Add support for pseudo-URLs with a missing schema.
Fri, Sep 23, 11:23 AM · Data Model, Nixguix loader
ardumont closed T2879: Finalize nixguix loader implementation as Wontfix.

This perimeter enters the scope of T3781.

Fri, Sep 23, 11:22 AM · Nixguix loader, Package Loader
ardumont closed T2879: Finalize nixguix loader implementation, a subtask of T1991: Implement a Guix/Nix loader, as Wontfix.
Fri, Sep 23, 11:22 AM · Package Loader
ardumont committed R260:b59599ea9bf4: staging: Deactivate debug logs for gogs listing (authored by ardumont).
staging: Deactivate debug logs for gogs listing
Fri, Sep 23, 11:19 AM
ardumont updated the task description for T1721: Implementation of Gogs Lister.
Fri, Sep 23, 11:18 AM · Gogs lister, Origin-Gitea/Gogs, Archive coverage, Lister
ardumont added a comment to T4478: Deploy Gogs lister to staging.

I either remembered an old stateless implementation or i remember another
implementation altogether.

Fri, Sep 23, 11:18 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont closed T4478: Deploy Gogs lister to staging, a subtask of T1721: Implementation of Gogs Lister, as Resolved.
Fri, Sep 23, 11:04 AM · Gogs lister, Origin-Gitea/Gogs, Archive coverage, Lister
ardumont closed T4478: Deploy Gogs lister to staging as Resolved.
Fri, Sep 23, 11:04 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont added a comment to T4478: Deploy Gogs lister to staging.

But on my side, the "stateless" lister starts from the problematic page (17), and then
plainly stops... [2].

Note that there is a misbehavior in terms here for that "stateless" typed lister. If it
is indeed a stateless lister, it should start from scratch each time it runs. If it has
an incremental behavior (it seems so from that described behavior) then it should be
probably typed differently.

Bingo, it is a stateful lister... so nevermind my remark ^

I either remembered an old stateless implementation or i remember another implementation

altogether.

I'll unstuck the situation by resetting that state.

@KShivendu, you may want to deal with that edgecase though (please, create another
task/diff if you want to address it). If the first page of the saved state is not
working, next time it triggers, the current lister implementation won't list anything
¯\_(ツ)_/¯.

[1]

10:41:16 swh-scheduler@db1:5432=> select * from listers where name='gogs';
+--------------------------------------+------+---------------+-------------------------------+-------------------------------------------------------------------------------------------------------+-------------------------------+
|                  id                  | name | instance_name |            created            |                                             current_state                                             |            updated            |
+--------------------------------------+------+---------------+-------------------------------+-------------------------------------------------------------------------------------------------------+-------------------------------+
| ec6c8408-42f9-47b8-b045-5a812d4a0eff | gogs | try.gogs.io   | 2022-09-13 09:13:00.647726+00 | {"last_seen_repo_id": 7591, "last_seen_next_link": "https://try.gogs.io/api/v1/repos/search?page=17"} | 2022-09-20 09:08:40.081281+00 |
+--------------------------------------+------+---------------+-------------------------------+-------------------------------------------------------------------------------------------------------+-------------------------------+
(1 row)

Time: 5.468 ms
Fri, Sep 23, 11:02 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont added a comment to T4478: Deploy Gogs lister to staging.

But on my side, the "stateless" lister starts from the problematic page (17), and then
plainly stops... [2].

Note that there is a misbehavior in terms here for that "stateless" typed lister. If it
is indeed a stateless lister, it should start from scratch each time it runs. If it has
an incremental behavior (it seems so from that described behavior) then it should be
probably typed differently.

Fri, Sep 23, 10:59 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont added a comment to T4478: Deploy Gogs lister to staging.

ah i think i got it...

Fri, Sep 23, 10:51 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont added a comment to T4478: Deploy Gogs lister to staging.

As a shot in the dark, i've changed the list task arguments [1] but i'd be surprised if that'd change anything...

Fri, Sep 23, 10:42 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont committed R260:f50c9c00a38d: staging: Activate debug logs for gogs listing (authored by ardumont).
staging: Activate debug logs for gogs listing
Fri, Sep 23, 10:35 AM
ardumont added a comment to T4478: Deploy Gogs lister to staging.

I noticed this but that's not what's happening in staging for some unknown reason [1]

Fri, Sep 23, 10:30 AM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont closed D8524: backend: Prevent query exception when lister ids is empty.
Fri, Sep 23, 10:21 AM
ardumont committed rDSCH6d0b1d1e1ab5: backend: Prevent query exception when lister ids is empty (authored by ardumont).
backend: Prevent query exception when lister ids is empty
Fri, Sep 23, 10:21 AM
ardumont moved T4545: staging: Deploy golang stack from in-progress to deployed/landed/monitoring on the System administration board.
Fri, Sep 23, 10:19 AM · System administration, Golang loader, Golang lister, Archive coverage
ardumont changed the status of T4545: staging: Deploy golang stack from Open to Work in Progress.
Fri, Sep 23, 10:19 AM · System administration, Golang loader, Golang lister, Archive coverage
ardumont changed the status of T4545: staging: Deploy golang stack, a subtask of T4124: Golang support, from Open to Work in Progress.
Fri, Sep 23, 10:19 AM · Golang loader, Golang lister, Archive coverage
ardumont updated the task description for T4545: staging: Deploy golang stack.
Fri, Sep 23, 10:18 AM · System administration, Golang loader, Golang lister, Archive coverage
ardumont added a project to T4545: staging: Deploy golang stack: System administration.
Fri, Sep 23, 10:17 AM · System administration, Golang loader, Golang lister, Archive coverage
ardumont committed R260:4c967b9ed085: staging: Deploy golang stack (authored by ardumont).
staging: Deploy golang stack
Fri, Sep 23, 10:11 AM
ardumont committed rSPRE83dbdd20b841: staging: Match current staging workers migrated to pompidou (authored by ardumont).
staging: Match current staging workers migrated to pompidou
Fri, Sep 23, 10:02 AM
ardumont committed rSPREf00227d8965e: staging: Instantiate new elastic rancher-node-worker4 node (authored by ardumont).
staging: Instantiate new elastic rancher-node-worker4 node
Fri, Sep 23, 10:02 AM
ardumont requested review of D8524: backend: Prevent query exception when lister ids is empty.
Fri, Sep 23, 9:54 AM
ardumont added a revision to T4545: staging: Deploy golang stack: D8524: backend: Prevent query exception when lister ids is empty.
Fri, Sep 23, 9:50 AM · System administration, Golang loader, Golang lister, Archive coverage