Page MenuHomeSoftware Heritage

Metadata LoadersFolder
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Recent Activity

Jan 8 2023

gitlab-migration changed the status of T4297: Add support for indexing intrinsic metadata from releases from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:03 PM · Metadata Loaders

Oct 19 2022

gitlab-migration closed T4606: Deploy swh-indexer v2.7.0, a subtask of T4605: Deploy swh-loader-metadata v0.0.3, as Migrated.
Oct 19 2022, 6:08 PM · Metadata Loaders, System administration
gitlab-migration closed T4605: Deploy swh-loader-metadata v0.0.3 as Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:08 PM · Metadata Loaders, System administration
gitlab-migration changed the status of T4243: Deploy loader.metadata credentials for high and oneshot loaders from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:06 PM · System administration, Metadata Loaders, Git loader
gitlab-migration changed the status of T4202: staging: Deploy swh.loader.metadata and friends from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:06 PM · Metadata Loaders, System administration
gitlab-migration changed the status of T4194: staging: Deploy swh-scheduler 1.1.0, a subtask of T4193: staging: Deploy metadata loader, from Resolved to Migrated.
Oct 19 2022, 6:06 PM · System administration, Metadata Loaders
gitlab-migration changed the status of T4193: staging: Deploy metadata loader from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:06 PM · System administration, Metadata Loaders

Oct 17 2022

ardumont moved T4605: Deploy swh-loader-metadata v0.0.3 from Backlog to Weekly backlog on the System administration board.
Oct 17 2022, 9:50 AM · Metadata Loaders, System administration

Oct 10 2022

ardumont added a comment to T4605: Deploy swh-loader-metadata v0.0.3.

Configure Gitea credentials

Oct 10 2022, 6:02 PM · Metadata Loaders, System administration

Oct 5 2022

vlorentz renamed T4605: Deploy swh-loader-metadata v0.0.3 from Deploy swh-loader-metadata v0.0.3 on production and staging to Deploy swh-loader-metadata v0.0.3.
Oct 5 2022, 1:39 PM · Metadata Loaders, System administration
vlorentz edited projects for T4605: Deploy swh-loader-metadata v0.0.3, added: Metadata Loaders; removed Indexer.
Oct 5 2022, 1:19 PM · Metadata Loaders, System administration

Jun 9 2022

vlorentz closed T4297: Add support for indexing intrinsic metadata from releases as Resolved.
Jun 9 2022, 1:41 PM · Metadata Loaders

Jun 7 2022

vlorentz added a revision to T4297: Add support for indexing intrinsic metadata from releases: D7937: Replace RevisionMetadataIndexer with DirectoryMetadataIndexer.
Jun 7 2022, 10:30 AM · Metadata Loaders

Jun 1 2022

vlorentz added a revision to T4297: Add support for indexing intrinsic metadata from releases: D7941: Add support for indexing from head releases.
Jun 1 2022, 5:43 PM · Metadata Loaders
vlorentz triaged T4297: Add support for indexing intrinsic metadata from releases as High priority.
Jun 1 2022, 2:47 PM · Metadata Loaders

May 13 2022

ardumont closed T4243: Deploy loader.metadata credentials for high and oneshot loaders as Resolved.
May 13 2022, 5:59 PM · System administration, Metadata Loaders, Git loader
ardumont moved T4243: Deploy loader.metadata credentials for high and oneshot loaders from deployed/landed/monitoring to Component upgrades on the System administration board.
May 13 2022, 5:59 PM · System administration, Metadata Loaders, Git loader
ardumont moved T4243: Deploy loader.metadata credentials for high and oneshot loaders from in-progress to deployed/landed/monitoring on the System administration board.
May 13 2022, 5:23 PM · System administration, Metadata Loaders, Git loader
ardumont renamed T4243: Deploy loader.metadata credentials for high and oneshot loaders from Deploy loader.metadata credentials for high and oneshot loader to Deploy loader.metadata credentials for high and oneshot loaders.
May 13 2022, 5:16 PM · System administration, Metadata Loaders, Git loader
ardumont updated the task description for T4243: Deploy loader.metadata credentials for high and oneshot loaders.
May 13 2022, 5:16 PM · System administration, Metadata Loaders, Git loader
ardumont added a revision to T4243: Deploy loader.metadata credentials for high and oneshot loaders: D7832: Deploy metadata loader credentials for high and oneshot loaders.
May 13 2022, 5:13 PM · System administration, Metadata Loaders, Git loader
ardumont changed the status of T4243: Deploy loader.metadata credentials for high and oneshot loaders from Open to Work in Progress.
May 13 2022, 5:12 PM · System administration, Metadata Loaders, Git loader
ardumont triaged T4243: Deploy loader.metadata credentials for high and oneshot loaders as Normal priority.
May 13 2022, 5:11 PM · System administration, Metadata Loaders, Git loader

Apr 28 2022

ardumont closed T4202: staging: Deploy swh.loader.metadata and friends as Resolved.
Apr 28 2022, 12:37 PM · Metadata Loaders, System administration
ardumont updated the task description for T4202: staging: Deploy swh.loader.metadata and friends.
Apr 28 2022, 12:31 PM · Metadata Loaders, System administration
ardumont added a comment to T4202: staging: Deploy swh.loader.metadata and friends.

After some tampering with the actual queue in scheduler0.staging (cleaning that up, it's staging so fine).
And limiting the number to less than 10k (100 is enough, way less workers).
We now have some github origins properly scheduled with their lister_name=github and lister_instance_name=github.
This now results in extrinsic metadata being fetched for those origins [1] (without me having to trigger the swh loader run cli).

Apr 28 2022, 12:30 PM · Metadata Loaders, System administration
ardumont moved T4202: staging: Deploy swh.loader.metadata and friends from in-progress to deployed/landed/monitoring on the System administration board.
Apr 28 2022, 11:11 AM · Metadata Loaders, System administration
ardumont changed the status of T4202: staging: Deploy swh.loader.metadata and friends from Open to Work in Progress.
Apr 28 2022, 10:40 AM · Metadata Loaders, System administration
ardumont updated the task description for T4202: staging: Deploy swh.loader.metadata and friends.
Apr 28 2022, 10:40 AM · Metadata Loaders, System administration
ardumont updated the task description for T4202: staging: Deploy swh.loader.metadata and friends.
Apr 28 2022, 9:35 AM · Metadata Loaders, System administration

Apr 27 2022

ardumont closed T4193: staging: Deploy metadata loader as Resolved.
Apr 27 2022, 4:56 PM · System administration, Metadata Loaders
ardumont closed T4194: staging: Deploy swh-scheduler 1.1.0, a subtask of T4193: staging: Deploy metadata loader, as Resolved.
Apr 27 2022, 4:56 PM · System administration, Metadata Loaders
ardumont moved T4202: staging: Deploy swh.loader.metadata and friends from Backlog to Weekly backlog on the System administration board.
Apr 27 2022, 4:56 PM · Metadata Loaders, System administration
ardumont triaged T4202: staging: Deploy swh.loader.metadata and friends as Normal priority.
Apr 27 2022, 4:56 PM · Metadata Loaders, System administration
ardumont added a revision to T4193: staging: Deploy metadata loader: D7701: cli: Pass metadata_fetcher_credentials from the config to the loader.
Apr 27 2022, 4:19 PM · System administration, Metadata Loaders
ardumont added a comment to T4193: staging: Deploy metadata loader.

So status on this, the git loader queue is quite filled in.
So triggering specific loading for github origins through the cli [1] was in order.
We do obtain results after that [2]

Apr 27 2022, 4:18 PM · System administration, Metadata Loaders

Apr 26 2022

ardumont moved T4193: staging: Deploy metadata loader from in-progress to deployed/landed/monitoring on the System administration board.
Apr 26 2022, 5:19 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 5:19 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 4:29 PM · System administration, Metadata Loaders
ardumont added a revision to T4193: staging: Deploy metadata loader: D7687: staging: Activate metadata loader for git loader.
Apr 26 2022, 4:28 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:55 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:55 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:51 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:42 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:36 PM · System administration, Metadata Loaders
ardumont changed the status of T4193: staging: Deploy metadata loader from Open to Work in Progress.
Apr 26 2022, 3:33 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:33 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:32 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 2:58 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 2:54 PM · System administration, Metadata Loaders