Page MenuHomeSoftware Heritage

Metadata LoadersFolder
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Recent Activity

Thu, Jun 9

vlorentz closed T4297: Add support for indexing intrinsic metadata from releases as Resolved.
Thu, Jun 9, 1:41 PM · Metadata Loaders

Tue, Jun 7

vlorentz added a revision to T4297: Add support for indexing intrinsic metadata from releases: D7937: Replace RevisionMetadataIndexer with DirectoryMetadataIndexer.
Tue, Jun 7, 10:30 AM · Metadata Loaders

Wed, Jun 1

vlorentz added a revision to T4297: Add support for indexing intrinsic metadata from releases: D7941: Add support for indexing from head releases.
Wed, Jun 1, 5:43 PM · Metadata Loaders
vlorentz triaged T4297: Add support for indexing intrinsic metadata from releases as High priority.
Wed, Jun 1, 2:47 PM · Metadata Loaders

May 13 2022

ardumont closed T4243: Deploy loader.metadata credentials for high and oneshot loaders as Resolved.
May 13 2022, 5:59 PM · System administration, Metadata Loaders, Git loader
ardumont moved T4243: Deploy loader.metadata credentials for high and oneshot loaders from deployed/landed/monitoring to Component upgrades on the System administration board.
May 13 2022, 5:59 PM · System administration, Metadata Loaders, Git loader
ardumont moved T4243: Deploy loader.metadata credentials for high and oneshot loaders from in-progress to deployed/landed/monitoring on the System administration board.
May 13 2022, 5:23 PM · System administration, Metadata Loaders, Git loader
ardumont renamed T4243: Deploy loader.metadata credentials for high and oneshot loaders from Deploy loader.metadata credentials for high and oneshot loader to Deploy loader.metadata credentials for high and oneshot loaders.
May 13 2022, 5:16 PM · System administration, Metadata Loaders, Git loader
ardumont updated the task description for T4243: Deploy loader.metadata credentials for high and oneshot loaders.
May 13 2022, 5:16 PM · System administration, Metadata Loaders, Git loader
ardumont added a revision to T4243: Deploy loader.metadata credentials for high and oneshot loaders: D7832: Deploy metadata loader credentials for high and oneshot loaders.
May 13 2022, 5:13 PM · System administration, Metadata Loaders, Git loader
ardumont changed the status of T4243: Deploy loader.metadata credentials for high and oneshot loaders from Open to Work in Progress.
May 13 2022, 5:12 PM · System administration, Metadata Loaders, Git loader
ardumont triaged T4243: Deploy loader.metadata credentials for high and oneshot loaders as Normal priority.
May 13 2022, 5:11 PM · System administration, Metadata Loaders, Git loader

Apr 28 2022

ardumont closed T4202: staging: Deploy swh.loader.metadata and friends as Resolved.
Apr 28 2022, 12:37 PM · Metadata Loaders, System administration
ardumont updated the task description for T4202: staging: Deploy swh.loader.metadata and friends.
Apr 28 2022, 12:31 PM · Metadata Loaders, System administration
ardumont added a comment to T4202: staging: Deploy swh.loader.metadata and friends.

After some tampering with the actual queue in scheduler0.staging (cleaning that up, it's staging so fine).
And limiting the number to less than 10k (100 is enough, way less workers).
We now have some github origins properly scheduled with their lister_name=github and lister_instance_name=github.
This now results in extrinsic metadata being fetched for those origins [1] (without me having to trigger the swh loader run cli).

Apr 28 2022, 12:30 PM · Metadata Loaders, System administration
ardumont moved T4202: staging: Deploy swh.loader.metadata and friends from in-progress to deployed/landed/monitoring on the System administration board.
Apr 28 2022, 11:11 AM · Metadata Loaders, System administration
ardumont changed the status of T4202: staging: Deploy swh.loader.metadata and friends from Open to Work in Progress.
Apr 28 2022, 10:40 AM · Metadata Loaders, System administration
ardumont updated the task description for T4202: staging: Deploy swh.loader.metadata and friends.
Apr 28 2022, 10:40 AM · Metadata Loaders, System administration
ardumont updated the task description for T4202: staging: Deploy swh.loader.metadata and friends.
Apr 28 2022, 9:35 AM · Metadata Loaders, System administration

Apr 27 2022

ardumont closed T4193: staging: Deploy metadata loader as Resolved.
Apr 27 2022, 4:56 PM · System administration, Metadata Loaders
ardumont closed T4194: staging: Deploy swh-scheduler 1.1.0, a subtask of T4193: staging: Deploy metadata loader, as Resolved.
Apr 27 2022, 4:56 PM · System administration, Metadata Loaders
ardumont moved T4202: staging: Deploy swh.loader.metadata and friends from Backlog to Weekly backlog on the System administration board.
Apr 27 2022, 4:56 PM · Metadata Loaders, System administration
ardumont triaged T4202: staging: Deploy swh.loader.metadata and friends as Normal priority.
Apr 27 2022, 4:56 PM · Metadata Loaders, System administration
ardumont added a revision to T4193: staging: Deploy metadata loader: D7701: cli: Pass metadata_fetcher_credentials from the config to the loader.
Apr 27 2022, 4:19 PM · System administration, Metadata Loaders
ardumont added a comment to T4193: staging: Deploy metadata loader.

So status on this, the git loader queue is quite filled in.
So triggering specific loading for github origins through the cli [1] was in order.
We do obtain results after that [2]

Apr 27 2022, 4:18 PM · System administration, Metadata Loaders

Apr 26 2022

ardumont moved T4193: staging: Deploy metadata loader from in-progress to deployed/landed/monitoring on the System administration board.
Apr 26 2022, 5:19 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 5:19 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 4:29 PM · System administration, Metadata Loaders
ardumont added a revision to T4193: staging: Deploy metadata loader: D7687: staging: Activate metadata loader for git loader.
Apr 26 2022, 4:28 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:55 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:55 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:51 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:42 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:36 PM · System administration, Metadata Loaders
ardumont changed the status of T4193: staging: Deploy metadata loader from Open to Work in Progress.
Apr 26 2022, 3:33 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:33 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 3:32 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 2:58 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 2:54 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 26 2022, 2:53 PM · System administration, Metadata Loaders
ardumont changed the status of T4194: staging: Deploy swh-scheduler 1.1.0, a subtask of T4193: staging: Deploy metadata loader, from Open to Work in Progress.
Apr 26 2022, 2:44 PM · System administration, Metadata Loaders

Apr 25 2022

ardumont moved T4193: staging: Deploy metadata loader from Backlog to Weekly backlog on the System administration board.
Apr 25 2022, 10:56 AM · System administration, Metadata Loaders

Apr 22 2022

ardumont added a project to T4193: staging: Deploy metadata loader: System administration.
Apr 22 2022, 3:59 PM · System administration, Metadata Loaders
ardumont renamed T4193: staging: Deploy metadata loader from staging: Deploy metadata fetcher to staging: Deploy metadata loader.
Apr 22 2022, 3:53 PM · System administration, Metadata Loaders
vlorentz added a parent task for T4193: staging: Deploy metadata loader: T1740: fetch extrinsic origin metadata from GitHub.
Apr 22 2022, 3:52 PM · System administration, Metadata Loaders
ardumont updated the task description for T4193: staging: Deploy metadata loader.
Apr 22 2022, 3:51 PM · System administration, Metadata Loaders
ardumont triaged T4193: staging: Deploy metadata loader as Normal priority.
Apr 22 2022, 3:50 PM · System administration, Metadata Loaders

Apr 21 2022

vlorentz created Metadata Loaders.
Apr 21 2022, 4:03 PM