Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Jun 1 2022

vlorentz added a revision to T4273: Rewrite indexers as journal clients when relevant: D7899: Add support for indexing directly from the journal client.
Jun 1 2022, 4:46 PM · Indexer, Metadata workflow
vlorentz added a revision to T4273: Rewrite indexers as journal clients when relevant: D7940: Switch origin-intrinsic-metadata from celery- to journal-based workers.
Jun 1 2022, 4:46 PM · Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 1 2022, 4:33 PM · System administration, Indexer, Metadata workflow
ardumont changed the status of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from Open to Work in Progress.
Jun 1 2022, 11:56 AM · System administration, Indexer, Metadata workflow
ardumont changed the status of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1, a subtask of T4273: Rewrite indexers as journal clients when relevant, from Open to Work in Progress.
Jun 1 2022, 11:56 AM · Indexer, Metadata workflow
ardumont added a project to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1: System administration.
Jun 1 2022, 11:56 AM · System administration, Indexer, Metadata workflow
ardumont added a comment to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.

Should be ready to be deployed now.

Jun 1 2022, 11:56 AM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 1 2022, 11:26 AM · System administration, Indexer, Metadata workflow

May 31 2022

ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
May 31 2022, 4:52 PM · System administration, Indexer, Metadata workflow
ardumont added a revision to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1: D7928: Deploy new origin intrinsic metadata journal client indexer.
May 31 2022, 4:11 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
May 31 2022, 3:53 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
May 31 2022, 3:42 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
May 31 2022, 3:33 PM · System administration, Indexer, Metadata workflow
ardumont renamed T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from staging: Deploy new origin intrinsic metadata journal client indexer to staging: Deploy new origin intrinsic metadata journal client indexer v1.1.
May 31 2022, 3:27 PM · System administration, Indexer, Metadata workflow

May 30 2022

ardumont triaged T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 as Normal priority.
May 30 2022, 1:16 PM · System administration, Indexer, Metadata workflow

May 25 2022

vlorentz added a revision to T4273: Rewrite indexers as journal clients when relevant: D7893: Refactor base indexers to provide a process_journal_objects method.
May 25 2022, 3:40 PM · Indexer, Metadata workflow
vlorentz updated the task description for T4273: Rewrite indexers as journal clients when relevant.
May 25 2022, 10:32 AM · Indexer, Metadata workflow

May 24 2022

vlorentz placed T4276: CffMapping: ignore invalid yaml files up for grabs.
May 24 2022, 5:43 PM · Indexer, Metadata workflow
vlorentz placed T4275: CffMapping: Add checks for value types up for grabs.
May 24 2022, 5:43 PM · Easy hack, Indexer, Metadata workflow
vlorentz triaged T4277: Deal with null characters in the output of the metadata indexer as Normal priority.
May 24 2022, 5:42 PM · Indexer, Metadata workflow
vlorentz triaged T4276: CffMapping: ignore invalid yaml files as Normal priority.
May 24 2022, 5:41 PM · Indexer, Metadata workflow
vlorentz added a project to T4275: CffMapping: Add checks for value types: Easy hack.
May 24 2022, 5:37 PM · Easy hack, Indexer, Metadata workflow
vlorentz triaged T4275: CffMapping: Add checks for value types as Normal priority.
May 24 2022, 5:37 PM · Easy hack, Indexer, Metadata workflow
vlorentz triaged T4274: Resolve all known crashes in the metadata indexer as Normal priority.
May 24 2022, 5:30 PM · Indexer, Metadata workflow
vlorentz triaged T4273: Rewrite indexers as journal clients when relevant as Normal priority.
May 24 2022, 5:29 PM · Indexer, Metadata workflow

May 17 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
May 17 2022, 3:07 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
May 17 2022, 1:48 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
May 17 2022, 1:48 PM · Archive search, Metadata workflow

May 16 2022

vlorentz triaged T4249: Choose/define an ontology to use for indexed extrinsic origin metadata as Normal priority.
May 16 2022, 4:51 PM · Archive search, Metadata workflow

May 3 2022

vlorentz added a parent task for T1740: fetch extrinsic origin metadata from GitHub: T3273: Use "fork" relationships to speed-up initial load of large repositories.
May 3 2022, 11:16 AM · Metadata workflow, Origin-GitHub
vlorentz closed T1740: fetch extrinsic origin metadata from GitHub as Resolved.
May 3 2022, 11:08 AM · Metadata workflow, Origin-GitHub
vlorentz closed T4187: Pass forge type to loaders, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
May 3 2022, 11:08 AM · Core Loader, Metadata workflow
vlorentz closed T4187: Pass forge type to loaders as Resolved.
May 3 2022, 11:08 AM · Core Loader, Metadata workflow
vlorentz closed T4186: Allow loaders to fetch extrinsic metadata, a subtask of T1740: fetch extrinsic origin metadata from GitHub, as Resolved.
May 3 2022, 11:07 AM · Metadata workflow, Origin-GitHub
vlorentz closed T4186: Allow loaders to fetch extrinsic metadata as Resolved.
May 3 2022, 11:07 AM · Core Loader, Metadata workflow
vlorentz closed T4188: Make swh-loader-core run metadata fetchers before loading an origin, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
May 3 2022, 11:07 AM · Core Loader, Metadata workflow
vlorentz closed T4188: Make swh-loader-core run metadata fetchers before loading an origin as Resolved.
May 3 2022, 11:07 AM · Core Loader, Metadata workflow

Apr 29 2022

ardumont closed T4206: prod: Deploy metadata loader v0.0.2, a subtask of T1740: fetch extrinsic origin metadata from GitHub, as Resolved.
Apr 29 2022, 11:27 AM · Metadata workflow, Origin-GitHub
ardumont closed T4204: prod: Deploy swh-scheduler 1.1.1, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
Apr 29 2022, 11:27 AM · Core Loader, Metadata workflow

Apr 28 2022

ardumont changed the status of T4206: prod: Deploy metadata loader v0.0.2, a subtask of T1740: fetch extrinsic origin metadata from GitHub, from Open to Work in Progress.
Apr 28 2022, 3:43 PM · Metadata workflow, Origin-GitHub
ardumont changed the status of T4204: prod: Deploy swh-scheduler 1.1.1, a subtask of T4186: Allow loaders to fetch extrinsic metadata, from Open to Work in Progress.
Apr 28 2022, 3:43 PM · Core Loader, Metadata workflow

Apr 27 2022

anlambert added a revision to T4187: Pass forge type to loaders: D7704: tasks: Simplify implementation and add tests for listed origins.
Apr 27 2022, 5:11 PM · Core Loader, Metadata workflow
ardumont closed T4193: staging: Deploy metadata loader, a subtask of T1740: fetch extrinsic origin metadata from GitHub, as Resolved.
Apr 27 2022, 4:56 PM · Metadata workflow, Origin-GitHub
ardumont closed T4194: staging: Deploy swh-scheduler 1.1.0, a subtask of T4187: Pass forge type to loaders, as Resolved.
Apr 27 2022, 4:56 PM · Core Loader, Metadata workflow
vlorentz added revisions to T4186: Allow loaders to fetch extrinsic metadata: D7688: Reference the new swh.loader.metadata package, D7634: Add swh-loader-metadata package to the CI, D7599: Replace self.url with self.origin.url in package loaders.
Apr 27 2022, 4:14 PM · Core Loader, Metadata workflow
vlorentz added a revision to T4186: Allow loaders to fetch extrinsic metadata: D7701: cli: Pass metadata_fetcher_credentials from the config to the loader.
Apr 27 2022, 4:12 PM · Core Loader, Metadata workflow
anlambert added a revision to T4187: Pass forge type to loaders: D7702: tasks: Simplify implementation and add tests for listed origins.
Apr 27 2022, 4:10 PM · Core Loader, Metadata workflow
anlambert added a revision to T4187: Pass forge type to loaders: D7700: tasks: Simplify implementation and add tests for listed origins.
Apr 27 2022, 3:33 PM · Core Loader, Metadata workflow
anlambert added a revision to T4187: Pass forge type to loaders: D7699: tasks: Simplify implementation and add tests for listed origins.
Apr 27 2022, 3:24 PM · Core Loader, Metadata workflow
vlorentz added a subtask for T4187: Pass forge type to loaders: T4194: staging: Deploy swh-scheduler 1.1.0.
Apr 27 2022, 11:25 AM · Core Loader, Metadata workflow
anlambert added a revision to T4187: Pass forge type to loaders: D7694: tasks: Simplify implementation and make visit_date parameter optional.
Apr 27 2022, 11:06 AM · Core Loader, Metadata workflow

Apr 26 2022

anlambert added a revision to T4187: Pass forge type to loaders: D7690: tasks: Fix and simplify implementation.
Apr 26 2022, 5:16 PM · Core Loader, Metadata workflow
ardumont changed the status of T4193: staging: Deploy metadata loader, a subtask of T1740: fetch extrinsic origin metadata from GitHub, from Open to Work in Progress.
Apr 26 2022, 3:33 PM · Metadata workflow, Origin-GitHub

Apr 22 2022

vlorentz added a subtask for T1740: fetch extrinsic origin metadata from GitHub: T4193: staging: Deploy metadata loader.
Apr 22 2022, 3:52 PM · Metadata workflow, Origin-GitHub
vlorentz added a revision to T1740: fetch extrinsic origin metadata from GitHub: D7633: Initialize base metadata fetcher + github.
Apr 22 2022, 3:52 PM · Metadata workflow, Origin-GitHub
vlorentz added a revision to T4188: Make swh-loader-core run metadata fetchers before loading an origin: D7632: BaseLoader: Add hook to call metadata fetchers before loading an origin.
Apr 22 2022, 3:52 PM · Core Loader, Metadata workflow
vlorentz renamed T4188: Make swh-loader-core run metadata fetchers before loading an origin from Make swh-loader-core run metadata fetchers after loading an origin to Make swh-loader-core run metadata fetchers before loading an origin.
Apr 22 2022, 3:51 PM · Core Loader, Metadata workflow

Apr 21 2022

vlorentz removed a subtask for T1740: fetch extrinsic origin metadata from GitHub: T3859: investigate using metadata from GHTorrent.
Apr 21 2022, 8:39 PM · Metadata workflow, Origin-GitHub
vlorentz added a revision to T4187: Pass forge type to loaders: D7628: Add a 'lister_instance_name' argument to all tasks created from ListedOrigin.
Apr 21 2022, 8:37 PM · Core Loader, Metadata workflow
vlorentz added revisions to T1740: fetch extrinsic origin metadata from GitHub: D7629: github: Remove dead code, D7630: github: Refactor rate-limiting out of the GitHubLister class.
Apr 21 2022, 8:36 PM · Metadata workflow, Origin-GitHub
vlorentz added revisions to T4187: Pass forge type to loaders: D7611: cvs: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7612: git: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7613: hg: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7614: bzr: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7615: svn: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7610: BaseLoader: Add 'origin_url' argument and remove 'prepare_origin_visit' method, D7618: Make create_origin_task_dict a standalone function, D7621: Add a 'lister_name' argument to all tasks created from ListedOrigin.
Apr 21 2022, 12:39 PM · Core Loader, Metadata workflow
vlorentz triaged T4188: Make swh-loader-core run metadata fetchers before loading an origin as Normal priority.
Apr 21 2022, 9:05 AM · Core Loader, Metadata workflow
vlorentz triaged T4187: Pass forge type to loaders as Normal priority.
Apr 21 2022, 9:03 AM · Core Loader, Metadata workflow
vlorentz claimed T1740: fetch extrinsic origin metadata from GitHub.
Apr 21 2022, 9:02 AM · Metadata workflow, Origin-GitHub
vlorentz triaged T4186: Allow loaders to fetch extrinsic metadata as Normal priority.
Apr 21 2022, 9:02 AM · Core Loader, Metadata workflow
vlorentz closed T1739: Define an architecture to fetch extrinsic metadata outside listers and loaders, a subtask of T1740: fetch extrinsic origin metadata from GitHub, as Resolved.
Apr 21 2022, 9:00 AM · Metadata workflow, Origin-GitHub
vlorentz closed T1739: Define an architecture to fetch extrinsic metadata outside listers and loaders, a subtask of T1344: Write specs about metadata workflow , as Resolved.
Apr 21 2022, 9:00 AM · Metadata workflow

Mar 23 2022

bchauvet added a parent task for T2088: Specify and draw metadata view on web-app: T4081: Show metadata on Web UI.
Mar 23 2022, 4:45 PM · Roadmap 2020, Web app, Metadata workflow
bchauvet added a parent task for T2191: Metadata Views: T4081: Show metadata on Web UI.
Mar 23 2022, 4:45 PM · Metadata workflow, Web app, Roadmap 2020

Mar 4 2022

vlorentz removed a subtask for T2064: Add metadata from deposits to metadata search: T2270: Add to intrinsic metadata files to be indexed: AUTHORS and CONTRIBUTORS.
Mar 4 2022, 12:03 PM · Metadata workflow

Jan 18 2022

vlorentz added a subtask for T1740: fetch extrinsic origin metadata from GitHub: T3859: investigate using metadata from GHTorrent.
Jan 18 2022, 12:43 PM · Metadata workflow, Origin-GitHub

Oct 21 2021

vlorentz closed T1344: Write specs about metadata workflow , a subtask of T1740: fetch extrinsic origin metadata from GitHub, as Resolved.
Oct 21 2021, 2:12 PM · Metadata workflow, Origin-GitHub
vlorentz closed T1344: Write specs about metadata workflow as Resolved.

It's still missing " Define an architecture to fetch extrinsic metadata outside listers and loaders"

Oct 21 2021, 2:12 PM · Metadata workflow
moranegg added a comment to T1344: Write specs about metadata workflow .

This can be resolved :-)

Oct 21 2021, 12:59 PM · Metadata workflow
moranegg added a comment to T3676: Add grouped properties for SWHID target in ERMDS API endpoint.

Yes context is a better option.
Then target is not in the grouped context.

Oct 21 2021, 11:42 AM · Metadata workflow
vlorentz added a comment to T3676: Add grouped properties for SWHID target in ERMDS API endpoint.

I'd rather call it "context" than "target-details", as this clearer (IMO), and consistent with the original terminology in https://docs.softwareheritage.org/devel/swh-storage/extrinsic-metadata-specification.html

Oct 21 2021, 11:31 AM · Metadata workflow
moranegg triaged T3676: Add grouped properties for SWHID target in ERMDS API endpoint as Normal priority.
Oct 21 2021, 10:58 AM · Metadata workflow

Oct 8 2021

vlorentz updated the task description for T3636: Make the opam loader write extrinsic metadata.
Oct 8 2021, 2:26 PM · Extrinsic metadata, Opam
vlorentz triaged T3636: Make the opam loader write extrinsic metadata as Normal priority.
Oct 8 2021, 2:24 PM · Extrinsic metadata, Opam

Sep 13 2021

vlorentz added a comment to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.

On the other hand, journal clients are sort of a resolution to T2063.

Sep 13 2021, 2:42 PM · Archive search, Metadata workflow
olasd added a comment to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.
In T2073#70230, @vlorentz wrote:

I'm tempted to postpone this issue until we resolve T2063...

Sep 13 2021, 11:36 AM · Archive search, Metadata workflow

Sep 10 2021

vlorentz added a comment to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.

I'm tempted to postpone this issue until we resolve T2063...

Sep 10 2021, 4:05 PM · Archive search, Metadata workflow
vlorentz updated the task description for T2064: Add metadata from deposits to metadata search.
Sep 10 2021, 4:01 PM · Metadata workflow

Sep 6 2021

vlorentz added a revision to T2513: Copy metadata on revisions to the extrinsic metadata storage: D6189: migrate_extrinsic_metadata: Add an option to limit the number of revisions.
Sep 6 2021, 2:46 PM · Metadata workflow, Roadmap 2020

Aug 19 2021

vlorentz removed a parent task for T2513: Copy metadata on revisions to the extrinsic metadata storage: T2202: Collect extrinsic metadata.
Aug 19 2021, 9:20 AM · Metadata workflow, Roadmap 2020

Aug 12 2021

moranegg lowered the priority of T1752: Test drive legacy software curation process with Scilab from High to Normal.
Aug 12 2021, 12:38 PM · Acquisition Process (SWHAP), Metadata workflow, Scientific Community Building

Jul 22 2021

KShivendu removed a watcher for Metadata workflow: KShivendu.
Jul 22 2021, 10:08 AM

Jul 15 2021

vlorentz closed T2938: Create API endpoint to access raw_extrinsic_metadata, a subtask of T2088: Specify and draw metadata view on web-app, as Resolved.
Jul 15 2021, 12:18 PM · Roadmap 2020, Web app, Metadata workflow
vlorentz closed T2938: Create API endpoint to access raw_extrinsic_metadata as Resolved.
Jul 15 2021, 12:18 PM · Web app, Metadata workflow

Jun 28 2021

vlorentz added a revision to T2938: Create API endpoint to access raw_extrinsic_metadata: D5936: Add an endpoint to list metadata authorities for a given SWHID.
Jun 28 2021, 4:06 PM · Web app, Metadata workflow
vlorentz added a revision to T2938: Create API endpoint to access raw_extrinsic_metadata: D5934: Add endpoint raw_extrinsic_metadata_get_authorities.
Jun 28 2021, 4:06 PM · Web app, Metadata workflow
ardumont closed T3411: Deploy api endpoint to access raw extrinsic metadata, a subtask of T2938: Create API endpoint to access raw_extrinsic_metadata, as Resolved.
Jun 28 2021, 12:26 PM · Web app, Metadata workflow
ardumont closed T3411: Deploy api endpoint to access raw extrinsic metadata as Resolved.
Jun 28 2021, 12:26 PM · System administration, Web app, Metadata workflow
ardumont moved T3411: Deploy api endpoint to access raw extrinsic metadata from Backlog to deployed/landed/monitoring on the System administration board.
Jun 28 2021, 12:17 PM · System administration, Web app, Metadata workflow
ardumont added a project to T3411: Deploy api endpoint to access raw extrinsic metadata: System administration.
Jun 28 2021, 12:17 PM · System administration, Web app, Metadata workflow
ardumont added a comment to T3411: Deploy api endpoint to access raw extrinsic metadata.

The example link [3] does return information

Jun 28 2021, 12:17 PM · System administration, Web app, Metadata workflow
ardumont updated the task description for T3411: Deploy api endpoint to access raw extrinsic metadata.
Jun 28 2021, 12:15 PM · System administration, Web app, Metadata workflow
ardumont updated the task description for T3411: Deploy api endpoint to access raw extrinsic metadata.
Jun 28 2021, 11:48 AM · System administration, Web app, Metadata workflow
ardumont triaged T3411: Deploy api endpoint to access raw extrinsic metadata as Normal priority.
Jun 28 2021, 11:28 AM · System administration, Web app, Metadata workflow

Jun 25 2021

vlorentz added revisions to T2938: Create API endpoint to access raw_extrinsic_metadata: D5921: Make api_raw_extrinsic_metadata_get set Content-disposition, D5875: Add an endpoint to list and access raw extrinsic metadata., D5865: Add endpoints to access REMD by id.
Jun 25 2021, 4:26 PM · Web app, Metadata workflow
First
Prev
Next
About · Developer information · Legal