Page MenuHomeSoftware Heritage

Metadata workflowProject
ActivePublic

Recent Activity

Oct 21 2021

vlorentz closed T1344: Write specs about metadata workflow , a subtask of T1740: fetch extrinsic origin metadata from GitHub, as Resolved.
Oct 21 2021, 2:12 PM · Metadata workflow, Origin-GitHub
vlorentz closed T1344: Write specs about metadata workflow as Resolved.

It's still missing " Define an architecture to fetch extrinsic metadata outside listers and loaders"

Oct 21 2021, 2:12 PM · Metadata workflow
moranegg added a comment to T1344: Write specs about metadata workflow .

This can be resolved :-)

Oct 21 2021, 12:59 PM · Metadata workflow
moranegg added a comment to T3676: Add grouped properties for SWHID target in ERMDS API endpoint.

Yes context is a better option.
Then target is not in the grouped context.

Oct 21 2021, 11:42 AM · Metadata workflow
vlorentz added a comment to T3676: Add grouped properties for SWHID target in ERMDS API endpoint.

I'd rather call it "context" than "target-details", as this clearer (IMO), and consistent with the original terminology in https://docs.softwareheritage.org/devel/swh-storage/extrinsic-metadata-specification.html

Oct 21 2021, 11:31 AM · Metadata workflow
moranegg triaged T3676: Add grouped properties for SWHID target in ERMDS API endpoint as Normal priority.
Oct 21 2021, 10:58 AM · Metadata workflow

Oct 8 2021

vlorentz updated the task description for T3636: Make the opam loader write extrinsic metadata.
Oct 8 2021, 2:26 PM · Extrinsic metadata, Opam
vlorentz triaged T3636: Make the opam loader write extrinsic metadata as Normal priority.
Oct 8 2021, 2:24 PM · Extrinsic metadata, Opam

Sep 13 2021

vlorentz added a comment to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.

On the other hand, journal clients are sort of a resolution to T2063.

Sep 13 2021, 2:42 PM · Archive search, Metadata workflow
olasd added a comment to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.

I'm tempted to postpone this issue until we resolve T2063...

Sep 13 2021, 11:36 AM · Archive search, Metadata workflow

Sep 10 2021

vlorentz added a comment to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.

I'm tempted to postpone this issue until we resolve T2063...

Sep 10 2021, 4:05 PM · Archive search, Metadata workflow
vlorentz updated the task description for T2064: Add metadata from deposits to metadata search.
Sep 10 2021, 4:01 PM · Metadata workflow

Sep 6 2021

vlorentz added a revision to T2513: Copy metadata on revisions to the extrinsic metadata storage: D6189: migrate_extrinsic_metadata: Add an option to limit the number of revisions.
Sep 6 2021, 2:46 PM · Metadata workflow, Roadmap 2020

Aug 19 2021

vlorentz removed a parent task for T2513: Copy metadata on revisions to the extrinsic metadata storage: T2202: Collect extrinsic metadata.
Aug 19 2021, 9:20 AM · Metadata workflow, Roadmap 2020

Aug 12 2021

moranegg lowered the priority of T1752: Test drive legacy software curation process from High to Normal.
Aug 12 2021, 12:38 PM · Acquisition Process (SWHAP), Metadata workflow, Scientific Community Building

Jul 22 2021

KShivendu removed a watcher for Metadata workflow: KShivendu.
Jul 22 2021, 10:08 AM

Jul 15 2021

vlorentz closed T2938: Create API endpoint to access raw_extrinsic_metadata, a subtask of T2088: Specify and draw metadata view on web-app, as Resolved.
Jul 15 2021, 12:18 PM · Roadmap 2020, Web app, Metadata workflow
vlorentz closed T2938: Create API endpoint to access raw_extrinsic_metadata as Resolved.
Jul 15 2021, 12:18 PM · Web app, Metadata workflow

Jun 28 2021

vlorentz added a revision to T2938: Create API endpoint to access raw_extrinsic_metadata: D5936: Add an endpoint to list metadata authorities for a given SWHID.
Jun 28 2021, 4:06 PM · Web app, Metadata workflow
vlorentz added a revision to T2938: Create API endpoint to access raw_extrinsic_metadata: D5934: Add endpoint raw_extrinsic_metadata_get_authorities.
Jun 28 2021, 4:06 PM · Web app, Metadata workflow
ardumont closed T3411: Deploy api endpoint to access raw extrinsic metadata, a subtask of T2938: Create API endpoint to access raw_extrinsic_metadata, as Resolved.
Jun 28 2021, 12:26 PM · Web app, Metadata workflow
ardumont closed T3411: Deploy api endpoint to access raw extrinsic metadata as Resolved.
Jun 28 2021, 12:26 PM · System administration, Web app, Metadata workflow
ardumont moved T3411: Deploy api endpoint to access raw extrinsic metadata from Backlog to deployed/landed on the System administration board.
Jun 28 2021, 12:17 PM · System administration, Web app, Metadata workflow
ardumont added a project to T3411: Deploy api endpoint to access raw extrinsic metadata: System administration.
Jun 28 2021, 12:17 PM · System administration, Web app, Metadata workflow
ardumont added a comment to T3411: Deploy api endpoint to access raw extrinsic metadata.

The example link [3] does return information

Jun 28 2021, 12:17 PM · System administration, Web app, Metadata workflow
ardumont updated the task description for T3411: Deploy api endpoint to access raw extrinsic metadata.
Jun 28 2021, 12:15 PM · System administration, Web app, Metadata workflow
ardumont updated the task description for T3411: Deploy api endpoint to access raw extrinsic metadata.
Jun 28 2021, 11:48 AM · System administration, Web app, Metadata workflow
ardumont triaged T3411: Deploy api endpoint to access raw extrinsic metadata as Normal priority.
Jun 28 2021, 11:28 AM · System administration, Web app, Metadata workflow

Jun 25 2021

vlorentz added revisions to T2938: Create API endpoint to access raw_extrinsic_metadata: D5921: Make api_raw_extrinsic_metadata_get set Content-disposition, D5875: Add an endpoint to list and access raw extrinsic metadata., D5865: Add endpoints to access REMD by id.
Jun 25 2021, 4:26 PM · Web app, Metadata workflow

Jun 8 2021

vlorentz removed a project from T2938: Create API endpoint to access raw_extrinsic_metadata: Easy hack.

Removing the "easy hack" tag, because that's actually much harder than expected :D

Jun 8 2021, 1:26 PM · Web app, Metadata workflow

Jun 4 2021

vlorentz claimed T2938: Create API endpoint to access raw_extrinsic_metadata.
Jun 4 2021, 1:42 PM · Web app, Metadata workflow

Apr 27 2021

vlorentz moved T2779: Put information (client, collection and deposit-id) inside metadata for metadata-only deposit from Landed/Tests/Validations (staging) to Deployed on the SWORD deposit board.
Apr 27 2021, 2:09 PM · Metadata workflow, SWORD deposit
vlorentz renamed T2779: Put information (client, collection and deposit-id) inside metadata for metadata-only deposit from Put information (client, collection and deposit-id) inside metadata for metada-only deposit to Put information (client, collection and deposit-id) inside metadata for metadata-only deposit.
Apr 27 2021, 2:09 PM · Metadata workflow, SWORD deposit

Apr 9 2021

vlorentz renamed T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch from Index extrinsic metadata in swh-search/Elasticsearch from the journal to Index extrinsic metadata from the journal in swh-search/Elasticsearch.
Apr 9 2021, 9:33 AM · Archive search, Metadata workflow

Apr 8 2021

vlorentz placed T2938: Create API endpoint to access raw_extrinsic_metadata up for grabs.
Apr 8 2021, 10:54 AM · Web app, Metadata workflow

Apr 7 2021

ardumont added a comment to T1523: Search tools on metadata.

can anybody point me to the relevant repo?

Apr 7 2021, 8:53 AM · meta-task, Restricted Project, Metadata workflow
hack3r-0m added a comment to T1523: Search tools on metadata.

hi, I would like to get familiar with this, as mentioned in the wiki ,

Apr 7 2021, 8:22 AM · meta-task, Restricted Project, Metadata workflow

Apr 6 2021

olasd added a comment to T2513: Copy metadata on revisions to the extrinsic metadata storage.
2021-04-06 20:54:44,962 __main__     ERROR    Could not parse revision metadata 00c6e2fe046dee3b5ef629f74f4801345840e70a
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/swh/storage/migrate_extrinsic_metadata.py", line 1161, in main
    handle_row(row, storage, deposit_cur, dry_run)
  File "/usr/lib/python3/dist-packages/swh/storage/migrate_extrinsic_metadata.py", line 843, in handle_row
    assert "id" in actual_metadata or "title" in actual_metadata
AssertionError
Apr 6 2021, 11:12 PM · Metadata workflow, Roadmap 2020
olasd added a comment to T2513: Copy metadata on revisions to the extrinsic metadata storage.
2021-04-06 20:19:19,898 __main__     ERROR    Could not parse revision metadata 00959a167bd98452c98ce73382f4b42179d53d32
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/swh/storage/migrate_extrinsic_metadata.py", line 1161, in main
    handle_row(row, storage, deposit_cur, dry_run)
  File "/usr/lib/python3/dist-packages/swh/storage/migrate_extrinsic_metadata.py", line 979, in handle_row
    storage, row["id"], metadata["original_artifact"][0]["filename"]
  File "/usr/lib/python3/dist-packages/swh/storage/migrate_extrinsic_metadata.py", line 265, in pypi_origin_from_filename
    project_name = pypi_project_from_filename(filename)
  File "/usr/lib/python3/dist-packages/swh/storage/migrate_extrinsic_metadata.py", line 256, in pypi_project_from_filename
    assert match, original_filename
AssertionError: pypops-201408-r4.tar.gz
Apr 6 2021, 10:21 PM · Metadata workflow, Roadmap 2020
olasd added a comment to T2513: Copy metadata on revisions to the extrinsic metadata storage.

(I've also noticed dry_run was = True, so I fixed that as well :P)

Apr 6 2021, 8:12 PM · Metadata workflow, Roadmap 2020
olasd added a comment to T2513: Copy metadata on revisions to the extrinsic metadata storage.

Tail of log:

Apr 6 2021, 7:57 PM · Metadata workflow, Roadmap 2020
olasd claimed T2513: Copy metadata on revisions to the extrinsic metadata storage.

The script is now running on getty.

Apr 6 2021, 7:07 PM · Metadata workflow, Roadmap 2020
vlorentz added a comment to T2513: Copy metadata on revisions to the extrinsic metadata storage.

https://forge.softwareheritage.org/source/swh-storage/browse/master/swh/storage/migrate_extrinsic_metadata.py

Apr 6 2021, 5:14 PM · Metadata workflow, Roadmap 2020
vlorentz merged T3185: Migrate extrinsic metadata from 'revision' to 'raw_extrinsic_metadata' tables into T2513: Copy metadata on revisions to the extrinsic metadata storage.
Apr 6 2021, 5:14 PM · Metadata workflow, Roadmap 2020

Apr 2 2021

moranegg added a comment to T2329: Extend CodeMeta vocabulary to qualify author relationships.

Another link for author roles: https://allcontributors.org/docs/en/emoji-key

Apr 2 2021, 2:15 PM · Scientific Community Building, Metadata workflow

Mar 25 2021

moranegg moved T2779: Put information (client, collection and deposit-id) inside metadata for metadata-only deposit from In progress to Landed/Tests/Validations (staging) on the SWORD deposit board.
Mar 25 2021, 12:38 PM · Metadata workflow, SWORD deposit
vlorentz closed T1910: Redesign origin search using a dedicated component (swh-search), a subtask of T1523: Search tools on metadata, as Resolved.
Mar 25 2021, 11:16 AM · meta-task, Restricted Project, Metadata workflow

Mar 23 2021

vlorentz closed T2703: Use intrinsic identifiers/hashes for RawExtrinsicMetadata objects, a subtask of T2513: Copy metadata on revisions to the extrinsic metadata storage, as Resolved.
Mar 23 2021, 2:33 PM · Metadata workflow, Roadmap 2020
vlorentz closed T2703: Use intrinsic identifiers/hashes for RawExtrinsicMetadata objects, a subtask of T2779: Put information (client, collection and deposit-id) inside metadata for metadata-only deposit, as Resolved.
Mar 23 2021, 2:33 PM · Metadata workflow, SWORD deposit

Mar 18 2021

KShivendu added a revision to T3078: Index CITATION.cff files: D5273: swh-indexer : Add mapping for CITATION.cff files.
Mar 18 2021, 6:16 AM · Intrinsic metadata, Easy hack