Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 22 2020

moranegg moved T2179: Document user stories on website or archive from Backlog to archive-users (docs/user-guides/) on the Documentation board.
Sep 22 2020, 2:47 PM · Documentation
moranegg moved T1946: Improve run_a_new_lister.rst file from Backlog to developers (docs/devel/) on the Documentation board.
Sep 22 2020, 2:44 PM · Easy hack, Documentation, Lister
moranegg added a comment to T358: doc: high-level architecture diagram.

Is the diagram in the link below the answer to this task?
https://docs.softwareheritage.org/devel/architecture.html

Sep 22 2020, 2:43 PM · Documentation
moranegg moved T1979: Remarks on the tutorial "Run a new lister" from Backlog to developers (docs/devel/) on the Documentation board.
Sep 22 2020, 2:39 PM · Documentation, Lister
moranegg moved T2050: Create page "how to contribute" (dev, docs, tasks) as a first steps guide in SWH from Backlog to developers (docs/devel/) on the Documentation board.
Sep 22 2020, 2:39 PM · Documentation
moranegg moved T2089: Write user stories entering the SWH world and its documentation from Backlog to archive-users (docs/user-guides/) on the Documentation board.
Sep 22 2020, 2:38 PM · Documentation
moranegg moved T1839: Write glossary/taxonomy for push archival process and mechanism from Backlog to visitors (main website) on the Documentation board.
Sep 22 2020, 2:38 PM · Community Building, Documentation
moranegg moved T2431: Document how to export the graph edge dataset from Backlog to archive-users (docs/user-guides/) on the Documentation board.
Sep 22 2020, 2:37 PM · Documentation, Compressed graph service, Datasets
moranegg moved T2612: Document project's architecture history by keeping trace of modules and sub-modules from Backlog to developers (docs/devel/) on the Documentation board.
Sep 22 2020, 2:30 PM · Documentation
moranegg added a subtask for T2234: Write use case-specific documentation: T2179: Document user stories on website or archive.
Sep 22 2020, 2:24 PM · Roadmap 2021, meta-task, Documentation
moranegg added a parent task for T2179: Document user stories on website or archive: T2234: Write use case-specific documentation.
Sep 22 2020, 2:24 PM · Documentation
moranegg added a subtask for T2179: Document user stories on website or archive: T2089: Write user stories entering the SWH world and its documentation .
Sep 22 2020, 2:23 PM · Documentation
moranegg added a parent task for T2089: Write user stories entering the SWH world and its documentation : T2179: Document user stories on website or archive.
Sep 22 2020, 2:23 PM · Documentation
moranegg removed a parent task for T2179: Document user stories on website or archive: T2089: Write user stories entering the SWH world and its documentation .
Sep 22 2020, 2:22 PM · Documentation
moranegg removed a subtask for T2089: Write user stories entering the SWH world and its documentation : T2179: Document user stories on website or archive.
Sep 22 2020, 2:22 PM · Documentation
moranegg updated the task description for T2089: Write user stories entering the SWH world and its documentation .
Sep 22 2020, 2:17 PM · Documentation
moranegg updated the task description for T2089: Write user stories entering the SWH world and its documentation .
Sep 22 2020, 2:14 PM · Documentation
moranegg updated subscribers of T2089: Write user stories entering the SWH world and its documentation .

This list of user stories is something that can be written in a wiki.
@douardda or do you prefer having this list of scenarios in the docs ( for example in: docs.softwareheritage.org/user-stories)

Sep 22 2020, 2:12 PM · Documentation
moranegg claimed T2089: Write user stories entering the SWH world and its documentation .
Sep 22 2020, 2:11 PM · Documentation
moranegg renamed T2618: Re-draw the flowcharts in swh-deposit documentation using plantuml from Re-draw the flowcharts in swh-deposit documentation using Plantuml to Re-draw the flowcharts in swh-deposit documentation using Mermaid.
Sep 22 2020, 12:03 PM · SWORD deposit, Documentation
moranegg added a comment to T2618: Re-draw the flowcharts in swh-deposit documentation using plantuml.

Also we decided (on today's call) to keep diagrams with mermaid.

Sep 22 2020, 12:02 PM · SWORD deposit, Documentation
moranegg added a comment to T2618: Re-draw the flowcharts in swh-deposit documentation using plantuml.

This is the blueprint page for all use-cases:
https://docs.softwareheritage.org/devel/swh-deposit/specs/blueprint.html

Sep 22 2020, 12:01 PM · SWORD deposit, Documentation

Sep 21 2020

moranegg added inline comments to D3999: blueprint: detail when deposit updates are allowed..
Sep 21 2020, 4:44 PM
moranegg closed T2527: Review codemeta.json export from HAL as Resolved.
Sep 21 2020, 3:19 PM · SWORD deposit, Metadata workflow
moranegg added a comment to T2527: Review codemeta.json export from HAL.

Reviewed and opened the HAL issue (which is on a closed forge, so most of you can't open):
https://gitlab.ccsd.cnrs.fr/ccsd/hal/-/issues/302

Sep 21 2020, 3:18 PM · SWORD deposit, Metadata workflow
moranegg added a comment to T2559: Modify redirection on https://softwareheritage.org/swhid.

Redirection should be to https://docs.softwareheritage.org/devel/swh-model/persistent-identifiers.html

Sep 21 2020, 3:13 PM · Website, SWORD deposit, Metadata workflow
moranegg placed T2559: Modify redirection on https://softwareheritage.org/swhid up for grabs.
Sep 21 2020, 3:11 PM · Website, SWORD deposit, Metadata workflow
moranegg added a comment to T2612: Document project's architecture history by keeping trace of modules and sub-modules.

@ardumont it is exactly the diagram I was looking for. Thanks!
I think we need a diagram that shows the functionality dependence between modules.

Sep 21 2020, 10:31 AM · Documentation

Sep 18 2020

moranegg added a project to T1839: Write glossary/taxonomy for push archival process and mechanism: Documentation.
Sep 18 2020, 3:08 PM · Community Building, Documentation
moranegg added a comment to T1839: Write glossary/taxonomy for push archival process and mechanism.

The access to the glossary from the main docs page is hard find.
It's under Indices and tables which is not exactly the evident as a glossary related category.
Also there is no access from the left menu.

Sep 18 2020, 3:08 PM · Community Building, Documentation
moranegg moved T1485: Show stats on extracted metadata from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 2:46 PM · Web app, Metadata workflow, Indexer
moranegg moved T1215: Crossminer: investigate CrossSim tool to tag software projects from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 2:46 PM · Metadata workflow
moranegg moved T2396: Link Wikidata entities (Qxxx) to SWH origins with a new property/qualifier from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 2:45 PM · Metadata workflow, Software Stories
moranegg renamed T2396: Link Wikidata entities (Qxxx) to SWH origins with a new property/qualifier from Create links from Wikidata to SWH origins to Link Wikidata entities (Qxxx) to SWH origins with a new property/qualifier.
Sep 18 2020, 2:45 PM · Metadata workflow, Software Stories
moranegg moved T2329: Extend CodeMeta vocabulary to qualify author relationships from Backlog to Crosswalks and mappings on the Metadata workflow board.
Sep 18 2020, 2:43 PM · Scientific Community Building, Metadata workflow
moranegg moved T1740: fetch extrinsic origin metadata from GitHub from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 2:41 PM · Metadata workflow, Origin-GitHub
moranegg edited projects for T2202: Collect extrinsic metadata, added: Extrinsic metadata; removed Metadata workflow.
Sep 18 2020, 2:39 PM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata
moranegg moved T2312: Review metadata deposit specs for metadata-only deposit from Work in progress to Done on the Roadmap 2020 board.
Sep 18 2020, 2:38 PM · Metadata workflow, Roadmap 2020
moranegg added a parent task for T1740: fetch extrinsic origin metadata from GitHub: T833: When listing an origin, add origin level metadata to RMD storage.
Sep 18 2020, 2:36 PM · Metadata workflow, Origin-GitHub
moranegg added a subtask for T833: When listing an origin, add origin level metadata to RMD storage: T1740: fetch extrinsic origin metadata from GitHub.
Sep 18 2020, 2:36 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg added a subtask for T2202: Collect extrinsic metadata: T833: When listing an origin, add origin level metadata to RMD storage.
Sep 18 2020, 2:35 PM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata
moranegg added a parent task for T833: When listing an origin, add origin level metadata to RMD storage: T2202: Collect extrinsic metadata.
Sep 18 2020, 2:35 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg renamed T833: When listing an origin, add origin level metadata to RMD storage from When listing an origin, add origin level metadata to storage to When listing an origin, add origin level metadata to RMD storage.
Sep 18 2020, 2:31 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg moved T1752: Test drive legacy software curation process with Scilab from Backlog to Documentation on the Metadata workflow board.
Sep 18 2020, 2:23 PM · Acquisition Process (SWHAP), Metadata workflow, Scientific Community Building
moranegg moved T2064: Add metadata from deposits to metadata search from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 2:23 PM · Metadata workflow
moranegg moved T2088: Specify and draw metadata view on web-app from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 2:23 PM · Roadmap 2020, Web app, Metadata workflow
moranegg claimed T2088: Specify and draw metadata view on web-app.
Sep 18 2020, 2:23 PM · Roadmap 2020, Web app, Metadata workflow
moranegg added a subtask for T2191: Metadata Views: T2088: Specify and draw metadata view on web-app.
Sep 18 2020, 2:22 PM · Metadata workflow, Web app, Roadmap 2020
moranegg added a parent task for T2088: Specify and draw metadata view on web-app: T2191: Metadata Views.
Sep 18 2020, 2:22 PM · Roadmap 2020, Web app, Metadata workflow
moranegg renamed T2088: Specify and draw metadata view on web-app from Create metadata view on web-app to Specify and draw metadata view on web-app.
Sep 18 2020, 2:21 PM · Roadmap 2020, Web app, Metadata workflow
moranegg moved T1681: Use project metadata as a "lister" from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 2:19 PM · Archive coverage, Indexer, Metadata workflow
moranegg moved T1739: Define an architecture to fetch extrinsic metadata outside listers and loaders from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 2:19 PM · Extrinsic metadata
moranegg moved T1747: Review APIs to get metadata from supported origins from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 2:18 PM · Extrinsic metadata
moranegg moved T1897: Specify dates schema when dealing with Legacy Software from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 2:18 PM · SWORD deposit, Metadata workflow, Scientific Community Building
moranegg closed T2312: Review metadata deposit specs for metadata-only deposit, a subtask of T2311: Review the deposit of CodeMeta metadata in xml (following SWORD V2 specs) , as Resolved.
Sep 18 2020, 2:16 PM · SWORD deposit, Metadata workflow, Roadmap 2020
moranegg closed T2312: Review metadata deposit specs for metadata-only deposit, a subtask of T2537: Extend new deposit endpoint to support metadata-only deposits, as Resolved.
Sep 18 2020, 2:16 PM · Roadmap 2020, SWORD deposit, Scientific Community Building
moranegg closed T2312: Review metadata deposit specs for metadata-only deposit as Resolved.
Sep 18 2020, 2:16 PM · Metadata workflow, Roadmap 2020
moranegg created Extrinsic metadata.
Sep 18 2020, 2:13 PM
moranegg created Intrinsic metadata.
Sep 18 2020, 2:12 PM
moranegg added a comment to T2560: Extend **update** deposit endpoint to enable new/modified metadata from client on an existing deposit.

Here is the document on which we based this summary

Sep 18 2020, 2:08 PM · Roadmap 2020, SWORD deposit, Scientific Community Building
moranegg moved T1585: Add support for extracting metadata from Python classifiers from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:50 PM · Indexer, Metadata workflow
moranegg moved T1523: Search tools on metadata from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:50 PM · meta-task, Restricted Project, Metadata workflow
moranegg moved T1345: Update metadata docs about using CodeMeta vocabulary from Backlog to Documentation on the Metadata workflow board.
Sep 18 2020, 1:49 PM · Documentation
moranegg moved T734: Create strategy for extracting metadata from external-catalogs from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 1:49 PM · Metadata workflow
moranegg moved T833: When listing an origin, add origin level metadata to RMD storage from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:49 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg moved T1344: Write specs about metadata workflow from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 1:49 PM · Metadata workflow
moranegg moved T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:48 PM · Archive search, Metadata workflow
moranegg moved T2270: Add to intrinsic metadata files to be indexed: AUTHORS and CONTRIBUTORS from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:48 PM · Intrinsic metadata, Indexer
moranegg moved T2079: Prepare collaborative document for how to use SWHID on WikiData for preservation and discovery from Backlog to Documentation on the Metadata workflow board.
Sep 18 2020, 1:48 PM · Software Stories
moranegg moved T2311: Review the deposit of CodeMeta metadata in xml (following SWORD V2 specs) from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 1:46 PM · SWORD deposit, Metadata workflow, Roadmap 2020
moranegg moved T2312: Review metadata deposit specs for metadata-only deposit from Backlog to Specifications on the Metadata workflow board.
Sep 18 2020, 1:46 PM · Metadata workflow, Roadmap 2020
moranegg moved T2397: Review semantic gaps in the CodeMeta crosswalk table from Backlog to Crosswalks and mappings on the Metadata workflow board.
Sep 18 2020, 1:45 PM · Software Stories
moranegg added a project to T2472: Indexing intrinsic metadata in a deposit using a sub-folder for the content: Indexer.
Sep 18 2020, 1:45 PM · Intrinsic metadata, Indexer, SWORD deposit
moranegg moved T2513: Copy metadata on revisions to the extrinsic metadata storage from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:44 PM · Metadata workflow, Roadmap 2020
moranegg moved T2559: Modify redirection on https://softwareheritage.org/swhid from Backlog to Implementation on the Metadata workflow board.
Sep 18 2020, 1:44 PM · Website, SWORD deposit, Metadata workflow
moranegg updated subscribers of T2612: Document project's architecture history by keeping trace of modules and sub-modules.
Sep 18 2020, 10:31 AM · Documentation
moranegg added a comment to T2612: Document project's architecture history by keeping trace of modules and sub-modules.

Also, I'm searching for a page or image that shows the relations between modules.

Sep 18 2020, 10:31 AM · Documentation

Sep 17 2020

moranegg triaged T2612: Document project's architecture history by keeping trace of modules and sub-modules as Normal priority.
Sep 17 2020, 4:49 PM · Documentation
moranegg added a comment to T2057: Check and fix HAL-preprod `forbidden` error .

I've sent an email (@ardumont in CC) to Bruno and Yannick about this error and about T2611.

Sep 17 2020, 4:33 PM · SWORD deposit
moranegg added a comment to T2611: Check and fix HAL-prod `Application error`.
id  |        reception_date         | complete_date | external_id  | swh_id | status  | client_id | collection_id | parent_id | status_detail | swh_id_context | check_task_id | load_task_id
-----+-------------------------------+---------------+--------------+--------+---------+-----------+---------------+-----------+---------------+----------------+---------------+--------------
 902 | 2020-09-17 13:16:42.70178+00  |               | hal-02942052 |        | partial |         2 |             1 |           |               |                |               |
 903 | 2020-09-17 14:17:59.276928+00 |               | hal-02942052 |        | partial |         2 |             1 |           |               |                |               |

Which means the deposit is not completed before the Application error.

Sep 17 2020, 4:32 PM · SWORD deposit
moranegg triaged T2611: Check and fix HAL-prod `Application error` as Normal priority.
Sep 17 2020, 4:32 PM · SWORD deposit
moranegg added a comment to T2057: Check and fix HAL-preprod `forbidden` error .

I have tested today at 11.20 with the same error on HAL's platform.
@ardumont : can you check what the logs say about that?
I think it's about the client credentials, they use the HAL prod credentials and they are listed as HAL preprod client.

Sep 17 2020, 11:29 AM · SWORD deposit

Sep 15 2020

moranegg added a comment to T2391: Document `--create-origin` on the swh-deposit client for origin creation.

The idea was to update the information about the slug on the documentation we give to clients :

  1. https://docs.softwareheritage.org/devel/swh-deposit/getting-started.html#single-deposit
  2. https://docs.softwareheritage.org/devel/swh-deposit/spec-api.html#create-deposit
Sep 15 2020, 4:42 PM · SWORD deposit
moranegg added a comment to T2311: Review the deposit of CodeMeta metadata in xml (following SWORD V2 specs) .

I think we can resolve this task as we agreed on staying with the xml format for the metadata-only deposit.

Sep 15 2020, 4:37 PM · SWORD deposit, Metadata workflow, Roadmap 2020
moranegg accepted D3939: Update the loading specification..
Sep 15 2020, 10:02 AM

Sep 14 2020

moranegg requested changes to D3939: Update the loading specification..
Sep 14 2020, 3:05 PM
moranegg accepted D3938: Proofread the loading specification..
Sep 14 2020, 3:03 PM
moranegg updated subscribers of T2399: Update SWORD deposit documentation about the returned SWHID.
Sep 14 2020, 3:02 PM · SWORD deposit
moranegg renamed T2399: Update SWORD deposit documentation about the returned SWHID from Update SWORD deposit documentation to Update SWORD deposit documentation about the returned SWHID.
Sep 14 2020, 3:01 PM · SWORD deposit
moranegg updated subscribers of T2399: Update SWORD deposit documentation about the returned SWHID.

@vlorentz can I assign you this task, as you are working on specs and docs?
it's only about adding information on the new SWHID qualifiers.

Sep 14 2020, 3:01 PM · SWORD deposit
moranegg added a comment to D3939: Update the loading specification..

Great ! thanks for tackling this !

Sep 14 2020, 2:49 PM

Sep 9 2020

moranegg renamed T2159: Add clickable examples to SWHID docs from Add clickable examples to SWH-ID docs to Add clickable examples to SWHID docs.
Sep 9 2020, 1:11 PM · Easy hack, Documentation

Sep 8 2020

moranegg triaged T2578: Review Wikidata property name and meaning [P6138] as Normal priority.
Sep 8 2020, 5:28 PM · Software Stories
moranegg added a comment to T1298: Review Wikidata property proposal for swh-id release.

Adding this link to the case study:
https://docs.google.com/document/d/1EZIBvENaY-atx9PvoOKUb9setQTERV2rmLvpMrJd2e0/edit?usp=sharing

Sep 8 2020, 4:28 PM · Software Stories, Metadata workflow
moranegg added inline comments to D3895: spec-meta-deposit: specify what SWHID context qualifiers are allowed..
Sep 8 2020, 4:13 PM
moranegg accepted D3893: spec-meta-deposit: only allow depositing metadata on one object at a time..
Sep 8 2020, 4:08 PM
moranegg added a comment to T2312: Review metadata deposit specs for metadata-only deposit.

I prefer A2 as well.

Sep 8 2020, 4:07 PM · Metadata workflow, Roadmap 2020

Sep 4 2020

moranegg added a comment to T2312: Review metadata deposit specs for metadata-only deposit.

I see we have three-four options:

Sep 4 2020, 2:10 PM · Metadata workflow, Roadmap 2020

Sep 3 2020

moranegg added a comment to T2312: Review metadata deposit specs for metadata-only deposit.

@vlorentz can you please review the naming and the choice of the tag with or without the attribute (e.g id, url)?

Sep 3 2020, 4:06 PM · Metadata workflow, Roadmap 2020
moranegg added a comment to T2537: Extend new deposit endpoint to support metadata-only deposits.

After this morning's meeting with @vlorentz and @ardumont:
We will keep the metadata-only deposit specs with the idea of a separate namespace swh for which we need to write the schema (not sure we have that).

This way, the xml with metadata has a section where the identified artifact is mentioned:

Reference a snapshot, revision or release:

With ${type} in {snp (snapshot), rev (revision), rel (release) }:
<swh:deposit>
  <swh:reference>
    <swh:object id="swh:1:${type}:aaaaaaaaaaaaaa..."/>
  </swh:reference>
</swh:deposit>

We need to add to the list of types: directory and content

The possibility to deposit metadata on an origin should be implemented as well, but is not suited for institutional repositories (e.g HAL).
Reference an origin:

<swh:deposit>
  <swh:reference>
    <swh:origin url="https://github.com/user/repo"/>
  </swh:reference>
</swh:deposit>

This specs fits the POST of a new deposit in SWORD and is described in the SWORD v2 documentation (6.3.3. Creating a Resource with an Atom Entry)

Sep 3 2020, 4:03 PM · Roadmap 2020, SWORD deposit, Scientific Community Building