Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 28 2017

moranegg triaged T833: When listing an origin, add origin level metadata to RMD storage as Low priority.
Nov 28 2017, 4:16 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg moved T859: SWORD deposit: verify deposit on web-app from Backlog to High priority on the SWORD deposit board.
Nov 28 2017, 4:14 PM · SWORD deposit
moranegg created T859: SWORD deposit: verify deposit on web-app.
Nov 28 2017, 4:14 PM · SWORD deposit
moranegg moved T858: Identify a deposit in the archive after loading from Backlog to High priority on the SWORD deposit board.
Nov 28 2017, 4:09 PM · SWORD deposit, Metadata workflow
moranegg renamed T834: deploy revision_indexer (at least for codemeta.json) from deploy revision_indexer (for codemeta.json) to deploy revision_indexer (at least for codemeta.json).
Nov 28 2017, 4:06 PM · Indexer, Metadata workflow
moranegg moved T858: Identify a deposit in the archive after loading from Backlog to Specifications on the Metadata workflow board.
Nov 28 2017, 4:05 PM · SWORD deposit, Metadata workflow
moranegg added a project to T858: Identify a deposit in the archive after loading: SWORD deposit.
Nov 28 2017, 4:05 PM · SWORD deposit, Metadata workflow
moranegg added a watcher for SWORD deposit: moranegg.
Nov 28 2017, 4:01 PM
moranegg created T858: Identify a deposit in the archive after loading.
Nov 28 2017, 3:59 PM · SWORD deposit, Metadata workflow
moranegg renamed T736: Identifying software in the archive- context and artifact identification from Identifying software to Identifying software in the archive- context and artifact identification.
Nov 28 2017, 3:55 PM · Metadata workflow
moranegg closed T852: When loading a software artifact, add origin level metadata as Resolved.
Nov 28 2017, 3:44 PM · Metadata workflow
moranegg moved T852: When loading a software artifact, add origin level metadata from Backlog to Specifications on the Metadata workflow board.
Nov 28 2017, 3:44 PM · Metadata workflow

Nov 23 2017

moranegg renamed T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit from HAL metadata integration to HAL metadata integration: implement and verify metadata deposit and storage for deposit.
Nov 23 2017, 12:32 PM · Metadata workflow, SWORD deposit
moranegg changed the status of T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit, a subtask of T716: Integration HAL - Software Heritage (metatask), from Open to Work in Progress.
Nov 23 2017, 12:32 PM · SWORD deposit
moranegg closed T837: add link to metadata documentation, a subtask of T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit, as Resolved.
Nov 23 2017, 12:30 PM · Metadata workflow, SWORD deposit
moranegg closed T837: add link to metadata documentation as Resolved.
Nov 23 2017, 12:30 PM · Metadata workflow, SWORD deposit
moranegg closed T832: deposit metadata injection into origin_metadata, a subtask of T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit, as Resolved.
Nov 23 2017, 12:29 PM · Metadata workflow, SWORD deposit
moranegg closed T832: deposit metadata injection into origin_metadata as Resolved.
Nov 23 2017, 12:29 PM · Metadata workflow, SWORD deposit
moranegg committed rDDEPb827c935f461: Refactor tests: use actual prepare_metadata without overriding it for tests (authored by moranegg).
Refactor tests: use actual prepare_metadata without overriding it for tests
Nov 23 2017, 12:28 PM
moranegg committed rDDEP49f7beee3530: Added metadata injection and url to client (authored by moranegg).
Added metadata injection and url to client
Nov 23 2017, 12:28 PM
moranegg committed rDDEPe2d1938b069c: Added tests for metadata injection (authored by moranegg).
Added tests for metadata injection
Nov 23 2017, 12:28 PM
moranegg committed rDDEP922f8952915d: Change metadata provider and tool as additional config (authored by moranegg).
Change metadata provider and tool as additional config
Nov 23 2017, 12:28 PM
moranegg committed rDDEP53f407f61338: Refactor origin_metadata injection with prepare_metadata from loader-core (authored by moranegg).
Refactor origin_metadata injection with prepare_metadata from loader-core
Nov 23 2017, 12:28 PM
moranegg closed D265: enable metadata injection from deposit.
Nov 23 2017, 12:27 PM
moranegg added a comment to D265: enable metadata injection from deposit.
In D265#5625, @ardumont wrote:
  • Refactor tests: use actual prepare_metadata without mocking it for tests

Well, you did not mock, you overrode :)

Nov 23 2017, 12:25 PM
moranegg moved T832: deposit metadata injection into origin_metadata from Implementation to Documentation on the Metadata workflow board.
Nov 23 2017, 12:17 PM · Metadata workflow, SWORD deposit
moranegg moved T837: add link to metadata documentation from Implementation to Documentation on the Metadata workflow board.
Nov 23 2017, 12:17 PM · Metadata workflow, SWORD deposit
moranegg committed rDLDBASE0308c46cf5d0: Added metadata injection possible from loader core (authored by moranegg).
Added metadata injection possible from loader core
Nov 23 2017, 12:16 PM
moranegg committed rDLDBASE7c907414795b: Refactor by having the provider_id and tool_id resolution at loader level (authored by moranegg).
Refactor by having the provider_id and tool_id resolution at loader level
Nov 23 2017, 12:16 PM
moranegg closed D266: enable metadata injection from loader core.
Nov 23 2017, 12:16 PM
moranegg updated the diff for D265: enable metadata injection from deposit.
  • Refactor tests: use actual prepare_metadata without mocking it for tests
Nov 23 2017, 12:06 PM
moranegg updated the diff for D265: enable metadata injection from deposit.
  • Refactor tests: use actual prepare_metadata without mocking it for tests
Nov 23 2017, 11:34 AM
moranegg updated the diff for D266: enable metadata injection from loader core.
  • Align prepare_metadata and send_tool with Storage capacity to return id for existing tool
Nov 23 2017, 11:31 AM

Nov 21 2017

moranegg added inline comments to D266: enable metadata injection from loader core.
Nov 21 2017, 10:45 AM

Nov 20 2017

moranegg updated the diff for D265: enable metadata injection from deposit.
  • Change metadata provider and tool as additional config
  • Added tests for metadata injection
  • Refactor origin_metadata injection with prepare_metadata from loader-core
Nov 20 2017, 3:59 PM
moranegg retitled D265: enable metadata injection from deposit from Added metadata injection and url to client to enable metadata injection from deposit.
Nov 20 2017, 3:37 PM
moranegg retitled D266: enable metadata injection from loader core from Added metadata injection possible from loader core to enable metadata injection from loader core.
Nov 20 2017, 3:35 PM
moranegg added a revision to T837: add link to metadata documentation: D265: enable metadata injection from deposit.
Nov 20 2017, 2:38 PM · Metadata workflow, SWORD deposit
moranegg added a revision to T832: deposit metadata injection into origin_metadata: D265: enable metadata injection from deposit.
Nov 20 2017, 2:38 PM · Metadata workflow, SWORD deposit
moranegg added tasks to D265: enable metadata injection from deposit: T837: add link to metadata documentation, T832: deposit metadata injection into origin_metadata.
Nov 20 2017, 2:38 PM
moranegg updated the diff for D266: enable metadata injection from loader core.
  • Refactor for provider_id and tool_id resolution at loader level
Nov 20 2017, 2:32 PM
moranegg updated the diff for D266: enable metadata injection from loader core.
Nov 20 2017, 2:28 PM
moranegg added a comment to D266: enable metadata injection from loader core.

After some thoughts this weekend.
I agree that it is more logic to have a send_provider and a send_tool at the loader level if the tool or provider are not in storage.

Nov 20 2017, 10:51 AM

Nov 17 2017

moranegg added a comment to D266: enable metadata injection from loader core.

The question remains, is it the storage job or the other packages job to know that a certain provider has a certain id.
your solution [solA]- sending tool and provider as part of the prepare method is a good idea but
the resolution is made by the loader and not by the storage so it keeps the resolution in the loader's scope.

Nov 17 2017, 4:02 PM

Nov 16 2017

moranegg updated the diff for D266: enable metadata injection from loader core.
  • Refactor adding origin_metadata to the loaders
Nov 16 2017, 4:48 PM
moranegg updated the diff for D265: enable metadata injection from deposit.
  • Added tests for metadata injection
Nov 16 2017, 4:45 PM
moranegg added inline comments to D266: enable metadata injection from loader core.
Nov 16 2017, 11:14 AM

Nov 15 2017

moranegg edited P169 One year plan.
Nov 15 2017, 3:35 PM · Metadata workflow
moranegg edited P169 One year plan.
Nov 15 2017, 3:33 PM · Metadata workflow
moranegg edited P169 One year plan.
Nov 15 2017, 3:32 PM · Metadata workflow
moranegg renamed T734: Create strategy for extracting metadata from external-catalogs from external catalogs worth tracking to Create strategy for extracting metadata from external-catalogs.
Nov 15 2017, 2:51 PM · Metadata workflow
moranegg renamed T833: When listing an origin, add origin level metadata to RMD storage from Add origin_metadata injection to listers to When listing an origin, add origin level metadata to storage.
Nov 15 2017, 2:10 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg edited P169 One year plan.
Nov 15 2017, 2:06 PM · Metadata workflow
moranegg created T852: When loading a software artifact, add origin level metadata.
Nov 15 2017, 2:05 PM · Metadata workflow
moranegg closed T715: create indexing strategy for metadata as Resolved.
Nov 15 2017, 1:55 PM · Metadata workflow, Indexer

Nov 14 2017

moranegg updated the diff for D266: enable metadata injection from loader core.

Sorry about the mix-up, here it is again..

Nov 14 2017, 11:21 AM
moranegg added inline comments to D265: enable metadata injection from deposit.
Nov 14 2017, 11:16 AM
moranegg updated the diff for D265: enable metadata injection from deposit.
  • Change metadata provider and tool as additional config
Nov 14 2017, 11:13 AM
moranegg updated the diff for D265: enable metadata injection from deposit.
Nov 14 2017, 11:09 AM

Nov 13 2017

moranegg moved T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit from Backlog to Specifications on the Metadata workflow board.
Nov 13 2017, 5:03 PM · Metadata workflow, SWORD deposit
moranegg moved T832: deposit metadata injection into origin_metadata from Specifications to Implementation on the Metadata workflow board.
Nov 13 2017, 5:02 PM · Metadata workflow, SWORD deposit
moranegg updated the diff for D266: enable metadata injection from loader core.
  • Change metadata provider and tool as additional config
Nov 13 2017, 5:00 PM

Nov 10 2017

moranegg moved T733: add content_metadata logic to storage from Backlog to Documentation on the Metadata workflow board.
Nov 10 2017, 3:06 PM · Metadata workflow, Indexer
moranegg moved T832: deposit metadata injection into origin_metadata from Backlog to Specifications on the Metadata workflow board.
Nov 10 2017, 3:06 PM · Metadata workflow, SWORD deposit
moranegg moved T837: add link to metadata documentation from Backlog to Implementation on the Metadata workflow board.
Nov 10 2017, 3:05 PM · Metadata workflow, SWORD deposit
moranegg moved T715: create indexing strategy for metadata from Backlog to Documentation on the Metadata workflow board.
Nov 10 2017, 3:03 PM · Metadata workflow, Indexer
moranegg archived Metadata implementation.
Nov 10 2017, 3:03 PM
moranegg edited projects for T795: create origin_metadata_translation, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 3:01 PM · Metadata workflow
moranegg edited projects for T831: review all json schemas in storage for metadata objects (content_metadata, revision_metadata and origin_metadata), added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 3:01 PM · Metadata workflow, Indexer
moranegg edited projects for T833: When listing an origin, add origin level metadata to RMD storage, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 3:01 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg edited projects for T834: deploy revision_indexer (at least for codemeta.json), added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 3:01 PM · Indexer, Metadata workflow
moranegg edited projects for T837: add link to metadata documentation, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 2:59 PM · Metadata workflow, SWORD deposit
moranegg edited projects for T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 2:59 PM · Metadata workflow, SWORD deposit
moranegg edited projects for T733: add content_metadata logic to storage, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 2:58 PM · Metadata workflow, Indexer
moranegg edited projects for T715: create indexing strategy for metadata, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 2:57 PM · Metadata workflow, Indexer
moranegg edited projects for T832: deposit metadata injection into origin_metadata, added: Metadata workflow; removed Metadata implementation.
Nov 10 2017, 2:57 PM · Metadata workflow, SWORD deposit

Nov 9 2017

moranegg added a comment to D266: enable metadata injection from loader core.
In D266#5422, @olasd wrote:

I think metadata should be added after the data has been fetched (maybe in store_data()?), as it might not be available before.

ack but I'm keeping it in store_metadata()

The critical part of loading metadata is the storage calls, so that's really what should be implemented here, as send_origin_metadata / send_origin_visit_metadata functions that call the underlying storage methods.

Excellent remark
now store_metadata() is in the generic load and implemented in the sub class calling for send_origin_metadata() which is doing the actual exchanges with storage.

Nov 9 2017, 12:43 PM
moranegg updated the diff for D266: enable metadata injection from loader core.
  • Refactor adding origin_metadata to the loaders
Nov 9 2017, 12:40 PM

Nov 8 2017

moranegg moved T832: deposit metadata injection into origin_metadata from debugging to code review on the Metadata implementation board.
Nov 8 2017, 5:24 PM · Metadata workflow, SWORD deposit
moranegg moved T832: deposit metadata injection into origin_metadata from in progress to debugging on the Metadata implementation board.
Nov 8 2017, 5:24 PM · Metadata workflow, SWORD deposit
Herald added a reviewer for D266: enable metadata injection from loader core: Reviewers.
Nov 8 2017, 5:19 PM
moranegg created D265: enable metadata injection from deposit.
Nov 8 2017, 5:17 PM

Nov 6 2017

moranegg created T837: add link to metadata documentation.
Nov 6 2017, 2:39 PM · Metadata workflow, SWORD deposit
moranegg edited projects for T734: Create strategy for extracting metadata from external-catalogs, added: Metadata workflow; removed Metadata implementation.
Nov 6 2017, 12:25 PM · Metadata workflow
moranegg created T834: deploy revision_indexer (at least for codemeta.json).
Nov 6 2017, 12:23 PM · Indexer, Metadata workflow
moranegg moved T715: create indexing strategy for metadata from Backlog to Done (almost done) on the Metadata implementation board.
Nov 6 2017, 12:22 PM · Metadata workflow, Indexer
moranegg created T833: When listing an origin, add origin level metadata to RMD storage.
Nov 6 2017, 12:22 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg updated the task description for T734: Create strategy for extracting metadata from external-catalogs.
Nov 6 2017, 12:10 PM · Metadata workflow
moranegg moved T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit from Backlog to in progress on the Metadata implementation board.
Nov 6 2017, 12:07 PM · Metadata workflow, SWORD deposit
moranegg moved T832: deposit metadata injection into origin_metadata from Backlog to in progress on the Metadata implementation board.
Nov 6 2017, 12:07 PM · Metadata workflow, SWORD deposit
moranegg created T832: deposit metadata injection into origin_metadata.
Nov 6 2017, 12:07 PM · Metadata workflow, SWORD deposit
moranegg created T831: review all json schemas in storage for metadata objects (content_metadata, revision_metadata and origin_metadata).
Nov 6 2017, 11:46 AM · Metadata workflow, Indexer

Oct 24 2017

moranegg committed rDSTOd13751aeaa9a: Refactor entry points to origin_metadata table with get_by function (authored by moranegg).
Refactor entry points to origin_metadata table with get_by function
Oct 24 2017, 2:48 PM
moranegg committed rDSTO48fc6f750003: Refactor origin_metadata and adding provider table and logic (authored by moranegg).
Refactor origin_metadata and adding provider table and logic
Oct 24 2017, 2:48 PM
moranegg closed T737: create origin_metadata table as Resolved by committing rDSTO76c5326599f4: Create origin_metadata tables and logic.
Oct 24 2017, 2:48 PM · Metadata implementation
moranegg committed rDSTO76c5326599f4: Create origin_metadata tables and logic (authored by moranegg).
Create origin_metadata tables and logic
Oct 24 2017, 2:48 PM
moranegg committed rDSTO17882a93521e: test for origin_metadata add and get functions pass (authored by moranegg).
test for origin_metadata add and get functions pass
Oct 24 2017, 2:48 PM
moranegg committed rDSTO3b425af2ebbc: Create origin_metadata tables and logic (authored by moranegg).
Create origin_metadata tables and logic
Oct 24 2017, 2:48 PM
moranegg closed D254: Create origin_metadata tables and logic.
Oct 24 2017, 2:48 PM
moranegg updated the diff for D254: Create origin_metadata tables and logic.
  • Refactor entry points to origin_metadata table with get_by function
Oct 24 2017, 2:30 PM