Page MenuHomeSoftware Heritage
Feed Advanced Search

Jul 13 2017

moranegg committed rDSTOaf4d3da6c6cf: Merge branch 'content_metadata_logic' (authored by moranegg).
Merge branch 'content_metadata_logic'
Jul 13 2017, 11:55 AM
moranegg committed rDSTObb17076fa080: Refactor to keep only content_metadata logic (authored by moranegg).
Refactor to keep only content_metadata logic
Jul 13 2017, 11:55 AM
moranegg committed rDSTO8465e7b92751: Added content_metadata logic to the storage (authored by moranegg).
Added content_metadata logic to the storage
Jul 13 2017, 11:55 AM
moranegg closed D219: Added content_metadata logic to the storage by committing rDSTO8465e7b92751: Added content_metadata logic to the storage.
Jul 13 2017, 11:55 AM · Metadata implementation
moranegg updated the diff for D219: Added content_metadata logic to the storage.

Merge

Jul 13 2017, 11:55 AM · Metadata implementation

Jul 12 2017

moranegg edited P168 Working on origin_metadata, external_metadata and revision_metadata tables.
Jul 12 2017, 4:28 PM · Metadata implementation
moranegg updated the title for P168 Working on origin_metadata, external_metadata and revision_metadata tables from Working on origin_metadata tabe to Working on origin_metadata, external_metadata and revision_metadata tables.
Jul 12 2017, 11:40 AM · Metadata implementation
moranegg added a comment to D220: Added specifications to README.

I think we should keep it as a diff here at least a couple more days to have comments on it, so I'm not pushing it for now (unless you tell me to ;-D)

Jul 12 2017, 10:41 AM
moranegg committed rDCIDX6880d8e39b83: Changed tool name to 'swh-metadata-translator' (authored by moranegg).
Changed tool name to 'swh-metadata-translator'
Jul 12 2017, 10:39 AM
moranegg closed D221: Changed tool name to 'swh-metadata-translator' by committing rDCIDX6880d8e39b83: Changed tool name to 'swh-metadata-translator'.
Jul 12 2017, 10:39 AM
moranegg added inline comments to D219: Added content_metadata logic to the storage.
Jul 12 2017, 10:34 AM · Metadata implementation
moranegg updated the diff for D219: Added content_metadata logic to the storage.

Updating D219: Added content_metadata logic to the storage

Jul 12 2017, 10:34 AM · Metadata implementation

Jul 11 2017

moranegg added a comment to P168 Working on origin_metadata, external_metadata and revision_metadata tables.

For the discussion tomorrow about the entity table vs origin_metadata table.
I also added a draft for the external_metadata table to have it in mind as well.

Jul 11 2017, 12:01 PM · Metadata implementation
moranegg created P168 Working on origin_metadata, external_metadata and revision_metadata tables.
Jul 11 2017, 11:59 AM · Metadata implementation
moranegg updated the diff for D221: Changed tool name to 'swh-metadata-translator'.

Updating D221: Changed tool name to 'swh-metadata-translator'
just changed a typo where i kept a comment for nothing

Jul 11 2017, 11:50 AM
moranegg added inline comments to D219: Added content_metadata logic to the storage.
Jul 11 2017, 11:30 AM · Metadata implementation
moranegg updated the diff for D219: Added content_metadata logic to the storage.

update D219 to keep only content_metadata modifications

Jul 11 2017, 11:30 AM · Metadata implementation

Jul 10 2017

moranegg moved T734: Create strategy for extracting metadata from external-catalogs from external catalogs to Backlog on the Metadata implementation board.
Jul 10 2017, 1:48 PM · Metadata workflow
moranegg updated the task description for T715: create indexing strategy for metadata.
Jul 10 2017, 1:47 PM · Metadata workflow, Indexer

Jul 7 2017

moranegg created D221: Changed tool name to 'swh-metadata-translator'.
Jul 7 2017, 4:34 PM
moranegg moved T733: add content_metadata logic to storage from in progress to Done (almost done) on the Metadata implementation board.
Jul 7 2017, 3:52 PM · Metadata workflow, Indexer
moranegg updated the summary of D219: Added content_metadata logic to the storage.
Jul 7 2017, 3:39 PM · Metadata implementation
moranegg updated the task description for T733: add content_metadata logic to storage.
Jul 7 2017, 3:36 PM · Metadata workflow, Indexer
moranegg updated the diff for D219: Added content_metadata logic to the storage.

Updating D219: Added content_metadata logic to the storage with tests

Jul 7 2017, 3:34 PM · Metadata implementation

Jul 6 2017

moranegg updated the task description for T733: add content_metadata logic to storage.
Jul 6 2017, 4:15 PM · Metadata workflow, Indexer

Jun 29 2017

moranegg edited reviewers for D220: Added specifications to README, added: Reviewers; removed: ardumont.
Jun 29 2017, 4:02 PM
moranegg added a comment to D220: Added specifications to README.

we should open the discussion for HAL & SWORD on this diff and keep it open for comments.

Jun 29 2017, 3:57 PM
moranegg created D220: Added specifications to README.
Jun 29 2017, 3:54 PM
moranegg updated the summary of D219: Added content_metadata logic to the storage.
Jun 29 2017, 3:11 PM · Metadata implementation
moranegg retitled D219: Added content_metadata logic to the storage from Added tables content_metadata, origin_metadata and origin_metadata_history to db schema to Added content_metadata logic to the storage.
Jun 29 2017, 3:08 PM · Metadata implementation
moranegg updated the diff for D219: Added content_metadata logic to the storage.

Added content_metadata logic to the storage

Jun 29 2017, 3:06 PM · Metadata implementation
moranegg added a revision to T733: add content_metadata logic to storage: D219: Added content_metadata logic to the storage.
Jun 29 2017, 3:06 PM · Metadata workflow, Indexer
moranegg updated the task description for T733: add content_metadata logic to storage.
Jun 29 2017, 12:10 PM · Metadata workflow, Indexer
moranegg updated the task description for T733: add content_metadata logic to storage.
Jun 29 2017, 11:50 AM · Metadata workflow, Indexer
moranegg updated the diff for D218: Added specifications to README.

Updating D218: Added specifications to README
and deleting docs/specs.md

Jun 29 2017, 10:45 AM

Jun 28 2017

moranegg updated the diff for D215: First draft of the metadata content indexer for npm (package.json) T715.

Updating D215: First draft of the metadata content indexer for npm (package.json) T715

Jun 28 2017, 2:28 PM · Metadata implementation

Jun 27 2017

moranegg added a comment to D218: Added specifications to README.

The "problem" with specs.md is that phabricator doesn't make it look pretty and the image for example won't be added to the view.

Jun 27 2017, 4:36 PM
moranegg created D219: Added content_metadata logic to the storage.
Jun 27 2017, 4:24 PM · Metadata implementation
moranegg updated the task description for T734: Create strategy for extracting metadata from external-catalogs.
Jun 27 2017, 3:17 PM · Metadata workflow
moranegg created T734: Create strategy for extracting metadata from external-catalogs.
Jun 27 2017, 3:16 PM · Metadata workflow
moranegg moved T733: add content_metadata logic to storage from Backlog to in progress on the Metadata implementation board.
Jun 27 2017, 3:14 PM · Metadata workflow, Indexer
moranegg updated the task description for T733: add content_metadata logic to storage.
Jun 27 2017, 2:21 PM · Metadata workflow, Indexer
moranegg updated the diff for D215: First draft of the metadata content indexer for npm (package.json) T715.

Updating D215: First draft of the metadata content indexer for npm (package.json) T715

Jun 27 2017, 2:00 PM · Metadata implementation
moranegg added inline comments to D215: First draft of the metadata content indexer for npm (package.json) T715.
Jun 27 2017, 1:56 PM · Metadata implementation
moranegg created T733: add content_metadata logic to storage.
Jun 27 2017, 12:21 PM · Metadata workflow, Indexer
moranegg updated the diff for D215: First draft of the metadata content indexer for npm (package.json) T715.

Updating D215: First draft of the metadata content indexer for npm (package.json) T715

Jun 27 2017, 12:12 PM · Metadata implementation

Jun 26 2017

moranegg created D218: Added specifications to README.
Jun 26 2017, 10:46 AM
moranegg added inline comments to D215: First draft of the metadata content indexer for npm (package.json) T715.
Jun 26 2017, 10:19 AM · Metadata implementation

Jun 23 2017

moranegg updated the diff for D215: First draft of the metadata content indexer for npm (package.json) T715.

Refactor metadata dictionary

Jun 23 2017, 6:43 PM · Metadata implementation
moranegg updated the diff for D215: First draft of the metadata content indexer for npm (package.json) T715.

Refactor metadata_dictionary and other edits

Jun 23 2017, 6:43 PM · Metadata implementation

Jun 22 2017

moranegg added inline comments to D215: First draft of the metadata content indexer for npm (package.json) T715.
Jun 22 2017, 1:48 PM · Metadata implementation

Jun 21 2017

moranegg added inline comments to D215: First draft of the metadata content indexer for npm (package.json) T715.
Jun 21 2017, 4:56 PM · Metadata implementation
moranegg closed T729: Database querying on README pattern as Resolved.
Jun 21 2017, 1:56 PM · Metadata workflow
moranegg added a comment to T729: Database querying on README pattern.

query was canceled due to "mental overload" on uffizi
closing task till further instructions

Jun 21 2017, 1:56 PM · Metadata workflow

Jun 20 2017

moranegg added a comment to T718: SWORD deposit: backend server.

We can embed image for sequence chart in readme with #F2403754 reference

Jun 20 2017, 5:15 PM · SWORD deposit

Jun 16 2017

moranegg added a task to D215: First draft of the metadata content indexer for npm (package.json) T715: T715: create indexing strategy for metadata.
Jun 16 2017, 5:27 PM · Metadata implementation
moranegg added a revision to T715: create indexing strategy for metadata: D215: First draft of the metadata content indexer for npm (package.json) T715.
Jun 16 2017, 5:27 PM · Metadata workflow, Indexer
moranegg updated the task description for T715: create indexing strategy for metadata.
Jun 16 2017, 5:26 PM · Metadata workflow, Indexer
moranegg retitled D215: First draft of the metadata content indexer for npm (package.json) T715 from First draft of the metadata content indexer for npm (package.json) to First draft of the metadata content indexer for npm (package.json) T715.
Jun 16 2017, 5:24 PM · Metadata implementation
moranegg added a reviewer for D215: First draft of the metadata content indexer for npm (package.json) T715: ardumont.
Jun 16 2017, 5:22 PM · Metadata implementation
moranegg created D215: First draft of the metadata content indexer for npm (package.json) T715.
Jun 16 2017, 5:22 PM · Metadata implementation

Jun 13 2017

moranegg added a comment to D210: Added tests for language indexer (T722).
In D210#4305, @ardumont wrote:

Ok. You could have done only one test with as input the list of the 2 sha1s - one with the c snippet, one with python ;)

Jun 13 2017, 6:26 PM
moranegg created D210: Added tests for language indexer (T722).
Jun 13 2017, 5:13 PM
moranegg created T731: Find tools to parse/translate metadata.
Jun 13 2017, 1:50 PM · Metadata implementation, Indexer

Jun 9 2017

moranegg added a comment to T729: Database querying on README pattern.

Launched query on 9.6 at 14.45, see P165

Jun 9 2017, 2:50 PM · Metadata workflow
moranegg added a comment to P165 sha1-of-files-at-root-named-README-multiple-ext.sql.

The query is available @uffizi:/srv/storage/space/lists/sha1-of-files-at-root-named-README-multiple-ext.sql
Temporary files are available@prado:/srv/softwareheritage/postgres/export/:

  • the cost of the query : explain-sha1-of-files-at-root-named-README.txt
  • sql query : sha1-of-files-at-root-named-README-multiple-ext.sql
  • result when available: sha1-of-files-at-root-named-README-multiple-ext.txt
Jun 9 2017, 2:48 PM · Metadata workflow
moranegg created P165 sha1-of-files-at-root-named-README-multiple-ext.sql.
Jun 9 2017, 2:40 PM · Metadata workflow

Jun 8 2017

moranegg moved T715: create indexing strategy for metadata from Backlog to in progress on the Metadata implementation board.
Jun 8 2017, 2:17 PM · Metadata workflow, Indexer
moranegg moved T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit from Backlog to code review on the Metadata implementation board.
Jun 8 2017, 2:17 PM · Metadata workflow, SWORD deposit
moranegg added a project to T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit: Metadata implementation.
Jun 8 2017, 2:13 PM · Metadata workflow, SWORD deposit
moranegg added a project to T715: create indexing strategy for metadata: Metadata implementation.
Jun 8 2017, 2:12 PM · Metadata workflow, Indexer
moranegg renamed Metadata workflow from Metadata crawling to Metadata workflow.
Jun 8 2017, 2:09 PM
moranegg created Metadata implementation.
Jun 8 2017, 2:04 PM
moranegg moved T729: Database querying on README pattern from Backlog to Crosswalks and mappings on the Metadata workflow board.
Jun 8 2017, 2:01 PM · Metadata workflow
moranegg created T729: Database querying on README pattern.
Jun 8 2017, 2:01 PM · Metadata workflow
moranegg created Metadata workflow.
Jun 8 2017, 12:42 PM

May 17 2017

moranegg updated the task description for T715: create indexing strategy for metadata.
May 17 2017, 4:43 PM · Metadata workflow, Indexer
moranegg updated the task description for T715: create indexing strategy for metadata.
May 17 2017, 4:43 PM · Metadata workflow, Indexer

May 16 2017

moranegg added a watcher for Indexer: moranegg.
May 16 2017, 1:55 PM

May 12 2017

moranegg lowered the priority of T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit from High to Normal.
May 12 2017, 12:00 PM · Metadata workflow, SWORD deposit
moranegg created T717: HAL metadata integration: implement and verify metadata deposit and storage for deposit.
May 12 2017, 9:46 AM · Metadata workflow, SWORD deposit

May 11 2017

moranegg updated the task description for T715: create indexing strategy for metadata.
May 11 2017, 5:09 PM · Metadata workflow, Indexer
moranegg updated the task description for T715: create indexing strategy for metadata.
May 11 2017, 4:27 PM · Metadata workflow, Indexer
moranegg created T715: create indexing strategy for metadata.
May 11 2017, 4:25 PM · Metadata workflow, Indexer

May 4 2017

moranegg added a comment to T714: Visits for the GNU injection don't contain all the occurrences..

So with the API can we access directly version 1.3.12? aka object_id: 2994581

May 4 2017, 1:51 PM · Archive content

Apr 21 2017

moranegg added a comment to P154 example: filtering origin on latest top file name matching pom.xml.

other files to add to list

Java gradle'gradle.properties'
Jekyll'_config.yml'
Apr 21 2017, 2:53 PM

Apr 20 2017

moranegg added a comment to P154 example: filtering origin on latest top file name matching pom.xml.
WHERE def.name IN (list of filenames matching metadata pattern)

List of filenames:

Apr 20 2017, 1:35 PM

Apr 19 2017

moranegg added a comment to P154 example: filtering origin on latest top file name matching pom.xml.

Using ardumont's query with:

select o.url, convert_from(def.name, 'utf-8') , def.sha1
Apr 19 2017, 11:40 AM

Feb 14 2017

moranegg closed T681: intern onbording -Morane as Resolved.
Feb 14 2017, 3:00 PM
moranegg created T681: intern onbording -Morane.
Feb 14 2017, 2:54 PM