Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 3 2018

moranegg added a parent task for T1228: Create a component that sends a list of revision sha1 to the metadataRevisionIndexer: T1232: Search over intrinsic metadata associated to an origin.
Oct 3 2018, 3:56 PM · Indexer, Metadata workflow
moranegg added a subtask for T1232: Search over intrinsic metadata associated to an origin: T1228: Create a component that sends a list of revision sha1 to the metadataRevisionIndexer.
Oct 3 2018, 3:56 PM · Metadata workflow
moranegg added a subtask for T1236: Refactor metadata translator to parse different types of files: T1237: Update mappings to CodeMeta crosswalk table .
Oct 3 2018, 3:55 PM · Metadata workflow, Indexer
moranegg added a parent task for T1237: Update mappings to CodeMeta crosswalk table : T1236: Refactor metadata translator to parse different types of files.
Oct 3 2018, 3:55 PM · Metadata workflow, Indexer
moranegg triaged T1237: Update mappings to CodeMeta crosswalk table as Normal priority.
Oct 3 2018, 3:53 PM · Metadata workflow, Indexer
moranegg created T1237: Update mappings to CodeMeta crosswalk table .
Oct 3 2018, 3:53 PM · Metadata workflow, Indexer
moranegg added a parent task for T1236: Refactor metadata translator to parse different types of files: T1235: Refactor metadata detector tool to add easily new file names to detect.
Oct 3 2018, 3:48 PM · Metadata workflow, Indexer
moranegg added a subtask for T1235: Refactor metadata detector tool to add easily new file names to detect: T1236: Refactor metadata translator to parse different types of files.
Oct 3 2018, 3:48 PM · Metadata workflow, Indexer
moranegg triaged T1236: Refactor metadata translator to parse different types of files as Normal priority.
Oct 3 2018, 3:47 PM · Metadata workflow, Indexer
moranegg added a subtask for T1232: Search over intrinsic metadata associated to an origin: T1235: Refactor metadata detector tool to add easily new file names to detect.
Oct 3 2018, 3:43 PM · Metadata workflow
moranegg added a parent task for T1235: Refactor metadata detector tool to add easily new file names to detect: T1232: Search over intrinsic metadata associated to an origin.
Oct 3 2018, 3:43 PM · Metadata workflow, Indexer
moranegg triaged T1235: Refactor metadata detector tool to add easily new file names to detect as Normal priority.
Oct 3 2018, 3:42 PM · Metadata workflow, Indexer
moranegg added a parent task for T1231: Create an origin indexer that lists the most recent revision in HEAD branch: T1232: Search over intrinsic metadata associated to an origin.
Oct 3 2018, 3:20 PM · Indexer, Metadata workflow
moranegg added a subtask for T1232: Search over intrinsic metadata associated to an origin: T1231: Create an origin indexer that lists the most recent revision in HEAD branch.
Oct 3 2018, 3:20 PM · Metadata workflow
moranegg triaged T1232: Search over intrinsic metadata associated to an origin as Normal priority.
Oct 3 2018, 3:20 PM · Metadata workflow
moranegg triaged T1231: Create an origin indexer that lists the most recent revision in HEAD branch as Normal priority.
Oct 3 2018, 3:07 PM · Indexer, Metadata workflow
moranegg triaged T1228: Create a component that sends a list of revision sha1 to the metadataRevisionIndexer as Normal priority.
Oct 3 2018, 12:03 PM · Indexer, Metadata workflow

Oct 2 2018

moranegg triaged T1226: Save code now email notification for submitter as Wishlist priority.
Oct 2 2018, 2:45 PM · Save Code Now, Web app
moranegg triaged T1223: identifiers.org URL resolution should support swh:id contextual parameters as Low priority.
Oct 2 2018, 12:19 PM · Metadata workflow

Oct 1 2018

moranegg changed the status of T833: When listing an origin, add origin level metadata to RMD storage from Work in Progress to Open.
Oct 1 2018, 3:05 PM · Extrinsic metadata, Restricted Project, GitHub lister
moranegg changed the status of T833: When listing an origin, add origin level metadata to RMD storage, a subtask of T1102: Handle all GitHub elements, from Work in Progress to Open.
Oct 1 2018, 3:05 PM · meta-task, General
moranegg closed T1020: Cook all resulting directories from query, a subtask of T1019: Prepare Crossminer dataset, as Resolved.
Oct 1 2018, 1:46 PM · Metadata workflow
moranegg closed T1020: Cook all resulting directories from query as Resolved.
Oct 1 2018, 1:46 PM · Metadata workflow
moranegg committed rDDEP50999a50c89a: docs: update with comments in T914 (authored by moranegg).
docs: update with comments in T914
Oct 1 2018, 12:11 PM

Sep 28 2018

moranegg triaged T1215: Crossminer: investigate CrossSim tool to tag software projects as Low priority.
Sep 28 2018, 10:58 AM · Metadata workflow

Sep 21 2018

moranegg added a comment to T1191: Vault: reschedule failed tasks after a manual/non-manual resolution.

Now with a new session I can relaunch a failed directory, but in an old session it keeps the error in the vault table view.

Sep 21 2018, 2:57 PM · Vault
moranegg renamed T1205: Web-app: Improve position of "Logged-in as..." from Web-app: "Log" text in corner right to Web-app: Improve position of "Logged-in as..." .
Sep 21 2018, 2:51 PM · Web app
moranegg added a comment to T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories .

I just had two vault successes:

  • d83b7dda887dc790f7207608474650d4344b8df9
  • cf31343fd5744d56d7126b6cb99e96d29f5c0376
Sep 21 2018, 2:49 PM · Vault
moranegg triaged T1205: Web-app: Improve position of "Logged-in as..." as Normal priority.
Sep 21 2018, 2:45 PM · Web app

Sep 20 2018

moranegg added a comment to T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories .

Now this returned with internal server error: fb13b51abbcfd13de85d9ba8d070a23679576cd7
and this one is done: 4a2875f69e68bb60a9e76414439c073fd2b20732

Sep 20 2018, 9:51 AM · Vault

Sep 19 2018

moranegg committed rMSLDbdb16ad69fe2: Create presentation for moderation day (authored by moranegg).
Create presentation for moderation day
Sep 19 2018, 5:06 PM
moranegg assigned T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories to seirl.
Sep 19 2018, 1:55 PM · Vault
moranegg added a comment to T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories .

For the new error where download stays at "new" for a long time, here are my 2 tests:
4a2875f69e68bb60a9e76414439c073fd2b20732
fb13b51abbcfd13de85d9ba8d070a23679576cd7

Sep 19 2018, 1:55 PM · Vault

Sep 14 2018

moranegg added a comment to T1020: Cook all resulting directories from query.

The query is done and cooked with 10% failed/unstarted directories.
Waiting for Crossminer's analysis to see if we need to relaunch the remaining 10%.

Sep 14 2018, 10:24 AM · Metadata workflow

Sep 12 2018

moranegg triaged T1191: Vault: reschedule failed tasks after a manual/non-manual resolution as Normal priority.
Sep 12 2018, 4:33 PM · Vault
moranegg added a comment to T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories .

Directories I tried and failed:

  • b1ed8c3c380b35c0a6546a04e526259d600c7a31
  • 8fd378d35eb2c80a24d5a29e66b994ed2a275592
Sep 12 2018, 4:05 PM · Vault
moranegg renamed T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories from bug report: Vault returns "Internal Server Error. This incident will be reported." for small directories (all I tried) to bug report: Vault returns "Internal Server Error. This incident will be reported." for directories .
Sep 12 2018, 4:01 PM · Vault
moranegg triaged T1190: bug report: Vault returns "Internal Server Error. This incident will be reported." for directories as High priority.
Sep 12 2018, 3:56 PM · Vault

Sep 10 2018

moranegg added a comment to T1186: Web-app: save code now accepts url of users for github and fails.

For the same reason as above I don't think the error message should be sophisticated and try to tell the user to enter a repo URL instead. It should just say something like "no repo to clone there". Users will figure out what they need to do.
(And we can have some example doc on the wiki, about how to "save code now" for common forges, if really needed.)

I agree it shouldn't be elaborated, a global rejection error with a link to the user documentation of how to use the "save code now" feature is sufficient.

Sep 10 2018, 5:22 PM · Web app
moranegg triaged T1186: Web-app: save code now accepts url of users for github and fails as Low priority.
Sep 10 2018, 4:59 PM · Web app
moranegg triaged T1185: Web-app: change wording of title for save code now feature as Low priority.
Sep 10 2018, 4:51 PM · Web app

Sep 3 2018

moranegg added a comment to T1171: Modify deposit workflow to check duplicated POST requests .

A possible problem to check with this workflow:

hal-prod and hal-preprod uses the same identifiers for different objects
Sep 3 2018, 4:44 PM · SWORD deposit (2018-09-25-HAL-opening)

Aug 29 2018

moranegg updated the task description for T1009: Create email notifications for deposit errors.
Aug 29 2018, 4:21 PM · Metrics/monitoring, SWORD deposit
moranegg triaged T1172: Create garbage collector for old deposits that are rejected/partial/failed as Normal priority.
Aug 29 2018, 4:15 PM · SWORD deposit
moranegg triaged T1171: Modify deposit workflow to check duplicated POST requests as Normal priority.
Aug 29 2018, 4:08 PM · SWORD deposit (2018-09-25-HAL-opening)

Aug 28 2018

moranegg committed rDDEPdf8ade16af39: docs: minor language modifications (authored by moranegg).
docs: minor language modifications
Aug 28 2018, 3:06 PM
moranegg changed the status of T992: Create a REST api entry point to easily access one or more deposits with a user-friendly interface, a subtask of T1011: Enable continuous monitoring of deposit, from Work in Progress to Open.
Aug 28 2018, 2:22 PM · Metrics/monitoring, SWORD deposit
moranegg changed the status of T992: Create a REST api entry point to easily access one or more deposits with a user-friendly interface from Work in Progress to Open.
Aug 28 2018, 2:22 PM · SWORD deposit
moranegg added a subtask for T1170: Add deposit-admin tab to the admin interface: T1169: Add entry point to return list of deposits for the admin interface.
Aug 28 2018, 12:00 PM · Web app, SWORD deposit
moranegg added a parent task for T1169: Add entry point to return list of deposits for the admin interface: T1170: Add deposit-admin tab to the admin interface.
Aug 28 2018, 12:00 PM · SWORD deposit
moranegg triaged T1170: Add deposit-admin tab to the admin interface as Normal priority.
Aug 28 2018, 12:00 PM · Web app, SWORD deposit
moranegg triaged T1169: Add entry point to return list of deposits for the admin interface as Normal priority.
Aug 28 2018, 11:48 AM · SWORD deposit

Jul 24 2018

moranegg added a comment to D400: Fix metadata reading when a deposit is a multiple metadata requests instance.

https://forge.softwareheritage.org/P285 (for my local tests)

Jul 24 2018, 2:04 PM
moranegg accepted D400: Fix metadata reading when a deposit is a multiple metadata requests instance.
Jul 24 2018, 2:04 PM
moranegg created P285 D400 added tests.
Jul 24 2018, 2:03 PM
moranegg added a comment to P284 D400 output-text.

make test 2>&1 | tee output-test

Jul 24 2018, 1:44 PM
moranegg created P284 D400 output-text.
Jul 24 2018, 1:43 PM
moranegg created P283 D400 errors.
Jul 24 2018, 1:41 PM
moranegg added a comment to T960: draft specs for deposit with incomplete tarball .

It is not yet deployed on the docs web pages, but I'll put a link here when it is.
Also I'm planing some modifications on the swh xml schema for the swh-id properties (mentioned in T1152).

Jul 24 2018, 10:52 AM · SWORD deposit, Directory loader

Jul 23 2018

moranegg updated the task description for T992: Create a REST api entry point to easily access one or more deposits with a user-friendly interface.
Jul 23 2018, 6:00 PM · SWORD deposit
moranegg added a comment to T992: Create a REST api entry point to easily access one or more deposits with a user-friendly interface.

After the deposit workshop and the last errors we had with HAL, I believe this entry point has to be without any deposit_id or external_id.

Jul 23 2018, 5:50 PM · SWORD deposit
moranegg closed T960: draft specs for deposit with incomplete tarball as Resolved.
Jul 23 2018, 4:36 PM · SWORD deposit, Directory loader
moranegg closed T960: draft specs for deposit with incomplete tarball , a subtask of T855: support directory entries pointing to revisions when loading directories, as Resolved.
Jul 23 2018, 4:36 PM · Directory loader
moranegg closed T960: draft specs for deposit with incomplete tarball , a subtask of T1021: SWORD deposit of metadata about an existing SWH object, as Resolved.
Jul 23 2018, 4:36 PM · Core Loader, SWORD deposit
moranegg committed rDDEP912420612f3d: Update sparse-deposit and metadata-deposit specs (authored by moranegg).
Update sparse-deposit and metadata-deposit specs
Jul 23 2018, 4:27 PM
moranegg committed rDDEP285a8ab37cd0: Update sparse/metadata deposit specs (authored by moranegg).
Update sparse/metadata deposit specs
Jul 23 2018, 4:27 PM
moranegg committed rDDEPf96c11ce3c23: docs: Update specs for the sparse-deposit and meta-deposit (authored by moranegg).
docs: Update specs for the sparse-deposit and meta-deposit
Jul 23 2018, 4:27 PM
moranegg committed rDDEP5f99d69285ad: docs: update example meta-deposit (authored by moranegg).
docs: update example meta-deposit
Jul 23 2018, 4:27 PM
moranegg committed rDDEPb822bfb13cb3: docs: Add swh xml schema for sparse and meta deposits (authored by moranegg).
docs: Add swh xml schema for sparse and meta deposits
Jul 23 2018, 4:27 PM
moranegg closed D329: Create specs for sparse-deposit and metadata-deposit.
Jul 23 2018, 4:27 PM
moranegg updated the diff for D329: Create specs for sparse-deposit and metadata-deposit.
  • docs: Update specs for the sparse-deposit and meta-deposit
  • docs: Add swh xml schema for sparse and meta deposits
  • docs: update example meta-deposit
  • Update sparse-deposit and metadata-deposit specs
  • Update sparse/metadata deposit specs
Jul 23 2018, 4:26 PM
moranegg created P282 Je-suis-gpl metadata.
Jul 23 2018, 2:03 PM · SWORD deposit
moranegg accepted D399: deposit/loader: Add missing origin_url transmission step.
Jul 23 2018, 1:37 PM
moranegg accepted D397: swh.deposit.client: Simplify client xml parsing.
Jul 23 2018, 11:38 AM
moranegg accepted D394: swh.deposit.models: Keep deposit request's raw metadata.
Jul 23 2018, 11:28 AM

Jul 19 2018

moranegg added a comment to T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information.

Just to be clear about this:

  1. the property swh-id returned to the client is the directory, with or without context?
  2. How should we call the new property added for the revision ID ?
  3. And will it be a revision ID with or without context?
Jul 19 2018, 2:40 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg added a comment to T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information.

Just adding another piece to the rational puzzle:
The software citation

Jul 19 2018, 12:06 PM · SWORD deposit (2018-09-25-HAL-opening)

Jul 18 2018

moranegg triaged T1152: deposit of tarball/zip: return as main swh-id the directory id, add the synthetic revision id as ancillary information as Normal priority.
Jul 18 2018, 5:57 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg added a comment to T912: integration with HAL for SWORD-based deposit (meta task).

I'm adding this meta-task to the grand HAL-opening thinking it can (and should) be resolved after accomplishing this milestone.

Jul 18 2018, 3:09 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg edited projects for T912: integration with HAL for SWORD-based deposit (meta task), added: SWORD deposit (2018-09-25-HAL-opening); removed SWORD deposit.
Jul 18 2018, 2:52 PM · SWORD deposit (2018-09-25-HAL-opening)
moranegg edited projects for T1009: Create email notifications for deposit errors, added: SWORD deposit (2018-09-25-HAL-opening); removed SWORD deposit.
Jul 18 2018, 2:52 PM · Metrics/monitoring, SWORD deposit
moranegg moved T960: draft specs for deposit with incomplete tarball from High priority to In code review on the SWORD deposit board.
Jul 18 2018, 2:50 PM · SWORD deposit, Directory loader
moranegg created SWORD deposit (2018-09-25-HAL-opening).
Jul 18 2018, 12:37 PM

Jul 17 2018

moranegg accepted D380: Reject deposit containing a single archive.
Jul 17 2018, 2:15 PM
moranegg added a comment to D380: Reject deposit containing a single archive.

Looks good to me.
All tests pass...

Jul 17 2018, 2:15 PM
moranegg accepted D380: Reject deposit containing a single archive.
Jul 17 2018, 2:15 PM
moranegg created P281 Arc patch D380 resulting in an error.
Jul 17 2018, 2:15 PM
moranegg accepted D381: Refactor common reading behavior between deposit read and check.
Jul 17 2018, 2:15 PM
moranegg added a comment to D380: Reject deposit containing a single archive.

My only comment would be to better document the possible archive errors that appear in the test,
if there are 4 types of errors -> missing / unreadable / unsupported / invalid, it will be easier to understand where they are captured if documented.

Jul 17 2018, 2:15 PM

Jul 10 2018

moranegg accepted D378: deposit_check: Improve details in failing checks.
Jul 10 2018, 8:55 AM
moranegg added a comment to D378: deposit_check: Improve details in failing checks.

No worries, I'm good with the changes.
Also all tests pass on my machine.
When are you deploying?

Jul 10 2018, 8:54 AM

Jul 9 2018

moranegg added a comment to D378: deposit_check: Improve details in failing checks.

This looks good ! are the error messages returned to the client as is?

Jul 9 2018, 5:38 PM
moranegg committed rMSLDc7c5096a4fc0: Add slide about source code and reproducibility and small updates (authored by moranegg).
Add slide about source code and reproducibility and small updates
Jul 9 2018, 4:05 PM

Jul 6 2018

moranegg accepted D353: swh.deposit.parsers: Do not lose information during parsing.
Jul 6 2018, 3:00 PM · SWORD deposit
moranegg added inline comments to D353: swh.deposit.parsers: Do not lose information during parsing.
Jul 6 2018, 12:09 PM · SWORD deposit

Jul 5 2018

moranegg changed the status of T1131: Fix the deposit XML parser to have multiple authors in json output from Open to Work in Progress.
Jul 5 2018, 4:06 PM · SWORD deposit
moranegg created T1131: Fix the deposit XML parser to have multiple authors in json output.
Jul 5 2018, 4:06 PM · SWORD deposit
moranegg added a comment to T1130: Create an elegant error when content found in DB but not in objstorage.

I will take the improvement of the error message :-)

Jul 5 2018, 12:20 PM · Web app
moranegg updated the diff for D329: Create specs for sparse-deposit and metadata-deposit.
  • Update sparse/metadata deposit specs
Jul 5 2018, 11:43 AM
moranegg added inline comments to D329: Create specs for sparse-deposit and metadata-deposit.
Jul 5 2018, 11:32 AM