Page MenuHomeSoftware Heritage
Feed Advanced Search

Jul 19 2022

ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jul 19 2022, 11:25 AM · System administration, Indexer, Metadata workflow
ardumont added a comment to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
  • Stop journal client [1] (export of offset needs the topics to be inactive [1'])
  • Keep current offset dump just in case [2]
  • Reset topics to earliest
  • Restart journal client
Jul 19 2022, 11:23 AM · System administration, Indexer, Metadata workflow
vlorentz updated the task description for T4273: Rewrite indexers as journal clients when relevant.
Jul 19 2022, 11:04 AM · Indexer, Metadata workflow
ardumont updated the task description for T4273: Rewrite indexers as journal clients when relevant.
Jul 19 2022, 10:57 AM · Indexer, Metadata workflow
vlorentz added a comment to T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.

we should also keep track of F3 (Friendly Forge Format): https://forum.forgefriends.org/t/about-the-friendly-forge-format-f3/681

Jul 19 2022, 8:37 AM · Archive search, Metadata workflow

Jul 18 2022

ardumont renamed T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from staging: Deploy new origin intrinsic metadata journal client indexer > v1.1 to Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jul 18 2022, 6:35 PM · System administration, Indexer, Metadata workflow
ardumont changed the status of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1, a subtask of T4273: Rewrite indexers as journal clients when relevant, from Open to Work in Progress.
Jul 18 2022, 6:23 PM · Indexer, Metadata workflow
ardumont changed the status of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from Open to Work in Progress.
Jul 18 2022, 6:23 PM · System administration, Indexer, Metadata workflow
ardumont changed the status of T4395: Migrate azure worker vms to cheaper and more efficient vms, a subtask of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1, from Open to Work in Progress.
Jul 18 2022, 6:23 PM · System administration, Indexer, Metadata workflow
ardumont added a subtask for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1: T4395: Migrate azure worker vms to cheaper and more efficient vms.
Jul 18 2022, 11:21 AM · System administration, Indexer, Metadata workflow

Jul 17 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jul 17 2022, 12:26 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jul 17 2022, 12:26 PM · Archive search, Metadata workflow

Jul 12 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jul 12 2022, 2:42 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4354: Contribute terms to ForgeFed.
Jul 12 2022, 2:41 PM · Archive search, Metadata workflow

Jul 11 2022

ardumont moved T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from Backlog to Weekly backlog on the System administration board.
Jul 11 2022, 2:21 PM · System administration, Indexer, Metadata workflow

Jul 5 2022

ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jul 5 2022, 4:55 PM · System administration, Indexer, Metadata workflow
vlorentz lowered the priority of T4277: Deal with null characters in the output of the metadata indexer from Normal to Low.

lowering priority, as it is still possible for the crash to happen, but D7992 solves the only known source

Jul 5 2022, 4:51 PM · Indexer, Metadata workflow
vlorentz closed T4274: Resolve all known crashes in the metadata indexer as Resolved.
Jul 5 2022, 4:50 PM · Indexer, Metadata workflow
vlorentz closed T4274: Resolve all known crashes in the metadata indexer, a subtask of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1, as Resolved.
Jul 5 2022, 4:50 PM · System administration, Indexer, Metadata workflow
vlorentz closed T4274: Resolve all known crashes in the metadata indexer, a subtask of T4273: Rewrite indexers as journal clients when relevant, as Resolved.
Jul 5 2022, 4:50 PM · Indexer, Metadata workflow

Jun 30 2022

vlorentz added revisions to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch: D8060: Add extrinsic metadata indexer, D8058: Add support for origin_extrinsic_metadata to the storage, D8055: github mapping: Add support for more terms from the Codemeta crosswalk, D8054: github mapping: Add support for terms outside the codemeta context, D8053: Add minimal GitHub metadata mapping, D8046: Remove SingleFileMapping from JsonMapping's base classes.
Jun 30 2022, 3:31 PM · Archive search, Metadata workflow

Jun 29 2022

swh-sentry-integration added a comment to T4277: Deal with null characters in the output of the metadata indexer.

Sentry issue: SWH-INDEXER-FB

Jun 29 2022, 11:27 AM · Indexer, Metadata workflow
VickyMerzOwn closed T4275: CffMapping: Add checks for value types, a subtask of T4274: Resolve all known crashes in the metadata indexer, as Resolved.
Jun 29 2022, 11:15 AM · Indexer, Metadata workflow
VickyMerzOwn closed T4275: CffMapping: Add checks for value types as Resolved.
Jun 29 2022, 11:15 AM · Easy hack, Indexer, Metadata workflow

Jun 28 2022

vlorentz updated the task description for T4354: Contribute terms to ForgeFed.
Jun 28 2022, 12:11 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 28 2022, 11:45 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 28 2022, 11:45 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 28 2022, 11:22 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 28 2022, 10:42 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 28 2022, 10:08 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 28 2022, 9:08 AM · Archive search, Metadata workflow

Jun 27 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 27 2022, 1:17 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 27 2022, 1:17 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 27 2022, 1:04 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4354: Contribute terms to ForgeFed.
Jun 27 2022, 11:12 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4354: Contribute terms to ForgeFed.
Jun 27 2022, 11:12 AM · Archive search, Metadata workflow
vlorentz triaged T4354: Contribute terms to ForgeFed as Normal priority.
Jun 27 2022, 11:11 AM · Archive search, Metadata workflow

Jun 24 2022

VickyMerzOwn added a revision to T4275: CffMapping: Add checks for value types: D8036: Check CFF Value Types.
Jun 24 2022, 8:01 PM · Easy hack, Indexer, Metadata workflow
VickyMerzOwn added a comment to T4275: CffMapping: Add checks for value types.

I'm not so sure what needs to be done here.
If some fields have no values, does it have to skip it or put some default value?

Jun 24 2022, 3:58 PM · Easy hack, Indexer, Metadata workflow

Jun 23 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 23 2022, 2:30 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 23 2022, 1:54 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 23 2022, 1:53 PM · Archive search, Metadata workflow

Jun 21 2022

vlorentz assigned T4275: CffMapping: Add checks for value types to VickyMerzOwn.
Jun 21 2022, 1:32 PM · Easy hack, Indexer, Metadata workflow
vlorentz added a subtask for T4274: Resolve all known crashes in the metadata indexer: T4333: test_npm_adversarial fails.
Jun 21 2022, 1:32 PM · Indexer, Metadata workflow
VickyMerzOwn closed T4276: CffMapping: ignore invalid yaml files, a subtask of T4274: Resolve all known crashes in the metadata indexer, as Resolved.
Jun 21 2022, 11:27 AM · Indexer, Metadata workflow
VickyMerzOwn closed T4276: CffMapping: ignore invalid yaml files as Resolved.
Jun 21 2022, 11:27 AM · Indexer, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 21 2022, 10:32 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 21 2022, 10:30 AM · Archive search, Metadata workflow
VickyMerzOwn added a revision to T4276: CffMapping: ignore invalid yaml files: D8002: CffMapping: Ignores invalid yaml files.
Jun 21 2022, 8:54 AM · Indexer, Metadata workflow

Jun 20 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:53 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:53 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:52 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:43 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:27 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:23 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:22 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 20 2022, 4:21 PM · Archive search, Metadata workflow

Jun 15 2022

vlorentz added a revision to T4277: Deal with null characters in the output of the metadata indexer: D7992: npm: Add workaround for mangled package descriptions.
Jun 15 2022, 6:30 PM · Indexer, Metadata workflow

Jun 13 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 5:50 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 5:41 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 5:35 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 5:15 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 5:14 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 5:13 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 4:30 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 2:22 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 2:16 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 1:59 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 1:58 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 10:38 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 10:36 AM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 13 2022, 10:35 AM · Archive search, Metadata workflow

Jun 10 2022

vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 5:58 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 3:23 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 3:06 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 3:02 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 2:59 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 2:48 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 2:47 PM · Archive search, Metadata workflow
vlorentz updated the task description for T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.
Jun 10 2022, 2:36 PM · Archive search, Metadata workflow
vlorentz added a comment to T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.

(moved to issue description because comments are painful to edit in Phab)

Jun 10 2022, 2:05 PM · Archive search, Metadata workflow
vlorentz added a comment to T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.

it is (probably) currently missing many of the terms we want to use

Jun 10 2022, 1:57 PM · Archive search, Metadata workflow
vlorentz assigned T4276: CffMapping: ignore invalid yaml files to VickyMerzOwn.
Jun 10 2022, 12:26 PM · Indexer, Metadata workflow

Jun 9 2022

moranegg added a comment to T1752: Test drive legacy software curation process with Scilab.

https://github.com/clg55/Scilab-Workbench

Jun 9 2022, 10:42 PM · Acquisition Process (SWHAP), Metadata workflow, Scientific Community Building
moranegg renamed T1752: Test drive legacy software curation process with Scilab from Test drive legacy software curation process to Test drive legacy software curation process with Scilab.
Jun 9 2022, 10:40 PM · Acquisition Process (SWHAP), Metadata workflow, Scientific Community Building
moranegg added a comment to T4249: Choose/define an ontology to use for indexed extrinsic origin metadata.

What are the drawbacks of Wikidata?

Jun 9 2022, 10:39 PM · Archive search, Metadata workflow

Jun 2 2022

ardumont changed the status of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from Work in Progress to Open.
Jun 2 2022, 6:00 PM · System administration, Indexer, Metadata workflow
ardumont changed the status of T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1, a subtask of T4273: Rewrite indexers as journal clients when relevant, from Work in Progress to Open.
Jun 2 2022, 6:00 PM · Indexer, Metadata workflow
ardumont moved T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from deployed/landed/monitoring to Backlog on the System administration board.
Jun 2 2022, 6:00 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 2 2022, 5:57 PM · System administration, Indexer, Metadata workflow
ardumont added a revision to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1: D7951: Deploy new origin intrinsic metadata journal client indexer.
Jun 2 2022, 5:57 PM · System administration, Indexer, Metadata workflow
ardumont added a comment to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.

Reverting:

  • Stopping and disabling journal client services [1]
  • D7950: Revert puppet manifest changes
  • scheduler0.staging: deploy manifest changes [2]
  • workers.staging: Deploy manifest changes [3]
  • check everything is back to normal [4]
Jun 2 2022, 5:53 PM · System administration, Indexer, Metadata workflow
ardumont added a revision to T4274: Resolve all known crashes in the metadata indexer: D7950: staging: Revert indexer journal client deployment.
Jun 2 2022, 5:46 PM · Indexer, Metadata workflow
ardumont added a parent task for T4274: Resolve all known crashes in the metadata indexer: T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 2 2022, 5:37 PM · Indexer, Metadata workflow
ardumont added a subtask for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1: T4274: Resolve all known crashes in the metadata indexer.
Jun 2 2022, 5:37 PM · System administration, Indexer, Metadata workflow
ardumont added a comment to T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.

This needs to be reverted in waiting for [1] to be resolved.
I'll attend to it tomorrow.

Jun 2 2022, 4:38 PM · System administration, Indexer, Metadata workflow

Jun 1 2022

ardumont moved T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 from in-progress to deployed/landed/monitoring on the System administration board.
Jun 1 2022, 5:37 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 1 2022, 5:37 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 1 2022, 5:22 PM · System administration, Indexer, Metadata workflow
ardumont updated the task description for T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1.
Jun 1 2022, 5:15 PM · System administration, Indexer, Metadata workflow