Page MenuHomeSoftware Heritage

Index extrinsic metadata from the journal in swh-search/Elasticsearch
Open, NormalPublic

Event Timeline

vlorentz triaged this task as Normal priority.Nov 8 2019, 5:17 PM
vlorentz created this task.
vlorentz renamed this task from Index extrinsic metadata in swh-search/Elasticsearch from the journal to Index extrinsic metadata from the journal in swh-search/Elasticsearch.Apr 9 2021, 9:33 AM

I'm tempted to postpone this issue until we resolve T2063...

I'm tempted to postpone this issue until we resolve T2063...

I don't think we're "resolving" T2063 until we need to process tasks that can't reasonably be handled by celery. On the other hand, journal clients are sort of a resolution to T2063.

Would a "simple" journal client, which would be able to mangle known metadata types into something that can be fed into elasticsearch be appropriate here?

On the other hand, journal clients are sort of a resolution to T2063.

Yes, they are. I just want to make sure we explicitly decide to go that way.

Would a "simple" journal client, which would be able to mangle known metadata types into something that can be fed into elasticsearch be appropriate here?

Yes.