11:25 <+vsellier> we will have to check the elasticsearch behavior with production volume 11:26 <+vsellier> the size increases have been important on staging 11:26 <+vsellier> around x5 11:26 <+vsellier> (the index size) 11:27 <+vsellier> if the ratio is the same for production, the bump could be from 250g to 1.2T 11:28 <+vsellier> the search-esnode are not yet sized for this 11:31 <vlorentz> shouldn't we stop the metadata ingestion until they are? 11:31 <+vsellier> (they are vms on proxmox, we will have to think where we can find so much space) 11:32 <+vsellier> the search journal client is not deployed so no problem for the moment, nothing is sent to ES 11:33 <+vsellier> (I mean not deployed in production, it is only on staging)
Description
Description
Status | Assigned | Task | ||
---|---|---|---|---|
Open | vlorentz | T1892 Cassandra as a storage backend | ||
Open | None | T1523 Search tools on metadata | ||
Open | vlorentz | T1117 Origin search is *slow* when you look for very common words | ||
Work in Progress | vlorentz | T1910 Redesign origin search using a dedicated component (swh-search) | ||
Resolved | vsellier | T2182 Switch production swh-web to use swh-search instead of postgresql search. | ||
Work in Progress | vlorentz | T2590 Finish the indexer -> swh-search pipeline | ||
Open | None | T3040 [production] Enable swh-search's journal-client for indexed objects | ||
Open | None | T3041 [production] Provision enough space for the search ES cluster to ingest all intrinsic metadata |