Page MenuHomeSoftware Heritage
Create Task
Maniphest T4251

[swh-search] Investigate long search queries response time
Closed, MigratedEdits Locked
Actions

Description

Most of the search queries take around 3-5 seconds which isn't good for UX. We should do some profiling tests, find out the bottlenecks, and fix them.

P1364 contains a list of queries for which we should run Kibana profiling tests to understand if the problem originates from elasticsearch itself. If it doesn't, we need to investigate other parts of the stack.

Related Objects

Event Timeline

KShivendu created this task.May 17 2022, 8:49 AM
KShivendu created this object in space S1 Public.
KShivendu added a subscriber: vsellier.
vsellier triaged this task as Normal priority.May 17 2022, 8:54 AM
vsellier added a project: System administrators.
vsellier removed a subscriber: vsellier.
vsellier added a comment.May 17 2022, 5:37 PM

Here are the results of the queries.
You can directly paste the json in the search profiler to see the result.
(Be careful some are quite huge)

  • visited = true

request1.json.bz26 KBDownload

  • (((visited = true and visits > 0)))

request2.json.bz214 KBDownload

  • origin : django and metadata : "web"

request3.json.bz2556 KBDownload

-origin : django

request4.json.bz216 KBDownload

  • metadata : "web"

request5.json.bz2518 KBDownload

  • origin : django or metadata : "web"

request6.json.bz21 MBDownload

  • visits != 5

request7.json.bz215 KBDownload

  • visit_type = [git,"pypi"]

request8.json.bz211 KBDownload

vsellier renamed this task from Improve search performance to [swh-search] Investigate long search queries response time.May 17 2022, 5:38 PM
vsellier closed this task as Resolved.
vsellier reopened this task as Work in Progress.
vsellier claimed this task.
vsellier edited projects, added System administration; removed System administrators.
vsellier moved this task from Backlog to in-progress on the System administration board.
vsellier added a comment.Oct 4 2022, 6:22 PM

@KShivendu Any news regarding these profiling ?

Should we keep this ticket open?

KShivendu added a comment.Oct 5 2022, 10:52 AM

Please keep it open since the search isn't fast enough at the moment.

gitlab-migration closed this task as Migrated.Oct 19 2022, 6:07 PM
gitlab-migration claimed this task.
gitlab-migration added subscribers: vsellier, gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal