There's a memory leak somewere in the swh.storage.api.server stack.
We can mitigate it by setting gunicorn to reap workers after a set number of queries, but it's a pretty ugly thing to do.
Let's try to investigate and fix it...
There's a memory leak somewere in the swh.storage.api.server stack.
We can mitigate it by setting gunicorn to reap workers after a set number of queries, but it's a pretty ugly thing to do.
Let's try to investigate and fix it...
potentially useful related tooling: http://carsonip.me/posts/debugging-memory-usage-python-tracemalloc/
Considering the age of the bug report and how many underlying libraries have been upgraded, we can reopen this when we notice it again.