Page MenuHomeSoftware Heritage
Paste P1192

[draft-ml-devel] About reducing the loader-git memory consumption and overall work
ActivePublic
Actions

Authored by ardumont on Oct 2 2021, 10:56 AM.
Hello,
The current loader git consumes a lot of memory depending on the size of
the repository. It's fetching the full packfile of unknown
references/refs (filtered by last snapshot's references), then parses
the packfile multiple times to load in order contents, directories,
revisions, releases and then finishes by creating one snapshot for the
visit.
References in this context are resolved tips of branches (e.g
refs/heads/master, ...) or tags (e.g refs/tags/...).
While the memory consumption is not a problem for small (< 200 refs) to
medium repositories (<= 500 refs), this can become one on large
repositories (> 500), either:
1. The currently unique packfile retrieved at the beginning of the
loading is too big (> 4Gib) which fails immediately the ingestion.
Nothing gets done. The visit is marked as failed. If that happens too
often (thrice consecutively iirc), the origin ends up disabled, so no
longer scheduled (up until it's listed again).
2. The ingestion starts but due to concurrency with other loading
processes, the ingestion process gets killed. That means partial
ingestion of objects got done, but no snapshot nor finalized visit.
This is actually a major problem regarding the scheduling of further
visits for that origin. Nonetheless, if further visit happens
somehow, those will skip already ingested objects (which will have
still been retrieved again though *without* partial snapshot in
between visits).
3. Prior to the process getting killed, a high memory pressure in the
current deployment situation implies that at some point heavy disk
i/o happens (to reduce memory pressure). But that actually creates
other ceph problems down the line, which can possibly cascade to
outage, see the events we faced during holidays for example... It's a
work in progress outside the scope of this email. But still, that
could still happen. In the mean time, the actual proposed solutions
could incidentally prevent this.
To solve these problems, some work has been investigated and tried.
A first naive attempt has been made to iterate over the packfile once
and keep a dict of the references (to drop immediately the packfile
reference) [1]. This failed as the memory consumption spiked even
further. This had the advantage to kill the loading very fast. So, the
conclusion of this attempt is that iterating over the packfile multiple
times (one iteration for each type of object of our model) is actually
not the problem.
[1] https://forge.softwareheritage.org/D6377
Another attempt was to modify the loader git to make the ingestion fetch
multiple packfiles ([2] [3] with a slight loader-core change required
[4])). This has the advantage of naturally taking care of 1. (no more
huge packfile). This is done by asking intervals of unknown remote refs,
starting by the tags (in natural order) then the branches [5]. The
natural order on tags sounds like a proper way to start incrementally
load the repository following its history [3]. If we don't follow the
history (only [2]), we could fetch first a huge packfile (with mostly
everything in it) thus back to square one. This does assume tags exist
in the repository (which should mostly be the case). The only limitation
seen for that approach is that we now regularly discuss with the server
to retrieve information during the loading. It's a trade-off.
FWIW, this regular server discussion approach is what's currently done
with the mercurial loader without issues. That loader is very stable now
and not as greedy in memory as it used to be (hence one other motivation
to align git loader behavior). It did the sourceforge hg origins
ingestion without issues and the bitbucket origins still ongoing is
running smoothly (ETA ~1 week or so).
[2] https://forge.softwareheritage.org/D6386 (ingest in multiple
packfile fetch)
[3] https://forge.softwareheritage.org/D6392 (follow refs tags in order,
then branches)
[4] https://forge.softwareheritage.org/D6380. This core loader
adaptation actually allows the git loader (well DVCS loaders) to create
partial visit targeting a snapshot after each internal ingestion loop
(so for git after each packfile consumption). So this makes sure that we
create incremental snapshot prior to the final one (if we reach the end
of the ingestion). Such adaptation takes care of point 2. (and make
subsequent visits do less work even in case of failures). Thanks to
@vlorentz which made me realize this on that diff's review. After a
couple of nights sleeping on it, it finally made sense!
[5] Another idea (not followed through) would be to delay ingestion of
some special references which are assumed highly connected within the
graph at the end. Typically, e.g. "HEAD", "refs/heads/master",
"refs/heads/main", "refs/heads/develop", ... (others?). The hypothesis
is that these references are the main connected part of the repository.
So starting with those would end up with a huge packfile immediately (so
with large repositories at least, we are back to the initial problem).
On the contrary, if we start by the other references first, then dealing
with the special ones at the end, only a bit more work would be needed
to fill in the blanks. That could yet be another optimization which
would maybe help if there are no tags in the repository for example.
Another consideration we did not follow completely through yet was to
use a depth parameter (in the current internal lib used to discuss with
the server). It's not completely clear what actual depth number would be
a relatively decent and satisfying enough for all repositories out
there. It's been slighly tested but dismissed for now due to that
question. It's not to be excluded though. It may simply be that this
solution composed with the previous points could just be a deeper
optimization on reducing the loader's work (especially the part walking
the git graph).
Not necessarily memory consumption related but still, as another
optimization point to further align the git loader with the mercurial
loader, it would be interesting to start using the extid table to map
what's considered git ids (which will change afaiui) with the
revision/release id. Using this mapping would allow filtering even
further what we already ingested across origins (known refs and not only
those from the last snapshot of the same origin as currently). That
optimization reduced quite a lot the mercurial loader work especially
regarding mercurial forks. In the loader git's case, filtering early
enough known refs (revision/release) would actually reduce further the
packfiles (providing the extid table is actually filled enough that is).
As a heads up, there are ongoing runs between staging (patched venv with
diffs [2] [3] and [4]) and production nodes. Stats will be updated along
the way when more runs conclude (stats [6]). In the mean time, the first
runs already confirm what's been described in this email, "it works".
That is less memory is used and it's not necessarily slower. Current
runs actually shows that staging nodes finishes faster than production
ones (possibly due to their load been less intensive). This is also
consistent in term of snapshot id computation. The final snapshot of the
"full" visit remains the same between production and patched staging
nodes (when the visit actually finishes production side).
[6] https://forge.softwareheritage.org/T3625#71604
Having described the problematic, possible solutions, implement some of
them, and with the first runs actually confirming it's actually working,
I'm now fairly convinced that we have a way forward to improve the
loader git. With at least the first diffs in review, it will end up
being less greedy in terms of memory, thus more concurrent friendly.
Which in turn, should help in making our lag subside even faster (we are
keeping up [7] btw but not as fast as we'd like).
[7] https://grafana.softwareheritage.org/goto/crFAS4Dnk?orgId=1
Any thoughts, pros or cons arguments prior to actually drive this all
the way through?
Thanks in advance for any feedback, cheers,
@vsellier and @ardumont
--
tony / Antoine R. Dumont (@ardumont)
-----------------------------------------------------------------
gpg fingerprint BF00 203D 741A C9D5 46A8 BE07 52E2 E984 0D10 C3B8

Event Timeline

ardumont created this paste.Oct 2 2021, 10:56 AM
ardumont edited the content of this paste. (Show Details)Oct 2 2021, 11:03 AM
ardumont mentioned this in T3625: Reduce git loader memory footprint.Oct 2 2021, 11:05 AM
ardumont edited the content of this paste. (Show Details)Oct 2 2021, 6:16 PM
ardumont changed the title of this paste from [draft-ml-devel] About reducing the loader-git memory consumption to [draft-ml-devel] About reducing the loader-git memory consumption and overall work.
ardumont edited the content of this paste. (Show Details)Oct 3 2021, 10:36 AM
ardumont edited the content of this paste. (Show Details)Oct 3 2021, 3:43 PM
ardumont edited the content of this paste. (Show Details)Oct 3 2021, 4:11 PM
ardumont added a comment.EditedOct 3 2021, 4:29 PM

Run on large repositories:

|---------+-----------------+-------+-------------------------+-------------------------+------------------------|
| Machine | torvalds/linux  | refs  | Snapshot                | Memory (max RSS kbytes) | Elapsed Time (h:mm:ss) |
|---------+-----------------+-------+-------------------------+-------------------------+------------------------|
| staging | torvalds/linux  | 1496  | \xc2847...3fb4          |                 1361324 |                6:59:16 |
| prod    | //              | //    | \xc2847...3fb4          |                 3080408 |               24:13:11 |
|---------+-----------------+-------+-------------------------+-------------------------+------------------------|
| staging | CocoaPods/Specs | 14036 | X (hash mismatched) [1] |                 5789344 |               23:10:48 |
| prod    | //              | //    | X (killed) [2]          |                14280284 |               10:09:09 |
|---------+-----------------+-------+-------------------------+-------------------------+------------------------|

[1] worker.staging run:

(ve) swhworker@worker1:~$ /usr/bin/time -v swh loader run git https://github.com/CocoaPods/Specs
qINFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/CocoaPods/Specs' with type 'git'
Enumerating objects: 5176632, done.
Counting objects: 100% (59/59), done.
Compressing objects: 100% (51/51), done.
Total 5176632 (delta 15), reused 28 (delta 5), pack-reused 5176573
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 33, done.
Counting objects: 100% (10/10), done.
Compressing objects: 100% (10/10), done.
Total 33 (delta 4), reused 0 (delta 0), pack-reused 23
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs  # <---------- Global number of refs time and again repeated even if packfile is smaller
Enumerating objects: 4496, done.
Counting objects: 100% (543/543), done.
Compressing objects: 100% (200/200), done.
Total 4496 (delta 410), reused 343 (delta 343), pack-reused 3953
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 2040, done.
Counting objects: 100% (703/703), done.
Compressing objects: 100% (191/191), done.
Total 2040 (delta 577), reused 512 (delta 512), pack-reused 1337
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 25920, done.
Counting objects: 100% (499/499), done.
Compressing objects: 100% (162/162), done.
Total 25920 (delta 397), reused 337 (delta 337), pack-reused 25421
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 1636, done.
Counting objects: 100% (475/475), done.
Compressing objects: 100% (198/198), done.
Total 1636 (delta 350), reused 277 (delta 277), pack-reused 1161
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 5561, done.
Counting objects: 100% (549/549), done.
Compressing objects: 100% (227/227), done.
Total 5561 (delta 415), reused 322 (delta 322), pack-reused 5012
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
ERROR:swh.loader.git.loader.GitLoader:Loading failure, updating to `failed` status
Traceback (most recent call last):
  File "/home/swhworker/swh-loader-core/swh/loader/core/loader.py", line 339, in load
    self.store_data(create_snapshot=not more_data_to_fetch)
  File "/home/swhworker/swh-loader-git/swh/loader/git/loader.py", line 416, in store_data
    super().store_data(create_snapshot)
  File "/home/swhworker/swh-loader-core/swh/loader/core/loader.py", line 457, in store_data
    for directory in self.get_directories():
  File "/home/swhworker/swh-loader-git/swh/loader/git/loader.py", line 452, in get_directories
    yield converters.dulwich_tree_to_directory(raw_obj)
  File "/home/swhworker/swh-loader-git/swh/loader/git/converters.py", line 104, in dulwich_tree_to_directory
    check_id(dir_)
  File "/home/swhworker/swh-loader-git/swh/loader/git/converters.py", line 39, in check_id
    f"Expected {type(obj).__name__} hash to be {obj.id.hex()}, "
swh.loader.git.converters.HashMismatch: Expected Directory hash to be 4f81b2310d1d1179305326cce9bfd628ded1b5f6, got 3f70740362b567e569f0a84f3a0c0f4ca04836e7
{'status': 'failed'}
        Command being timed: "swh loader run git https://github.com/CocoaPods/Specs"
        User time (seconds): 73818.03
        System time (seconds): 1122.75
        Percent of CPU this job got: 89%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 23:10:48
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 5789344
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 31
        Minor (reclaiming a frame) page faults: 121229650
        Voluntary context switches: 8938885
        Involuntary context switches: 5298174
        Swaps: 0
        File system inputs: 337056
        File system outputs: 1814336
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096

[2]

swhworker@worker18:~$ /usr/bin/time -v swh loader run git https://github.com/CocoaPods/Specs
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/CocoaPods/Specs' with type 'git'
Enumerating objects: 5043861, done.
Counting objects: 100% (59/59), done.
Compressing objects: 100% (51/51), done.
Total 5043861 (delta 15), reused 28 (delta 5), pack-reused 5043802
INFO:swh.loader.git.loader.GitLoader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Command terminated by signal 9
        Command being timed: "swh loader run git https://github.com/CocoaPods/Specs"
        User time (seconds): 23710.19
        System time (seconds): 715.48
        Percent of CPU this job got: 66%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 10:09:09
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 14280284
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 505
        Minor (reclaiming a frame) page faults: 9356497
        Voluntary context switches: 3972820
        Involuntary context switches: 5202889
        Swaps: 0
        File system inputs: 86800
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0
ardumont edited the content of this paste. (Show Details)Oct 3 2021, 5:51 PM
ardumont edited the content of this paste. (Show Details)Oct 3 2021, 6:20 PM
ardumont edited the content of this paste. (Show Details)Oct 3 2021, 6:59 PM
ardumont added a comment.EditedOct 4 2021, 8:09 AM
  • commands
/usr/bin/time -v swh loader run git https://github.com/CocoaPods/Specs
/usr/bin/time -v swh loader run git https://github.com/cozy/cozy-stack
/usr/bin/time -v swh loader run git https://github.com/hylang/hy
/usr/bin/time -v swh loader run git https://github.com/vsellier/easy-cozy
/usr/bin/time -v swh loader run git https://github.com/rancher/dashboard
/usr/bin/time -v swh loader run git https://github.com/kubernetes/kubectl
/usr/bin/time -v swh loader run git https://github.com/git/git
/usr/bin/time -v swh loader run git https://github.com/torvalds/linux
/usr/bin/time -v swh loader run git https://github.com/rust-lang/rust

# with debug
/usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/rust-lang/rust

docker-compose exec swh-scheduler swh scheduler origin schedule-next cvs 10
  • rust-lang/rust
    • staging
    • production ingestion:
swhworker@worker18:~$ /usr/bin/time -v swh loader run git https://github.com/rust-lang/rust
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/rust-lang/rust' with type 'git'
Enumerating objects: 1568280, done.
Counting objects: 100% (326/326), done.
Compressing objects: 100% (241/241), done.
Total 1568280 (delta 134), reused 220 (delta 85), pack-reused 1567954
INFO:swh.loader.git.loader.GitLoader:Listed 48615 refs for repo https://github.com/rust-lang/rust
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/rust-lang/rust"
        User time (seconds): 8248.27
        System time (seconds): 321.57
        Percent of CPU this job got: 77%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 3:05:09
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 3397172
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 17
        Minor (reclaiming a frame) page faults: 3162550
        Voluntary context switches: 2667
        Involuntary context switches: 677524
        Swaps: 0
        File system inputs: 608
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

08:00:47 softwareheritage@belvedere:5432=>
select now(), date, status, snapshot from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/rust-lang/rust' and ovs.type='git' order by date desc limit 2;
+-------------------------------+-------------------------------+---------+--------------------------------------------+
|              now              |             date              | status  |                  snapshot                  |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
| 2021-10-04 06:00:58.466446+00 | 2021-10-03 18:25:07.247909+00 | full    | \x40352a332ae4421502491e3a8a26cf9ed0179ecb |
| 2021-10-04 06:00:58.466446+00 | 2021-10-03 15:20:00.733285+00 | created | (null)                                     |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
(2 rows)

Time: 7.663 ms
  • git/git
    • staging

ingestion:

(ve) swhworker@worker1:~$ /usr/bin/time -v swh loader run git https://github.com/git/git
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/git/git' with type 'git'
Enumerating objects: 57270, done.
Counting objects: 100% (1397/1397), done.
Compressing objects: 100% (79/79), done.
Total 57270 (delta 1350), reused 1318 (delta 1318), pack-reused 55873
INFO:swh.loader.git.loader:Listed 1903 refs for repo https://github.com/git/git
Enumerating objects: 98312, done.
Counting objects: 100% (18660/18660), done.
Compressing objects: 100% (2289/2289), done.
Total 98312 (delta 17564), reused 16371 (delta 16371), pack-reused 79652
INFO:swh.loader.git.loader:Listed 1903 refs for repo https://github.com/git/git
Enumerating objects: 68841, done.
Counting objects: 100% (22748/22748), done.
Compressing objects: 100% (8059/8059), done.
Total 68841 (delta 21073), reused 14689 (delta 14689), pack-reused 46093
INFO:swh.loader.git.loader:Listed 1903 refs for repo https://github.com/git/git
Enumerating objects: 190170, done.
Counting objects: 100% (77728/77728), done.
Compressing objects: 100% (11945/11945), done.
Total 190170 (delta 75584), reused 66188 (delta 65783), pack-reused 112442
INFO:swh.loader.git.loader:Listed 1903 refs for repo https://github.com/git/git
ERROR:swh.loader.git.loader.GitLoader:Loading failure, updating to `partial` status
Traceback (most recent call last):
  File "/home/swhworker/swh-loader-core/swh/loader/core/loader.py", line 339, in load
    self.store_data(create_partial_visit=more_data_to_fetch)
  File "/home/swhworker/swh-loader-git/swh/loader/git/loader.py", line 412, in store_data
    super().store_data(create_partial_visit)
  File "/home/swhworker/swh-loader-core/swh/loader/core/loader.py", line 460, in store_data
    for revision in self.get_revisions():
  File "/home/swhworker/swh-loader-git/swh/loader/git/loader.py", line 457, in get_revisions
    yield converters.dulwich_commit_to_revision(raw_obj)
  File "/home/swhworker/swh-loader-git/swh/loader/git/converters.py", line 163, in dulwich_commit_to_revision
    check_id(rev)
  File "/home/swhworker/swh-loader-git/swh/loader/git/converters.py", line 39, in check_id
    f"Expected {type(obj).__name__} hash to be {obj.id.hex()}, "
swh.loader.git.converters.HashMismatch: Expected Revision hash to be 5f549aa2f78314ac37bbd436c8f80aea4c752e07, got 6471e8cc72e1323b44a9d97e6cf297e9ed09eec3
{'status': 'failed'}
        Command being timed: "swh loader run git https://github.com/git/git"
        User time (seconds): 2894.15
        System time (seconds): 20.17
        Percent of CPU this job got: 63%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 1:16:17
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 464200
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 1076208
        Voluntary context switches: 596097
        Involuntary context switches: 226334
        Swaps: 0
        File system inputs: 0
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot: git/git failed prior to the final visit but it got partial snapshot along the way:

18:25:11 swh@db1:5432=> select now(), date, status, snapshot from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/git/git' and ovs.type='git' order by date desc limit 7;
+-------------------------------+-------------------------------+---------+--------------------------------------------+
|              now              |             date              | status  |                  snapshot                  |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
| 2021-10-03 16:25:13.634449+00 | 2021-10-03 16:17:35.745275+00 | partial | \x2df8ad71aaa2e6a11c653c6894afa7909ace848e |
| 2021-10-03 16:25:13.634449+00 | 2021-10-03 15:36:31.019449+00 | partial | \x2df8ad71aaa2e6a11c653c6894afa7909ace848e |
| 2021-10-03 16:25:13.634449+00 | 2021-10-03 15:24:29.421092+00 | partial | \xbbe916578b5a0fd916d41462ddde83017be3973d |
| 2021-10-03 16:25:13.634449+00 | 2021-10-03 15:13:39.308974+00 | partial | \x3f506808dd5f2cee14fb0ed16b78aad253554d99 |
| 2021-10-03 16:25:13.634449+00 | 2021-10-03 15:06:08.169689+00 | partial | \x7c43d5f5f365a7311aabe4fd958723665c724bcb |
| 2021-10-03 16:25:13.634449+00 | 2021-10-03 15:01:21.691919+00 | created | (null)                                     |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
(6 rows)

Time: 4.997 ms
  • production

ingestion:

swhworker@worker18:~$ /usr/bin/time -v swh loader run git https://github.com/git/git
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/git/git' with type 'git'
Enumerating objects: 484776, done.
Counting objects: 100% (2517/2517), done.
Compressing objects: 100% (1165/1165), done.
Total 484776 (delta 1716), reused 1757 (delta 1352), pack-reused 482259
INFO:swh.loader.git.loader.GitLoader:Listed 1903 refs for repo https://github.com/git/git
ERROR:swh.loader.git.loader.GitLoader:Loading failure, updating to `failed` status
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/swh/loader/core/loader.py", line 339, in load
    self.store_data()
  File "/usr/lib/python3/dist-packages/swh/loader/core/loader.py", line 460, in store_data
    for revision in self.get_revisions():
  File "/usr/lib/python3/dist-packages/swh/loader/git/loader.py", line 371, in get_revisions
    yield converters.dulwich_commit_to_revision(raw_obj, log=self.log)
  File "/usr/lib/python3/dist-packages/swh/loader/git/converters.py", line 163, in dulwich_commit_to_revision
    check_id(rev)
  File "/usr/lib/python3/dist-packages/swh/loader/git/converters.py", line 39, in check_id
    f"Expected {type(obj).__name__} hash to be {obj.id.hex()}, "
swh.loader.git.converters.HashMismatch: Expected Revision hash to be 5f549aa2f78314ac37bbd436c8f80aea4c752e07, got 6471e8cc72e1323b44a9d97e6cf297e9ed09eec3
{'status': 'failed'}
        Command being timed: "swh loader run git https://github.com/git/git"
        User time (seconds): 5403.48
        System time (seconds): 173.96
        Percent of CPU this job got: 61%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 2:31:38
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 2059192
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 11
        Minor (reclaiming a frame) page faults: 3844954
        Voluntary context switches: 851913
        Involuntary context switches: 983917
        Swaps: 0
        File system inputs: 176
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

no snapshot

  • keybase/client
    • staging
      • run1

ingest:

(ve) swhworker@worker0:~/swh-loader-git$ /usr/bin/time -v swh loader run git https://github.com/keybase/client
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/keybase/client' with type 'git'
Enumerating objects: 431195, done.
Counting objects: 100% (431195/431195), done.
Compressing objects: 100% (105589/105589), done.
Total 431195 (delta 320325), reused 431187 (delta 320318), pack-reused 0
INFO:swh.loader.git.loader:Listed 19867 refs for repo https://github.com/keybase/client
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/keybase/client"
        User time (seconds): 1306.00
        System time (seconds): 27.66
        Percent of CPU this job got: 62%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 35:26.36
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 278568
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 15
        Minor (reclaiming a frame) page faults: 747287
        Voluntary context switches: 36155
        Involuntary context switches: 65788
        Swaps: 0
        File system inputs: 12208
        File system outputs: 1089672
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

17:24:32 swh@db1:5432=> select now(), date, status, snapshot from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/keybase/client' and ovs.type='git' order by date desc limit 2;
+-------------------------------+-------------------------------+---------+--------------------------------------------+
|              now              |             date              | status  |                  snapshot                  |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
| 2021-10-03 15:24:37.630727+00 | 2021-10-03 15:21:59.952628+00 | full    | \xf780a1024b436704066adfcf89d28a1ccbe1c5a7 |
| 2021-10-03 15:24:37.630727+00 | 2021-10-03 14:46:36.017078+00 | created | (null)                                     |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
(2 rows)
  • run 2

ingest:

...
Enumerating objects: 10895, done.
Counting objects: 100% (6728/6728), done.
Compressing objects: 100% (3903/3903), done.
Total 10895 (delta 5543), reused 2825 (delta 2825), pack-reused 4167
INFO:swh.loader.git.loader:Listed 19867 refs for repo https://github.com/keybase/client
WARNING:swh.loader.git.loader:Unknown objects referenced by remote refs: refs/pull/9920/head: e50a1338a8e41c1c8d446e21efccd26dce0fd0d6, refs/pull/9922/head: 7284a005a569e4ff25193799d1303457b310d35a, refs/pull/9923/head: 05933212fdb4ce9045bec24d06dd85cfc9ef041e, refs/pull/9924/head: 5e58c14a53410d255251f22e61dfe3f5d43fda22, refs/pull/9925/head: 8c5d1f2819abfd6ef273bdec7f6e6a8fc002d664, refs/pull/9926/head: f4c683a17bcb7c1131fc86638b6ae56d805b2b4b, refs/pull/9927/head: 30ff65be4a3a9539d617ef0638a33e87e6af06e4, refs/pull/9928/head: 438d8349b556994cdbacd20ea0f5196923b4cbba, refs/pull/9932/head: 19d8d347c0dcdd2e0ec9660743a41faadad8b67f, refs/pull/9933/head: acf5b31edc63aaf15e3baddf33a866cc31c93dc0, refs/pull/9935/head: ada8b28793b0f65b7cea16130b627c88e1853801, refs/pull/9937/head: d215444c9ace847102b7ada07a8774ff06daf472, refs/pull/9939/head: 6e947765513d858e72f7ed6aa7da432fb2548e44, refs/pull/9940/head: b7fe66d308cd4537222c8a54b8206412255b47e2, refs/pull/9941/head: 90d6494a1f352044586a72203e6e88a463faaaff, refs/pull/9949/head: f1ba6d5d905ca9bf8804c6631987f4d2baa3488d, refs/pull/995/head: 208a02751456c3638b573d6e1650a6ad9644d567, refs/pull/9951/head: 9e0ebe268240becf49d83965d491b3422ac87e01, refs/pull/9952/head: 52dc7d56bd3dc5df4757389eb4ded291775fb87e, refs/pull/9953/head: 924fb5c229f61771ea11ada94d9998b7522b983a, refs/pull/9954/head: 6ba0634aa97af26d81cad82548be40beeff37301, refs/pull/9955/head: b74b63899dc130d98cc565681a337941bcfa76c0, refs/pull/9956/head: 831febe51aa3ca0c3173472090ff15c3578bccac, refs/pull/9957/head: e2b6b50b490c8f76b3447aee070d16b7c131089a, refs/pull/9958/head: e92cbc300850ca861f4414c617782b2b999a384b, refs/pull/9959/head: 4fe5f808a4363721f14ce45958c5ff13361cb035, refs/pull/9960/head: b2104c8bbf001a391d854799757fcc468d7acf5c, refs/pull/9962/head: 202fb43cd1dcd2f9b144ba1eec01bfa22b852861, refs/pull/9968/head: fa5675bb9937f33620febc1c74785b09040319cf, refs/pull/9973/head: 9ae100e9fd3b0b97282cd25edf77ffcc1b83ba73, refs/pull/9974/head: 09ac1b3891c7b6e8a86e9c6b21398c5de898a17a, refs/pull/9975/head: cfe4df5128704cad9a6ea9a1f785a8779cbbd4a5, refs/pull/9976/head: 11a123085fdd758fc906950e4aa27cf2ace6008b,
refs/pull/9977/head: 769289ea4a571567b112131c024246fbfa9b9805, refs/pull/9978/head: 3a5c3511fd3b39929d2b1ab617b587a7879b5c59, refs/pull/9979/head: 24de5adecae91bdc4b80e7bcd155f10da48d5c03, refs/pull/9980/head: 6e82ed093c62e4301bc54e7fa88fb5b72ecad8b4, refs/pull/9982/head: e3e4fc623622f3e4a314ae8a32d1c946d86a56aa, refs/pull/9983/head: 940b6621aa7b0d58eb914febe8f092163388a274, refs/pull/9984/head: 2231b47074dc0f1e49e5a81e6703294fedb52f42, refs/pull/9986/head: 0f9bb202bc731bb1dfd204d54681dac6f55fefd9, refs/pull/9987/head: c1eb42d294eec09c568614c36dfd23fc08d154c4, refs/pull/9991/head: fd9f822e196c03444300023db172f8188f3f7bdc, refs/pull/9992/head: 1f2cd8f663b7a272597b8cb52c62d1a7cc575a40, refs/pull/9993/head: f7ec1bac8ab3e69e1b6f491bf42da066ca27d257, refs/pull/9994/head: c552c8d1e72c92080c68ef9bfb378d18017038ee, refs/pull/9995/head: ee8799516f20fc8a07c5fb6515463ed613bcbc70, refs/pull/9998/head: 7f7cd8e797d317f62f2763bc164daccedd9ca2f5, refs/pull/9999/head: 21d6212b30ac710ad97a5d9da5314cfea94aafe3
Enumerating objects: 3711, done.
Counting objects: 100% (1798/1798), done.
Compressing objects: 100% (1395/1395), done.
Total 3711 (delta 868), reused 403 (delta 403), pack-reused 1913
INFO:swh.loader.git.loader:Listed 19867 refs for repo https://github.com/keybase/client
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/keybase/client ignore_history=True"
        User time (seconds): 6971.47
        System time (seconds): 130.59
        Percent of CPU this job got: 42%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 4:41:04
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 489256
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 4312444
        Voluntary context switches: 2760066
        Involuntary context switches: 703268
        Swaps: 0
        File system inputs: 0
        File system outputs: 1091200
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

08:02:28 swh@db1:5432=> select now(), date, status, snapshot from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/keybase/client' and ovs.type='git' order by date desc limit 3;
+-------------------------------+-------------------------------+---------+--------------------------------------------+
|              now              |             date              | status  |                  snapshot                  |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
| 2021-10-04 06:02:37.780545+00 | 2021-10-03 20:07:04.735571+00 | full    | \xf780a1024b436704066adfcf89d28a1ccbe1c5a7 |
| 2021-10-04 06:02:37.780545+00 | 2021-10-03 20:06:21.128046+00 | partial | \xd5469b62b99c9158c84a124c966c5e7f6da8d564 |
| 2021-10-04 06:02:37.780545+00 | 2021-10-03 20:05:10.569774+00 | partial | \x2ae993fb5a1e652081f4772441d744cf821310f3 |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
(3 rows)

Time: 7.440 ms
  • production ingestion:
swhworker@worker17:~$ /usr/bin/time -v swh loader run git https://github.com/keybase/client
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/keybase/client' with type 'git'
Enumerating objects: 431199, done.
Counting objects: 100% (17/17), done.
Compressing objects: 100% (8/8), done.
Total 431199 (delta 12), reused 9 (delta 9), pack-reused 431182
INFO:swh.loader.git.loader.GitLoader:Listed 19867 refs for repo https://github.com/keybase/client
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/keybase/client"
        User time (seconds): 3134.66
        System time (seconds): 150.90
        Percent of CPU this job got: 61%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 1:29:02
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 1381324
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 3
        Minor (reclaiming a frame) page faults: 1293456
        Voluntary context switches: 375865
        Involuntary context switches: 913867
        Swaps: 0
        File system inputs: 32
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

18:28:06 softwareheritage@belvedere:5432=> select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/keybase/client' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----------+-----------------------------------+----------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
|              now              |    id    |                url                |  origin  | visit |             date              | status  | metadata |                  snapshot                  | type |
+-------------------------------+----------+-----------------------------------+----------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
| 2021-10-03 16:28:13.240852+00 | 34438017 | https://github.com/keybase/client | 34438017 |   114 | 2021-10-03 16:15:38.143629+00 | full    | (null)   | \xf780a1024b436704066adfcf89d28a1ccbe1c5a7 | git  |
| 2021-10-03 16:28:13.240852+00 | 34438017 | https://github.com/keybase/client | 34438017 |   114 | 2021-10-03 14:46:39.664664+00 | created | (null)   | (null)                                     | git  |
+-------------------------------+----------+-----------------------------------+----------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
(2 rows)

Time: 64.446 ms
  • torvalds/linux
    • docker with patch D6392

ingestion:

swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@bcdd4f30a6b5:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/torvalds/linux
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7f3f53be4c10>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/torvalds/linux' with type 'git'
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/torvalds/linux
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f3f5113ef90> to fetch pack at /torvalds/linux
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=1465
DEBUG:swh.loader.git.loader:wanted_refs_count=1465
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 1631240, done.
Counting objects: 100% (232/232), done.
Compressing objects: 100% (12/12), done.
Total 1631240 (delta 225), reused 220 (delta 220), pack-reused 1631008
DEBUG:swh.loader.git.loader:fetched_pack_size=577020331
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1496 refs for repo https://github.com/torvalds/linux
ERROR:swh.storage.proxies.filter:content add entry count: 9365
ERROR:swh.storage.proxies.filter:content add missing: 9365 (0.2367)
ERROR:swh.storage.proxies.filter:content added in 48.3588
ERROR:swh.storage.proxies.filter:CSV:content;9365;0.2367;9365;48.3588
ERROR:swh.storage.proxies.filter:content add entry count: 10000
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.4981)
ERROR:swh.storage.proxies.filter:content added in 34.3356
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.4981;10000;34.3356
ERROR:swh.storage.proxies.filter:content add entry count: 3777
ERROR:swh.storage.proxies.filter:content add missing: 3777 (0.0837)
ERROR:swh.storage.proxies.filter:content added in 14.9965
ERROR:swh.storage.proxies.filter:CSV:content;3777;0.0837;3777;14.9965
ERROR:swh.storage.proxies.filter:content add entry count: 6011
ERROR:swh.storage.proxies.filter:content add missing: 6011 (0.1352)
ERROR:swh.storage.proxies.filter:content added in 20.4367
ERROR:swh.storage.proxies.filter:CSV:content;6011;0.1352;6011;20.4367
ERROR:swh.storage.proxies.filter:content add entry count: 3569
ERROR:swh.storage.proxies.filter:content add missing: 3569 (0.0822)
ERROR:swh.storage.proxies.filter:content added in 15.0462
ERROR:swh.storage.proxies.filter:CSV:content;3569;0.0822;3569;15.0462
ERROR:swh.storage.proxies.filter:content add entry count: 3718
ERROR:swh.storage.proxies.filter:content add missing: 3718 (0.0861)
ERROR:swh.storage.proxies.filter:content added in 13.7132
ERROR:swh.storage.proxies.filter:CSV:content;3718;0.0861;3718;13.7132
ERROR:swh.storage.proxies.filter:content add entry count: 2432
ERROR:swh.storage.proxies.filter:content add missing: 2432 (0.0582)
ERROR:swh.storage.proxies.filter:content added in 11.9792
ERROR:swh.storage.proxies.filter:CSV:content;2432;0.0582;2432;11.9792
ERROR:swh.storage.proxies.filter:content add entry count: 1882
ERROR:swh.storage.proxies.filter:content add missing: 1882 (0.0484)
ERROR:swh.storage.proxies.filter:content added in 7.9821
ERROR:swh.storage.proxies.filter:CSV:content;1882;0.0484;1882;7.9821
ERROR:swh.storage.proxies.filter:content add entry count: 5286
ERROR:swh.storage.proxies.filter:content add missing: 5286 (0.1215)
ERROR:swh.storage.proxies.filter:content added in 21.4325
ERROR:swh.storage.proxies.filter:CSV:content;5286;0.1215;5286;21.4325
ERROR:swh.storage.proxies.filter:content add entry count: 10000
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2252)
ERROR:swh.storage.proxies.filter:content added in 39.1838
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2252;10000;39.1838
ERROR:swh.storage.proxies.filter:content add entry count: 10000
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2257)
ERROR:swh.storage.proxies.filter:content added in 36.5127
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2257;10000;36.5127
ERROR:swh.storage.proxies.filter:content add entry count: 5984
ERROR:swh.storage.proxies.filter:content add missing: 5984 (0.1356)
ERROR:swh.storage.proxies.filter:content added in 23.5207
ERROR:swh.storage.proxies.filter:CSV:content;5984;0.1356;5984;23.5207
ERROR:swh.storage.proxies.filter:content add entry count: 4311
ERROR:swh.storage.proxies.filter:content add missing: 4311 (0.1012)
ERROR:swh.storage.proxies.filter:content added in 19.6050
ERROR:swh.storage.proxies.filter:CSV:content;4311;0.1012;4311;19.6050
ERROR:swh.storage.proxies.filter:content add entry count: 2041
ERROR:swh.storage.proxies.filter:content add missing: 2041 (0.0495)
ERROR:swh.storage.proxies.filter:content added in 8.5464
ERROR:swh.storage.proxies.filter:CSV:content;2041;0.0495;2041;8.5464
ERROR:swh.storage.proxies.filter:content add entry count: 3417
ERROR:swh.storage.proxies.filter:content add missing: 3417 (0.0802)
ERROR:swh.storage.proxies.filter:content added in 15.9329
ERROR:swh.storage.proxies.filter:CSV:content;3417;0.0802;3417;15.9329
ERROR:swh.storage.proxies.filter:content add entry count: 2675
ERROR:swh.storage.proxies.filter:content add missing: 2675 (0.0640)
ERROR:swh.storage.proxies.filter:content added in 9.5330
ERROR:swh.storage.proxies.filter:CSV:content;2675;0.0640;2675;9.5330
ERROR:swh.storage.proxies.filter:content add entry count: 2889
ERROR:swh.storage.proxies.filter:content add missing: 2889 (0.0808)
ERROR:swh.storage.proxies.filter:content added in 12.9127
ERROR:swh.storage.proxies.filter:CSV:content;2889;0.0808;2889;12.9127
ERROR:swh.storage.proxies.filter:content add entry count: 3905
ERROR:swh.storage.proxies.filter:content add missing: 3905 (0.0979)
ERROR:swh.storage.proxies.filter:content added in 16.4975
ERROR:swh.storage.proxies.filter:CSV:content;3905;0.0979;3905;16.4975
ERROR:swh.storage.proxies.filter:content add entry count: 4629
ERROR:swh.storage.proxies.filter:content add missing: 4629 (0.1043)
ERROR:swh.storage.proxies.filter:content added in 20.4265
ERROR:swh.storage.proxies.filter:CSV:content;4629;0.1043;4629;20.4265
ERROR:swh.storage.proxies.filter:content add entry count: 1655
ERROR:swh.storage.proxies.filter:content add missing: 1655 (0.0418)
ERROR:swh.storage.proxies.filter:content added in 8.0091
ERROR:swh.storage.proxies.filter:CSV:content;1655;0.0418;1655;8.0091
ERROR:swh.storage.proxies.filter:content add entry count: 2460
ERROR:swh.storage.proxies.filter:content add missing: 2460 (0.0622)
ERROR:swh.storage.proxies.filter:content added in 12.1414
ERROR:swh.storage.proxies.filter:CSV:content;2460;0.0622;2460;12.1414
ERROR:swh.storage.proxies.filter:content add entry count: 2397
ERROR:swh.storage.proxies.filter:content add missing: 2397 (0.0575)
ERROR:swh.storage.proxies.filter:content added in 12.2324
ERROR:swh.storage.proxies.filter:CSV:content;2397;0.0575;2397;12.2324
ERROR:swh.storage.proxies.filter:content add entry count: 1783
ERROR:swh.storage.proxies.filter:content add missing: 1783 (0.0428)
ERROR:swh.storage.proxies.filter:content added in 7.8816
ERROR:swh.storage.proxies.filter:CSV:content;1783;0.0428;1783;7.8816
ERROR:swh.storage.proxies.filter:content add entry count: 1497
ERROR:swh.storage.proxies.filter:content add missing: 1497 (0.0385)
ERROR:swh.storage.proxies.filter:content added in 9.3655
ERROR:swh.storage.proxies.filter:CSV:content;1497;0.0385;1497;9.3655
ERROR:swh.storage.proxies.filter:content add entry count: 2271
ERROR:swh.storage.proxies.filter:content add missing: 2271 (0.0554)
ERROR:swh.storage.proxies.filter:content added in 11.4458
ERROR:swh.storage.proxies.filter:CSV:content;2271;0.0554;2271;11.4458
ERROR:swh.storage.proxies.filter:content add entry count: 1892
ERROR:swh.storage.proxies.filter:content add missing: 1892 (0.0468)
ERROR:swh.storage.proxies.filter:content added in 8.5208
ERROR:swh.storage.proxies.filter:CSV:content;1892;0.0468;1892;8.5208
ERROR:swh.storage.proxies.filter:content add entry count: 3561
ERROR:swh.storage.proxies.filter:content add missing: 3561 (0.0835)
ERROR:swh.storage.proxies.filter:content added in 14.1030
ERROR:swh.storage.proxies.filter:CSV:content;3561;0.0835;3561;14.1030
ERROR:swh.storage.proxies.filter:content add entry count: 1773
ERROR:swh.storage.proxies.filter:content add missing: 1773 (0.0443)
ERROR:swh.storage.proxies.filter:content added in 14.2272
ERROR:swh.storage.proxies.filter:CSV:content;1773;0.0443;1773;14.2272
ERROR:swh.storage.proxies.filter:content add entry count: 2343
ERROR:swh.storage.proxies.filter:content add missing: 2343 (0.0572)
ERROR:swh.storage.proxies.filter:content added in 12.6461
ERROR:swh.storage.proxies.filter:CSV:content;2343;0.0572;2343;12.6461
ERROR:swh.storage.proxies.filter:content add entry count: 2973
ERROR:swh.storage.proxies.filter:content add missing: 2973 (0.0708)
ERROR:swh.storage.proxies.filter:content added in 11.8933
ERROR:swh.storage.proxies.filter:CSV:content;2973;0.0708;2973;11.8933
ERROR:swh.storage.proxies.filter:content add entry count: 6980
ERROR:swh.storage.proxies.filter:content add missing: 6980 (0.1605)
ERROR:swh.storage.proxies.filter:content added in 27.5397
ERROR:swh.storage.proxies.filter:CSV:content;6980;0.1605;6980;27.5397
ERROR:swh.storage.proxies.filter:content add entry count: 5271
ERROR:swh.storage.proxies.filter:content add missing: 5271 (0.1214)
ERROR:swh.storage.proxies.filter:content added in 23.9411
ERROR:swh.storage.proxies.filter:CSV:content;5271;0.1214;5271;23.9411
ERROR:swh.storage.proxies.filter:content add entry count: 3264
ERROR:swh.storage.proxies.filter:content add missing: 3264 (0.0766)
ERROR:swh.storage.proxies.filter:content added in 13.3309
ERROR:swh.storage.proxies.filter:CSV:content;3264;0.0766;3264;13.3309
ERROR:swh.storage.proxies.filter:content add entry count: 1370
ERROR:swh.storage.proxies.filter:content add missing: 1370 (0.0355)
ERROR:swh.storage.proxies.filter:content added in 8.8437
ERROR:swh.storage.proxies.filter:CSV:content;1370;0.0355;1370;8.8437
ERROR:swh.storage.proxies.filter:content add entry count: 926
ERROR:swh.storage.proxies.filter:content add missing: 926 (0.0256)
ERROR:swh.storage.proxies.filter:content added in 6.4535
ERROR:swh.storage.proxies.filter:CSV:content;926;0.0256;926;6.4535
ERROR:swh.storage.proxies.filter:content add entry count: 1524
ERROR:swh.storage.proxies.filter:content add missing: 1524 (0.0421)
ERROR:swh.storage.proxies.filter:content added in 7.2701
ERROR:swh.storage.proxies.filter:CSV:content;1524;0.0421;1524;7.2701
ERROR:swh.storage.proxies.filter:content add entry count: 617
ERROR:swh.storage.proxies.filter:content add missing: 617 (0.0206)
ERROR:swh.storage.proxies.filter:content added in 6.0040
ERROR:swh.storage.proxies.filter:CSV:content;617;0.0206;617;6.0040
ERROR:swh.storage.proxies.filter:content add entry count: 2612
ERROR:swh.storage.proxies.filter:content add missing: 2612 (0.0629)
ERROR:swh.storage.proxies.filter:content added in 13.0142
ERROR:swh.storage.proxies.filter:CSV:content;2612;0.0629;2612;13.0142
ERROR:swh.storage.proxies.filter:content add entry count: 2208
ERROR:swh.storage.proxies.filter:content add missing: 2208 (0.0539)
ERROR:swh.storage.proxies.filter:content added in 9.6401
ERROR:swh.storage.proxies.filter:CSV:content;2208;0.0539;2208;9.6401
ERROR:swh.storage.proxies.filter:content add entry count: 2197
ERROR:swh.storage.proxies.filter:content add missing: 2197 (0.0537)
ERROR:swh.storage.proxies.filter:content added in 12.1084
ERROR:swh.storage.proxies.filter:CSV:content;2197;0.0537;2197;12.1084
ERROR:swh.storage.proxies.filter:content add entry count: 2373
ERROR:swh.storage.proxies.filter:content add missing: 2373 (0.0657)
ERROR:swh.storage.proxies.filter:content added in 10.5975
ERROR:swh.storage.proxies.filter:CSV:content;2373;0.0657;2373;10.5975
ERROR:swh.storage.proxies.filter:content add entry count: 2930
ERROR:swh.storage.proxies.filter:content add missing: 2930 (0.0878)
ERROR:swh.storage.proxies.filter:content added in 14.0587
ERROR:swh.storage.proxies.filter:CSV:content;2930;0.0878;2930;14.0587
ERROR:swh.storage.proxies.filter:content add entry count: 2125
ERROR:swh.storage.proxies.filter:content add missing: 2125 (0.0528)
ERROR:swh.storage.proxies.filter:content added in 11.1318
ERROR:swh.storage.proxies.filter:CSV:content;2125;0.0528;2125;11.1318
ERROR:swh.storage.proxies.filter:content add entry count: 3206
ERROR:swh.storage.proxies.filter:content add missing: 3206 (0.0768)
ERROR:swh.storage.proxies.filter:content added in 13.7907
ERROR:swh.storage.proxies.filter:CSV:content;3206;0.0768;3206;13.7907
ERROR:swh.storage.proxies.filter:content add entry count: 3446
ERROR:swh.storage.proxies.filter:content add missing: 3446 (0.0846)
ERROR:swh.storage.proxies.filter:content added in 15.0482
ERROR:swh.storage.proxies.filter:CSV:content;3446;0.0846;3446;15.0482
ERROR:swh.storage.proxies.filter:content add entry count: 3459
ERROR:swh.storage.proxies.filter:content add missing: 3459 (0.0814)
ERROR:swh.storage.proxies.filter:content added in 15.3340
ERROR:swh.storage.proxies.filter:CSV:content;3459;0.0814;3459;15.3340
ERROR:swh.storage.proxies.filter:content add entry count: 5487
ERROR:swh.storage.proxies.filter:content add missing: 5487 (0.1271)
ERROR:swh.storage.proxies.filter:content added in 21.4459
ERROR:swh.storage.proxies.filter:CSV:content;5487;0.1271;5487;21.4459
ERROR:swh.storage.proxies.filter:content add entry count: 4110
ERROR:swh.storage.proxies.filter:content add missing: 4110 (0.0979)
ERROR:swh.storage.proxies.filter:content added in 18.5613
ERROR:swh.storage.proxies.filter:CSV:content;4110;0.0979;4110;18.5613
ERROR:swh.storage.proxies.filter:content add entry count: 2360
ERROR:swh.storage.proxies.filter:content add missing: 2360 (0.0584)
ERROR:swh.storage.proxies.filter:content added in 10.2814
ERROR:swh.storage.proxies.filter:CSV:content;2360;0.0584;2360;10.2814
ERROR:swh.storage.proxies.filter:content add entry count: 2873
ERROR:swh.storage.proxies.filter:content add missing: 2873 (0.0696)
ERROR:swh.storage.proxies.filter:content added in 14.7849
ERROR:swh.storage.proxies.filter:CSV:content;2873;0.0696;2873;14.7849
ERROR:swh.storage.proxies.filter:content add entry count: 673
ERROR:swh.storage.proxies.filter:content add missing: 673 (0.0202)
ERROR:swh.storage.proxies.filter:content added in 5.2541
ERROR:swh.storage.proxies.filter:CSV:content;673;0.0202;673;5.2541
ERROR:swh.storage.proxies.filter:content add entry count: 1031
ERROR:swh.storage.proxies.filter:content add missing: 1031 (0.0289)
ERROR:swh.storage.proxies.filter:content added in 6.2093
ERROR:swh.storage.proxies.filter:CSV:content;1031;0.0289;1031;6.2093
ERROR:swh.storage.proxies.filter:content add entry count: 1794
ERROR:swh.storage.proxies.filter:content add missing: 1794 (0.0522)
ERROR:swh.storage.proxies.filter:content added in 9.9726
ERROR:swh.storage.proxies.filter:CSV:content;1794;0.0522;1794;9.9726
ERROR:swh.storage.proxies.filter:content add entry count: 2617
ERROR:swh.storage.proxies.filter:content add missing: 2617 (0.0689)
ERROR:swh.storage.proxies.filter:content added in 11.4775
ERROR:swh.storage.proxies.filter:CSV:content;2617;0.0689;2617;11.4775
ERROR:swh.storage.proxies.filter:content add entry count: 2457
ERROR:swh.storage.proxies.filter:content add missing: 2457 (0.0597)
ERROR:swh.storage.proxies.filter:content added in 12.0929
ERROR:swh.storage.proxies.filter:CSV:content;2457;0.0597;2457;12.0929
ERROR:swh.storage.proxies.filter:content add entry count: 2135
ERROR:swh.storage.proxies.filter:content add missing: 2135 (0.0513)
ERROR:swh.storage.proxies.filter:content added in 11.7648
ERROR:swh.storage.proxies.filter:CSV:content;2135;0.0513;2135;11.7648
ERROR:swh.storage.proxies.filter:content add entry count: 2361
ERROR:swh.storage.proxies.filter:content add missing: 2361 (0.0563)
ERROR:swh.storage.proxies.filter:content added in 9.9750
ERROR:swh.storage.proxies.filter:CSV:content;2361;0.0563;2361;9.9750
ERROR:swh.storage.proxies.filter:content add entry count: 3213
ERROR:swh.storage.proxies.filter:content add missing: 3213 (0.0777)
ERROR:swh.storage.proxies.filter:content added in 16.2620
ERROR:swh.storage.proxies.filter:CSV:content;3213;0.0777;3213;16.2620
ERROR:swh.storage.proxies.filter:content add entry count: 3129
ERROR:swh.storage.proxies.filter:content add missing: 3129 (0.0777)
ERROR:swh.storage.proxies.filter:content added in 12.8858
ERROR:swh.storage.proxies.filter:CSV:content;3129;0.0777;3129;12.8858
ERROR:swh.storage.proxies.filter:content add entry count: 1260
ERROR:swh.storage.proxies.filter:content add missing: 1260 (0.0341)
ERROR:swh.storage.proxies.filter:content added in 8.1968
ERROR:swh.storage.proxies.filter:CSV:content;1260;0.0341;1260;8.1968
ERROR:swh.storage.proxies.filter:content add entry count: 186
ERROR:swh.storage.proxies.filter:content add missing: 186 (0.0090)
ERROR:swh.storage.proxies.filter:content added in 3.6993
ERROR:swh.storage.proxies.filter:CSV:content;186;0.0090;186;3.6993
ERROR:swh.storage.proxies.filter:content add entry count: 188
ERROR:swh.storage.proxies.filter:content add missing: 188 (0.0088)
ERROR:swh.storage.proxies.filter:content added in 3.5935
ERROR:swh.storage.proxies.filter:CSV:content;188;0.0088;188;3.5935
ERROR:swh.storage.proxies.filter:content add entry count: 3034
ERROR:swh.storage.proxies.filter:content add missing: 3034 (0.0736)
ERROR:swh.storage.proxies.filter:content added in 12.1945
ERROR:swh.storage.proxies.filter:CSV:content;3034;0.0736;3034;12.1945
ERROR:swh.storage.proxies.filter:content add entry count: 3004
ERROR:swh.storage.proxies.filter:content add missing: 3004 (0.0820)
ERROR:swh.storage.proxies.filter:content added in 12.3487
ERROR:swh.storage.proxies.filter:CSV:content;3004;0.0820;3004;12.3487
ERROR:swh.storage.proxies.filter:content add entry count: 1456
ERROR:swh.storage.proxies.filter:content add missing: 1456 (0.0383)
ERROR:swh.storage.proxies.filter:content added in 8.5978
ERROR:swh.storage.proxies.filter:CSV:content;1456;0.0383;1456;8.5978
ERROR:swh.storage.proxies.filter:content add entry count: 3282
ERROR:swh.storage.proxies.filter:content add missing: 3282 (0.0913)
ERROR:swh.storage.proxies.filter:content added in 21.1444
ERROR:swh.storage.proxies.filter:CSV:content;3282;0.0913;3282;21.1444
ERROR:swh.storage.proxies.filter:content add entry count: 2691
ERROR:swh.storage.proxies.filter:content add missing: 2691 (0.0770)
ERROR:swh.storage.proxies.filter:content added in 11.1932
ERROR:swh.storage.proxies.filter:CSV:content;2691;0.0770;2691;11.1932
ERROR:swh.storage.proxies.filter:content add entry count: 3406
ERROR:swh.storage.proxies.filter:content add missing: 3406 (0.0840)
ERROR:swh.storage.proxies.filter:content added in 16.7548
ERROR:swh.storage.proxies.filter:CSV:content;3406;0.0840;3406;16.7548
ERROR:swh.storage.proxies.filter:content add entry count: 1932
ERROR:swh.storage.proxies.filter:content add missing: 1932 (0.0489)
ERROR:swh.storage.proxies.filter:content added in 8.9167
ERROR:swh.storage.proxies.filter:CSV:content;1932;0.0489;1932;8.9167
ERROR:swh.storage.proxies.filter:content add entry count: 1787
ERROR:swh.storage.proxies.filter:content add missing: 1787 (0.0468)
ERROR:swh.storage.proxies.filter:content added in 10.3362
ERROR:swh.storage.proxies.filter:CSV:content;1787;0.0468;1787;10.3362
ERROR:swh.storage.proxies.filter:content add entry count: 3501
ERROR:swh.storage.proxies.filter:content add missing: 3501 (0.0893)
ERROR:swh.storage.proxies.filter:content added in 15.2466
ERROR:swh.storage.proxies.filter:CSV:content;3501;0.0893;3501;15.2466
ERROR:swh.storage.proxies.filter:content add entry count: 560
ERROR:swh.storage.proxies.filter:content add missing: 560 (0.0189)
ERROR:swh.storage.proxies.filter:content added in 5.1071
ERROR:swh.storage.proxies.filter:CSV:content;560;0.0189;560;5.1071
ERROR:swh.storage.proxies.filter:content add entry count: 294
ERROR:swh.storage.proxies.filter:content add missing: 294 (0.0113)
ERROR:swh.storage.proxies.filter:content added in 4.4833
ERROR:swh.storage.proxies.filter:CSV:content;294;0.0113;294;4.4833
ERROR:swh.storage.proxies.filter:content add entry count: 3095
ERROR:swh.storage.proxies.filter:content add missing: 3095 (0.0836)
ERROR:swh.storage.proxies.filter:content added in 15.2504
ERROR:swh.storage.proxies.filter:CSV:content;3095;0.0836;3095;15.2504
ERROR:swh.storage.proxies.filter:content add entry count: 3139
ERROR:swh.storage.proxies.filter:content add missing: 3139 (0.0773)
ERROR:swh.storage.proxies.filter:content added in 13.2836
ERROR:swh.storage.proxies.filter:CSV:content;3139;0.0773;3139;13.2836
ERROR:swh.storage.proxies.filter:content add entry count: 1756
ERROR:swh.storage.proxies.filter:content add missing: 1756 (0.0451)
ERROR:swh.storage.proxies.filter:content added in 10.5687
ERROR:swh.storage.proxies.filter:CSV:content;1756;0.0451;1756;10.5687
ERROR:swh.storage.proxies.filter:content add entry count: 1798
ERROR:swh.storage.proxies.filter:content add missing: 1798 (0.0457)
ERROR:swh.storage.proxies.filter:content added in 8.6022
ERROR:swh.storage.proxies.filter:CSV:content;1798;0.0457;1798;8.6022
ERROR:swh.storage.proxies.filter:content add entry count: 856
ERROR:swh.storage.proxies.filter:content add missing: 856 (0.0244)
ERROR:swh.storage.proxies.filter:content added in 6.1521
ERROR:swh.storage.proxies.filter:CSV:content;856;0.0244;856;6.1521
ERROR:swh.storage.proxies.filter:content add entry count: 7691
ERROR:swh.storage.proxies.filter:content add missing: 7691 (0.1820)
ERROR:swh.storage.proxies.filter:content added in 33.5827
ERROR:swh.storage.proxies.filter:CSV:content;7691;0.1820;7691;33.5827
ERROR:swh.storage.proxies.filter:content add entry count: 9045
ERROR:swh.storage.proxies.filter:content add missing: 9045 (0.2078)
ERROR:swh.storage.proxies.filter:content added in 35.9234
ERROR:swh.storage.proxies.filter:CSV:content;9045;0.2078;9045;35.9234
ERROR:swh.storage.proxies.filter:content add entry count: 8873
ERROR:swh.storage.proxies.filter:content add missing: 8873 (0.2059)
ERROR:swh.storage.proxies.filter:content added in 32.4393
ERROR:swh.storage.proxies.filter:CSV:content;8873;0.2059;8873;32.4393
ERROR:swh.storage.proxies.filter:content add entry count: 10000
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2325)
ERROR:swh.storage.proxies.filter:content added in 39.7253
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2325;10000;39.7253
ERROR:swh.storage.proxies.filter:content add entry count: 6327
ERROR:swh.storage.proxies.filter:content add missing: 6327 (0.1521)
ERROR:swh.storage.proxies.filter:content added in 25.7800
ERROR:swh.storage.proxies.filter:CSV:content;6327;0.1521;6327;25.7800
ERROR:swh.storage.proxies.filter:content add entry count: 5105
ERROR:swh.storage.proxies.filter:content add missing: 5105 (0.1180)
ERROR:swh.storage.proxies.filter:content added in 23.4977
ERROR:swh.storage.proxies.filter:CSV:content;5105;0.1180;5105;23.4977
ERROR:swh.storage.proxies.filter:content add entry count: 2728
ERROR:swh.storage.proxies.filter:content add missing: 2728 (0.0687)
ERROR:swh.storage.proxies.filter:content added in 11.5246
ERROR:swh.storage.proxies.filter:CSV:content;2728;0.0687;2728;11.5246
ERROR:swh.storage.proxies.filter:content add entry count: 3095
ERROR:swh.storage.proxies.filter:content add missing: 3095 (0.0750)
ERROR:swh.storage.proxies.filter:content added in 15.5819
ERROR:swh.storage.proxies.filter:CSV:content;3095;0.0750;3095;15.5819
ERROR:swh.storage.proxies.filter:content add entry count: 4156
ERROR:swh.storage.proxies.filter:content add missing: 4156 (0.0996)
ERROR:swh.storage.proxies.filter:content added in 16.5365
ERROR:swh.storage.proxies.filter:CSV:content;4156;0.0996;4156;16.5365
ERROR:swh.storage.proxies.filter:content add entry count: 3238
ERROR:swh.storage.proxies.filter:content add missing: 3238 (0.0782)
ERROR:swh.storage.proxies.filter:content added in 14.6530
ERROR:swh.storage.proxies.filter:CSV:content;3238;0.0782;3238;14.6530
ERROR:swh.storage.proxies.filter:content add entry count: 4357
ERROR:swh.storage.proxies.filter:content add missing: 4357 (0.1053)
ERROR:swh.storage.proxies.filter:content added in 19.0138
ERROR:swh.storage.proxies.filter:CSV:content;4357;0.1053;4357;19.0138
ERROR:swh.storage.proxies.filter:content add entry count: 4857
ERROR:swh.storage.proxies.filter:content add missing: 4857 (0.1140)
ERROR:swh.storage.proxies.filter:content added in 19.0600
ERROR:swh.storage.proxies.filter:CSV:content;4857;0.1140;4857;19.0600
ERROR:swh.storage.proxies.filter:content add entry count: 2642
ERROR:swh.storage.proxies.filter:content add missing: 2642 (0.0680)
ERROR:swh.storage.proxies.filter:content added in 13.4870
ERROR:swh.storage.proxies.filter:CSV:content;2642;0.0680;2642;13.4870
ERROR:swh.storage.proxies.filter:content add entry count: 3883
ERROR:swh.storage.proxies.filter:content add missing: 3883 (0.1043)
ERROR:swh.storage.proxies.filter:content added in 18.4715
ERROR:swh.storage.proxies.filter:CSV:content;3883;0.1043;3883;18.4715
ERROR:swh.storage.proxies.filter:content add entry count: 543
ERROR:swh.storage.proxies.filter:content add missing: 543 (0.0181)
ERROR:swh.storage.proxies.filter:content added in 5.4972
ERROR:swh.storage.proxies.filter:CSV:content;543;0.0181;543;5.4972
ERROR:swh.storage.proxies.filter:content add entry count: 1466
ERROR:swh.storage.proxies.filter:content add missing: 1466 (0.0419)
ERROR:swh.storage.proxies.filter:content added in 8.4660
ERROR:swh.storage.proxies.filter:CSV:content;1466;0.0419;1466;8.4660
ERROR:swh.storage.proxies.filter:content add entry count: 3064
ERROR:swh.storage.proxies.filter:content add missing: 3064 (0.0758)
ERROR:swh.storage.proxies.filter:content added in 13.4207
ERROR:swh.storage.proxies.filter:CSV:content;3064;0.0758;3064;13.4207
ERROR:swh.storage.proxies.filter:content add entry count: 2348
ERROR:swh.storage.proxies.filter:content add missing: 2348 (0.0655)
ERROR:swh.storage.proxies.filter:content added in 12.8113
ERROR:swh.storage.proxies.filter:CSV:content;2348;0.0655;2348;12.8113
ERROR:swh.storage.proxies.filter:content add entry count: 1949
ERROR:swh.storage.proxies.filter:content add missing: 1949 (0.0507)
ERROR:swh.storage.proxies.filter:content added in 8.3845
ERROR:swh.storage.proxies.filter:CSV:content;1949;0.0507;1949;8.3845
ERROR:swh.storage.proxies.filter:content add entry count: 2558
ERROR:swh.storage.proxies.filter:content add missing: 2558 (0.0806)
ERROR:swh.storage.proxies.filter:content added in 10.6928
ERROR:swh.storage.proxies.filter:CSV:content;2558;0.0806;2558;10.6928
ERROR:swh.storage.proxies.filter:content add entry count: 3144
ERROR:swh.storage.proxies.filter:content add missing: 3144 (0.0796)
ERROR:swh.storage.proxies.filter:content added in 12.2167
ERROR:swh.storage.proxies.filter:CSV:content;3144;0.0796;3144;12.2167
ERROR:swh.storage.proxies.filter:content add entry count: 3291
ERROR:swh.storage.proxies.filter:content add missing: 3291 (0.0803)
ERROR:swh.storage.proxies.filter:content added in 13.4339
ERROR:swh.storage.proxies.filter:CSV:content;3291;0.0803;3291;13.4339
ERROR:swh.storage.proxies.filter:content add entry count: 3922
ERROR:swh.storage.proxies.filter:content add missing: 3922 (0.0949)
ERROR:swh.storage.proxies.filter:content added in 18.2035
ERROR:swh.storage.proxies.filter:CSV:content;3922;0.0949;3922;18.2035
ERROR:swh.storage.proxies.filter:content add entry count: 2190
ERROR:swh.storage.proxies.filter:content add missing: 2190 (0.0550)
ERROR:swh.storage.proxies.filter:content added in 11.9000
ERROR:swh.storage.proxies.filter:CSV:content;2190;0.0550;2190;11.9000
ERROR:swh.storage.proxies.filter:content add entry count: 1837
ERROR:swh.storage.proxies.filter:content add missing: 1837 (0.0472)
ERROR:swh.storage.proxies.filter:content added in 10.1769
ERROR:swh.storage.proxies.filter:CSV:content;1837;0.0472;1837;10.1769
ERROR:swh.storage.proxies.filter:content add entry count: 3672
ERROR:swh.storage.proxies.filter:content add missing: 3672 (0.0884)
ERROR:swh.storage.proxies.filter:content added in 15.3722
ERROR:swh.storage.proxies.filter:CSV:content;3672;0.0884;3672;15.3722
ERROR:swh.storage.proxies.filter:content add entry count: 2228
ERROR:swh.storage.proxies.filter:content add missing: 2228 (0.0559)
ERROR:swh.storage.proxies.filter:content added in 11.7918
ERROR:swh.storage.proxies.filter:CSV:content;2228;0.0559;2228;11.7918
ERROR:swh.storage.proxies.filter:content add entry count: 4364
ERROR:swh.storage.proxies.filter:content add missing: 4364 (0.1085)
ERROR:swh.storage.proxies.filter:content added in 15.6812
ERROR:swh.storage.proxies.filter:CSV:content;4364;0.1085;4364;15.6812
ERROR:swh.storage.proxies.filter:content add entry count: 4863
ERROR:swh.storage.proxies.filter:content add missing: 4863 (0.1256)
ERROR:swh.storage.proxies.filter:content added in 20.8732
ERROR:swh.storage.proxies.filter:CSV:content;4863;0.1256;4863;20.8732
ERROR:swh.storage.proxies.filter:content add entry count: 3768
ERROR:swh.storage.proxies.filter:content add missing: 3768 (0.0889)
ERROR:swh.storage.proxies.filter:content added in 18.4332
ERROR:swh.storage.proxies.filter:CSV:content;3768;0.0889;3768;18.4332
ERROR:swh.storage.proxies.filter:content add entry count: 1571
ERROR:swh.storage.proxies.filter:content add missing: 1571 (0.0408)
ERROR:swh.storage.proxies.filter:content added in 7.4938
ERROR:swh.storage.proxies.filter:CSV:content;1571;0.0408;1571;7.4938
ERROR:swh.storage.proxies.filter:content add entry count: 3400
ERROR:swh.storage.proxies.filter:content add missing: 3400 (0.1007)
ERROR:swh.storage.proxies.filter:content added in 16.4075
ERROR:swh.storage.proxies.filter:CSV:content;3400;0.1007;3400;16.4075
ERROR:swh.storage.proxies.filter:content add entry count: 8424
ERROR:swh.storage.proxies.filter:content add missing: 8424 (0.2008)
ERROR:swh.storage.proxies.filter:content added in 34.2184
ERROR:swh.storage.proxies.filter:CSV:content;8424;0.2008;8424;34.2184
ERROR:swh.storage.proxies.filter:content add entry count: 4889
ERROR:swh.storage.proxies.filter:content add missing: 4889 (0.1169)
ERROR:swh.storage.proxies.filter:content added in 19.9810
ERROR:swh.storage.proxies.filter:CSV:content;4889;0.1169;4889;19.9810
ERROR:swh.storage.proxies.filter:content add entry count: 3966
ERROR:swh.storage.proxies.filter:content add missing: 3966 (0.0960)
ERROR:swh.storage.proxies.filter:content added in 16.2987
ERROR:swh.storage.proxies.filter:CSV:content;3966;0.0960;3966;16.2987
ERROR:swh.storage.proxies.filter:content add entry count: 3815
ERROR:swh.storage.proxies.filter:content add missing: 3815 (0.0889)
ERROR:swh.storage.proxies.filter:content added in 18.6155
ERROR:swh.storage.proxies.filter:CSV:content;3815;0.0889;3815;18.6155
ERROR:swh.storage.proxies.filter:content add entry count: 4438
ERROR:swh.storage.proxies.filter:content add missing: 4438 (0.1079)
ERROR:swh.storage.proxies.filter:content added in 18.1804
ERROR:swh.storage.proxies.filter:CSV:content;4438;0.1079;4438;18.1804
ERROR:swh.storage.proxies.filter:content add entry count: 3244
ERROR:swh.storage.proxies.filter:content add missing: 3244 (0.0790)
ERROR:swh.storage.proxies.filter:content added in 15.3142
ERROR:swh.storage.proxies.filter:CSV:content;3244;0.0790;3244;15.3142
ERROR:swh.storage.proxies.filter:content add entry count: 4092
ERROR:swh.storage.proxies.filter:content add missing: 4092 (0.0985)
ERROR:swh.storage.proxies.filter:content added in 17.4734
ERROR:swh.storage.proxies.filter:CSV:content;4092;0.0985;4092;17.4734
ERROR:swh.storage.proxies.filter:content add entry count: 3422
ERROR:swh.storage.proxies.filter:content add missing: 3422 (0.0836)
ERROR:swh.storage.proxies.filter:content added in 14.1247
ERROR:swh.storage.proxies.filter:CSV:content;3422;0.0836;3422;14.1247
ERROR:swh.storage.proxies.filter:content add entry count: 8495
ERROR:swh.storage.proxies.filter:content add missing: 8495 (0.2179)
ERROR:swh.storage.proxies.filter:content added in 34.2162
ERROR:swh.storage.proxies.filter:CSV:content;8495;0.2179;8495;34.2162
ERROR:swh.storage.proxies.filter:content add entry count: 4300
ERROR:swh.storage.proxies.filter:content add missing: 4300 (0.1028)
ERROR:swh.storage.proxies.filter:content added in 17.7586
ERROR:swh.storage.proxies.filter:CSV:content;4300;0.1028;4300;17.7586
ERROR:swh.storage.proxies.filter:content add entry count: 3104
ERROR:swh.storage.proxies.filter:content add missing: 3104 (0.0751)
ERROR:swh.storage.proxies.filter:content added in 16.9942
ERROR:swh.storage.proxies.filter:CSV:content;3104;0.0751;3104;16.9942
ERROR:swh.storage.proxies.filter:content add entry count: 3094
ERROR:swh.storage.proxies.filter:content add missing: 3094 (0.0746)
ERROR:swh.storage.proxies.filter:content added in 14.1906
ERROR:swh.storage.proxies.filter:CSV:content;3094;0.0746;3094;14.1906
ERROR:swh.storage.proxies.filter:content add entry count: 2079
ERROR:swh.storage.proxies.filter:content add missing: 2079 (0.0517)
ERROR:swh.storage.proxies.filter:content added in 8.8562
ERROR:swh.storage.proxies.filter:CSV:content;2079;0.0517;2079;8.8562
ERROR:swh.storage.proxies.filter:content add entry count: 2234
ERROR:swh.storage.proxies.filter:content add missing: 2234 (0.0550)
ERROR:swh.storage.proxies.filter:content added in 9.4658
ERROR:swh.storage.proxies.filter:CSV:content;2234;0.0550;2234;9.4658
ERROR:swh.storage.proxies.filter:content add entry count: 1666
ERROR:swh.storage.proxies.filter:content add missing: 1666 (0.0421)
ERROR:swh.storage.proxies.filter:content added in 8.9195
ERROR:swh.storage.proxies.filter:CSV:content;1666;0.0421;1666;8.9195
ERROR:swh.storage.proxies.filter:content add entry count: 1216
ERROR:swh.storage.proxies.filter:content add missing: 1216 (0.0318)
ERROR:swh.storage.proxies.filter:content added in 6.7581
ERROR:swh.storage.proxies.filter:CSV:content;1216;0.0318;1216;6.7581
ERROR:swh.storage.proxies.filter:content add entry count: 520
ERROR:swh.storage.proxies.filter:content add missing: 520 (0.0175)
ERROR:swh.storage.proxies.filter:content added in 6.1912
ERROR:swh.storage.proxies.filter:CSV:content;520;0.0175;520;6.1912
ERROR:swh.storage.proxies.filter:content add entry count: 2532
ERROR:swh.storage.proxies.filter:content add missing: 2532 (0.0629)
ERROR:swh.storage.proxies.filter:content added in 13.2082
ERROR:swh.storage.proxies.filter:CSV:content;2532;0.0629;2532;13.2082
ERROR:swh.storage.proxies.filter:content add entry count: 2871
ERROR:swh.storage.proxies.filter:content add missing: 2871 (0.0688)
ERROR:swh.storage.proxies.filter:content added in 12.5708
ERROR:swh.storage.proxies.filter:CSV:content;2871;0.0688;2871;12.5708
ERROR:swh.storage.proxies.filter:content add entry count: 6340
ERROR:swh.storage.proxies.filter:content add missing: 6340 (0.1521)
ERROR:swh.storage.proxies.filter:content added in 25.6609
ERROR:swh.storage.proxies.filter:CSV:content;6340;0.1521;6340;25.6609
ERROR:swh.storage.proxies.filter:content add entry count: 7566
ERROR:swh.storage.proxies.filter:content add missing: 7566 (0.1817)
ERROR:swh.storage.proxies.filter:content added in 28.1773
ERROR:swh.storage.proxies.filter:CSV:content;7566;0.1817;7566;28.1773
ERROR:swh.storage.proxies.filter:content add entry count: 2455
ERROR:swh.storage.proxies.filter:content add missing: 2455 (0.0605)
ERROR:swh.storage.proxies.filter:content added in 13.3951
ERROR:swh.storage.proxies.filter:CSV:content;2455;0.0605;2455;13.3951
ERROR:swh.storage.proxies.filter:content add entry count: 2593
ERROR:swh.storage.proxies.filter:content add missing: 2593 (0.0837)
ERROR:swh.storage.proxies.filter:content added in 10.5106
ERROR:swh.storage.proxies.filter:CSV:content;2593;0.0837;2593;10.5106
ERROR:swh.storage.proxies.filter:content add entry count: 925
ERROR:swh.storage.proxies.filter:content add missing: 925 (0.0343)
ERROR:swh.storage.proxies.filter:content added in 6.4646
ERROR:swh.storage.proxies.filter:CSV:content;925;0.0343;925;6.4646
ERROR:swh.storage.proxies.filter:content add entry count: 1226
ERROR:swh.storage.proxies.filter:content add missing: 1226 (0.0334)
ERROR:swh.storage.proxies.filter:content added in 7.4976
ERROR:swh.storage.proxies.filter:CSV:content;1226;0.0334;1226;7.4976
ERROR:swh.storage.proxies.filter:content add entry count: 3559
ERROR:swh.storage.proxies.filter:content add missing: 3559 (0.0865)
ERROR:swh.storage.proxies.filter:content added in 16.7678
ERROR:swh.storage.proxies.filter:CSV:content;3559;0.0865;3559;16.7678
ERROR:swh.storage.proxies.filter:content add entry count: 1875
ERROR:swh.storage.proxies.filter:content add missing: 1875 (0.0566)
ERROR:swh.storage.proxies.filter:content added in 10.6722
ERROR:swh.storage.proxies.filter:CSV:content;1875;0.0566;1875;10.6722
ERROR:swh.storage.proxies.filter:content add entry count: 2863
ERROR:swh.storage.proxies.filter:content add missing: 2863 (0.0753)
ERROR:swh.storage.proxies.filter:content added in 14.3983
ERROR:swh.storage.proxies.filter:CSV:content;2863;0.0753;2863;14.3983
ERROR:swh.storage.proxies.filter:content add entry count: 4043
ERROR:swh.storage.proxies.filter:content add missing: 4043 (0.0985)
ERROR:swh.storage.proxies.filter:content added in 17.3274
ERROR:swh.storage.proxies.filter:CSV:content;4043;0.0985;4043;17.3274
ERROR:swh.storage.proxies.filter:content add entry count: 4536
ERROR:swh.storage.proxies.filter:content add missing: 4536 (0.1178)
ERROR:swh.storage.proxies.filter:content added in 18.7659
ERROR:swh.storage.proxies.filter:CSV:content;4536;0.1178;4536;18.7659
ERROR:swh.storage.proxies.filter:content add entry count: 3633
ERROR:swh.storage.proxies.filter:content add missing: 3633 (0.1163)
ERROR:swh.storage.proxies.filter:content added in 17.8600
ERROR:swh.storage.proxies.filter:CSV:content;3633;0.1163;3633;17.8600
ERROR:swh.storage.proxies.filter:content add entry count: 4424
ERROR:swh.storage.proxies.filter:content add missing: 4424 (0.1061)
ERROR:swh.storage.proxies.filter:content added in 16.8019
ERROR:swh.storage.proxies.filter:CSV:content;4424;0.1061;4424;16.8019
ERROR:swh.storage.proxies.filter:content add entry count: 3363
ERROR:swh.storage.proxies.filter:content add missing: 3363 (0.0827)
ERROR:swh.storage.proxies.filter:content added in 15.5654
ERROR:swh.storage.proxies.filter:CSV:content;3363;0.0827;3363;15.5654
ERROR:swh.storage.proxies.filter:content add entry count: 2004
ERROR:swh.storage.proxies.filter:content add missing: 2004 (0.0521)
ERROR:swh.storage.proxies.filter:content added in 9.3738
ERROR:swh.storage.proxies.filter:CSV:content;2004;0.0521;2004;9.3738
ERROR:swh.storage.proxies.filter:content add entry count: 4220
ERROR:swh.storage.proxies.filter:content add missing: 4220 (0.1032)
ERROR:swh.storage.proxies.filter:content added in 20.1449
ERROR:swh.storage.proxies.filter:CSV:content;4220;0.1032;4220;20.1449
ERROR:swh.storage.proxies.filter:content add entry count: 3673
ERROR:swh.storage.proxies.filter:content add missing: 3673 (0.0909)
ERROR:swh.storage.proxies.filter:content added in 15.2053
ERROR:swh.storage.proxies.filter:CSV:content;3673;0.0909;3673;15.2053
ERROR:swh.storage.proxies.filter:content add entry count: 4452
ERROR:swh.storage.proxies.filter:content add missing: 4452 (0.1067)
ERROR:swh.storage.proxies.filter:content added in 18.3396
ERROR:swh.storage.proxies.filter:CSV:content;4452;0.1067;4452;18.3396
ERROR:swh.storage.proxies.filter:content add entry count: 1313
ERROR:swh.storage.proxies.filter:content add missing: 1313 (0.0350)
ERROR:swh.storage.proxies.filter:content added in 9.1045
ERROR:swh.storage.proxies.filter:CSV:content;1313;0.0350;1313;9.1045
ERROR:swh.storage.proxies.filter:content add entry count: 1834
ERROR:swh.storage.proxies.filter:content add missing: 1834 (0.0470)
ERROR:swh.storage.proxies.filter:content added in 11.1109
ERROR:swh.storage.proxies.filter:CSV:content;1834;0.0470;1834;11.1109
ERROR:swh.storage.proxies.filter:content add entry count: 2727
ERROR:swh.storage.proxies.filter:content add missing: 2727 (0.0670)
ERROR:swh.storage.proxies.filter:content added in 11.2160
ERROR:swh.storage.proxies.filter:CSV:content;2727;0.0670;2727;11.2160
ERROR:swh.storage.proxies.filter:content add entry count: 4501
ERROR:swh.storage.proxies.filter:content add missing: 4501 (0.1074)
ERROR:swh.storage.proxies.filter:content added in 18.2607
ERROR:swh.storage.proxies.filter:CSV:content;4501;0.1074;4501;18.2607
ERROR:swh.storage.proxies.filter:content add entry count: 5759
ERROR:swh.storage.proxies.filter:content add missing: 5759 (0.1364)
ERROR:swh.storage.proxies.filter:content added in 29.4107
ERROR:swh.storage.proxies.filter:CSV:content;5759;0.1364;5759;29.4107
ERROR:swh.storage.proxies.filter:content add entry count: 5698
ERROR:swh.storage.proxies.filter:content add missing: 5698 (0.1450)
ERROR:swh.storage.proxies.filter:content added in 21.5681
ERROR:swh.storage.proxies.filter:CSV:content;5698;0.1450;5698;21.5681
ERROR:swh.storage.proxies.filter:content add entry count: 5937
ERROR:swh.storage.proxies.filter:content add missing: 5937 (0.1714)
ERROR:swh.storage.proxies.filter:content added in 24.2284
ERROR:swh.storage.proxies.filter:CSV:content;5937;0.1714;5937;24.2284
DEBUG:swh.loader.git.loader:packfile_read_count_blob=527467
ERROR:swh.storage.proxies.filter:content add entry count: 4903
ERROR:swh.storage.proxies.filter:content add missing: 4903 (0.1210)
ERROR:swh.storage.proxies.filter:content added in 19.5033
ERROR:swh.storage.proxies.filter:CSV:content;4903;0.1210;4903;19.5033
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0758)
ERROR:swh.storage.proxies.filter:directory added 37.0017
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0758;10000;37.0017
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0824)
ERROR:swh.storage.proxies.filter:directory added 29.9104
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0824;10000;29.9104
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0876)
ERROR:swh.storage.proxies.filter:directory added 20.7361
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0876;10000;20.7361
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0883)
ERROR:swh.storage.proxies.filter:directory added 50.9213
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0883;10000;50.9213
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0909)
ERROR:swh.storage.proxies.filter:directory added 46.6072
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0909;10000;46.6072
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0912)
ERROR:swh.storage.proxies.filter:directory added 54.5158
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0912;10000;54.5158
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0856)
ERROR:swh.storage.proxies.filter:directory added 62.5171
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0856;10000;62.5171
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0926)
ERROR:swh.storage.proxies.filter:directory added 107.4006
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0926;10000;107.4006
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0920)
ERROR:swh.storage.proxies.filter:directory added 40.7738
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0920;10000;40.7738
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0945)
ERROR:swh.storage.proxies.filter:directory added 50.1529
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0945;10000;50.1529
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0924)
ERROR:swh.storage.proxies.filter:directory added 37.4759
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0924;10000;37.4759
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0944)
ERROR:swh.storage.proxies.filter:directory added 254.0113
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0944;10000;254.0113
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0956)
ERROR:swh.storage.proxies.filter:directory added 101.9814
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0956;10000;101.9814
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0927)
ERROR:swh.storage.proxies.filter:directory added 37.3308
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0927;10000;37.3308
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0945)
ERROR:swh.storage.proxies.filter:directory added 82.9406
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0945;10000;82.9406
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0933)
ERROR:swh.storage.proxies.filter:directory added 28.5140
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0933;10000;28.5140
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0943)
ERROR:swh.storage.proxies.filter:directory added 37.6374
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0943;10000;37.6374
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0937)
ERROR:swh.storage.proxies.filter:directory added 44.8806
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0937;10000;44.8806
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0932)
ERROR:swh.storage.proxies.filter:directory added 31.2616
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0932;10000;31.2616
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0940)
ERROR:swh.storage.proxies.filter:directory added 65.1499
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0940;10000;65.1499
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0898)
ERROR:swh.storage.proxies.filter:directory added 58.4151
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0898;10000;58.4151
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0956)
ERROR:swh.storage.proxies.filter:directory added 144.3589
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0956;10000;144.3589
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0959)
ERROR:swh.storage.proxies.filter:directory added 29.7526
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0959;10000;29.7526
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0966)
ERROR:swh.storage.proxies.filter:directory added 86.5997
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0966;10000;86.5997
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0959)
ERROR:swh.storage.proxies.filter:directory added 32.8429
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0959;10000;32.8429
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0971)
ERROR:swh.storage.proxies.filter:directory added 34.1197
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0971;10000;34.1197
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0881)
ERROR:swh.storage.proxies.filter:directory added 76.4569
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0881;10000;76.4569
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0961)
ERROR:swh.storage.proxies.filter:directory added 38.1104
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0961;10000;38.1104
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1182)
ERROR:swh.storage.proxies.filter:directory added 43.5318
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1182;10000;43.5318
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0959)
ERROR:swh.storage.proxies.filter:directory added 70.8941
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0959;10000;70.8941
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0882)
ERROR:swh.storage.proxies.filter:directory added 50.7559
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0882;10000;50.7559
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0960)
ERROR:swh.storage.proxies.filter:directory added 36.0051
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0960;10000;36.0051
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0959)
ERROR:swh.storage.proxies.filter:directory added 19.2926
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0959;10000;19.2926
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0962)
ERROR:swh.storage.proxies.filter:directory added 71.7631
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0962;10000;71.7631
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0958)
ERROR:swh.storage.proxies.filter:directory added 24.2802
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0958;10000;24.2802
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0973)
ERROR:swh.storage.proxies.filter:directory added 83.2232
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0973;10000;83.2232
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0892)
ERROR:swh.storage.proxies.filter:directory added 24.4943
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0892;10000;24.4943
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0972)
ERROR:swh.storage.proxies.filter:directory added 27.8168
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0972;10000;27.8168
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0964)
ERROR:swh.storage.proxies.filter:directory added 24.6135
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0964;10000;24.6135
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0972)
ERROR:swh.storage.proxies.filter:directory added 28.8050
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0972;10000;28.8050
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0957)
ERROR:swh.storage.proxies.filter:directory added 27.5106
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0957;10000;27.5106
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0981)
ERROR:swh.storage.proxies.filter:directory added 25.1219
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0981;10000;25.1219
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0976)
ERROR:swh.storage.proxies.filter:directory added 77.5396
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0976;10000;77.5396
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1139)
ERROR:swh.storage.proxies.filter:directory added 24.9133
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1139;10000;24.9133
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0881)
ERROR:swh.storage.proxies.filter:directory added 24.0303
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0881;10000;24.0303
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1012)
ERROR:swh.storage.proxies.filter:directory added 20.1570
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1012;10000;20.1570
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0980)
ERROR:swh.storage.proxies.filter:directory added 22.9912
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0980;10000;22.9912
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0972)
ERROR:swh.storage.proxies.filter:directory added 77.5262
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0972;10000;77.5262
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0992)
ERROR:swh.storage.proxies.filter:directory added 61.5537
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0992;10000;61.5537
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0975)
ERROR:swh.storage.proxies.filter:directory added 61.1609
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0975;10000;61.1609
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0980)
ERROR:swh.storage.proxies.filter:directory added 77.3591
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0980;10000;77.3591
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0988)
ERROR:swh.storage.proxies.filter:directory added 117.5031
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0988;10000;117.5031
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1148)
ERROR:swh.storage.proxies.filter:directory added 103.0316
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1148;10000;103.0316
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0970)
ERROR:swh.storage.proxies.filter:directory added 71.1176
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0970;10000;71.1176
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0984)
ERROR:swh.storage.proxies.filter:directory added 113.7625
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0984;10000;113.7625
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0978)
ERROR:swh.storage.proxies.filter:directory added 43.8522
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0978;10000;43.8522
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0995)
ERROR:swh.storage.proxies.filter:directory added 42.6207
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0995;10000;42.6207
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0969)
ERROR:swh.storage.proxies.filter:directory added 57.0183
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0969;10000;57.0183
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1210)
ERROR:swh.storage.proxies.filter:directory added 38.5039
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1210;10000;38.5039
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0986)
ERROR:swh.storage.proxies.filter:directory added 77.9215
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0986;10000;77.9215
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0995)
ERROR:swh.storage.proxies.filter:directory added 64.1491
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0995;10000;64.1491
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0982)
ERROR:swh.storage.proxies.filter:directory added 54.0863
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0982;10000;54.0863
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0918)
ERROR:swh.storage.proxies.filter:directory added 40.6996
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0918;10000;40.6996
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0982)
ERROR:swh.storage.proxies.filter:directory added 23.3483
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0982;10000;23.3483
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0979)
ERROR:swh.storage.proxies.filter:directory added 20.1076
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0979;10000;20.1076
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0990)
ERROR:swh.storage.proxies.filter:directory added 25.8022
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0990;10000;25.8022
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0984)
ERROR:swh.storage.proxies.filter:directory added 21.8566
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0984;10000;21.8566
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0986)
ERROR:swh.storage.proxies.filter:directory added 23.6084
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0986;10000;23.6084
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0994)
ERROR:swh.storage.proxies.filter:directory added 23.0478
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0994;10000;23.0478
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1000)
ERROR:swh.storage.proxies.filter:directory added 21.8096
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1000;10000;21.8096
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0989)
ERROR:swh.storage.proxies.filter:directory added 20.8787
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0989;10000;20.8787
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0985)
ERROR:swh.storage.proxies.filter:directory added 22.2859
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0985;10000;22.2859
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0989)
ERROR:swh.storage.proxies.filter:directory added 26.3542
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0989;10000;26.3542
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0983)
ERROR:swh.storage.proxies.filter:directory added 25.7874
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0983;10000;25.7874
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0988)
ERROR:swh.storage.proxies.filter:directory added 24.0649
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0988;10000;24.0649
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0981)
ERROR:swh.storage.proxies.filter:directory added 38.5468
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0981;10000;38.5468
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1002)
ERROR:swh.storage.proxies.filter:directory added 27.5220
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1002;10000;27.5220
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1009)
ERROR:swh.storage.proxies.filter:directory added 28.6098
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1009;10000;28.6098
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0978)
ERROR:swh.storage.proxies.filter:directory added 21.5115
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0978;10000;21.5115
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0985)
ERROR:swh.storage.proxies.filter:directory added 26.1062
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0985;10000;26.1062
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0977)
ERROR:swh.storage.proxies.filter:directory added 39.0354
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0977;10000;39.0354
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0986)
ERROR:swh.storage.proxies.filter:directory added 115.7359
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0986;10000;115.7359
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1015)
ERROR:swh.storage.proxies.filter:directory added 40.2815
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1015;10000;40.2815
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0995)
ERROR:swh.storage.proxies.filter:directory added 23.2576
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0995;10000;23.2576
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0999)
ERROR:swh.storage.proxies.filter:directory added 40.5111
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0999;10000;40.5111
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0994)
ERROR:swh.storage.proxies.filter:directory added 22.9618
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0994;10000;22.9618
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0992)
ERROR:swh.storage.proxies.filter:directory added 21.3443
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0992;10000;21.3443
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0941)
ERROR:swh.storage.proxies.filter:directory added 28.3483
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0941;10000;28.3483
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0994)
ERROR:swh.storage.proxies.filter:directory added 26.9132
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0994;10000;26.9132
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0951)
ERROR:swh.storage.proxies.filter:directory added 20.0838
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0951;10000;20.0838
DEBUG:swh.loader.git.loader:packfile_read_count_tree=902183
ERROR:swh.storage.proxies.filter:directory add entry count: 2183
ERROR:swh.storage.proxies.filter:directory add missing: 2183 (0.0258)
ERROR:swh.storage.proxies.filter:directory added 4.3508
ERROR:swh.storage.proxies.filter:CSV:directory;2183;0.0258;2183;4.3508
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0761)
ERROR:swh.storage.proxies.filter:revision added 5.0144
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0761;10000;5.0144
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0847)
ERROR:swh.storage.proxies.filter:revision added 5.0741
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0847;10000;5.0741
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0882)
ERROR:swh.storage.proxies.filter:revision added 4.9378
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0882;10000;4.9378
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0878)
ERROR:swh.storage.proxies.filter:revision added 5.0537
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0878;10000;5.0537
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0930)
ERROR:swh.storage.proxies.filter:revision added 5.1573
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0930;10000;5.1573
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0911)
ERROR:swh.storage.proxies.filter:revision added 5.1768
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0911;10000;5.1768
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0943)
ERROR:swh.storage.proxies.filter:revision added 5.1233
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0943;10000;5.1233
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0937)
ERROR:swh.storage.proxies.filter:revision added 5.2191
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0937;10000;5.2191
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0930)
ERROR:swh.storage.proxies.filter:revision added 5.2840
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0930;10000;5.2840
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0944)
ERROR:swh.storage.proxies.filter:revision added 5.1977
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0944;10000;5.1977
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0909)
ERROR:swh.storage.proxies.filter:revision added 5.0793
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0909;10000;5.0793
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0942)
ERROR:swh.storage.proxies.filter:revision added 5.0399
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0942;10000;5.0399
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0925)
ERROR:swh.storage.proxies.filter:revision added 5.1985
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0925;10000;5.1985
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0867)
ERROR:swh.storage.proxies.filter:revision added 5.0619
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0867;10000;5.0619
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0945)
ERROR:swh.storage.proxies.filter:revision added 5.0199
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0945;10000;5.0199
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.1053)
ERROR:swh.storage.proxies.filter:revision added 5.2278
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.1053;10000;5.2278
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0876)
ERROR:swh.storage.proxies.filter:revision added 5.1164
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0876;10000;5.1164
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0945)
ERROR:swh.storage.proxies.filter:revision added 5.0383
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0945;10000;5.0383
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0948)
ERROR:swh.storage.proxies.filter:revision added 5.0439
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0948;10000;5.0439
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0937)
ERROR:swh.storage.proxies.filter:revision added 5.1437
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0937;10000;5.1437
DEBUG:swh.loader.git.loader:packfile_read_count_commit=201392
DEBUG:swh.loader.git.loader:packfile_read_count_tag=198
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/torvalds/linux
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f3f4cd73850> to fetch pack at /torvalds/linux
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 2335780, done.
Counting objects: 100% (259417/259417), done.
Compressing objects: 100% (57880/57880), done.
Total 2335780 (delta 240780), reused 201537 (delta 201537), pack-reused 2076363
DEBUG:swh.loader.git.loader:fetched_pack_size=841197493
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1496 refs for repo https://github.com/torvalds/linux
ERROR:swh.storage.proxies.filter:content add entry count: 2894
ERROR:swh.storage.proxies.filter:content add missing: 2894 (0.3370)
ERROR:swh.storage.proxies.filter:content added in 11.5962
ERROR:swh.storage.proxies.filter:CSV:content;2894;0.3370;2894;11.5962
ERROR:swh.storage.proxies.filter:content add entry count: 1985
ERROR:swh.storage.proxies.filter:content add missing: 1985 (0.1859)
ERROR:swh.storage.proxies.filter:content added in 10.0449
ERROR:swh.storage.proxies.filter:CSV:content;1985;0.1859;1985;10.0449
ERROR:swh.storage.proxies.filter:content add entry count: 3793
ERROR:swh.storage.proxies.filter:content add missing: 3793 (0.2069)
ERROR:swh.storage.proxies.filter:content added in 18.3859
ERROR:swh.storage.proxies.filter:CSV:content;3793;0.2069;3793;18.3859
ERROR:swh.storage.proxies.filter:content add entry count: 3402
ERROR:swh.storage.proxies.filter:content add missing: 3402 (0.0968)
ERROR:swh.storage.proxies.filter:content added in 15.3703
ERROR:swh.storage.proxies.filter:CSV:content;3402;0.0968;3402;15.3703
ERROR:swh.storage.proxies.filter:content add entry count: 5428
ERROR:swh.storage.proxies.filter:content add missing: 5428 (0.1384)
ERROR:swh.storage.proxies.filter:content added in 23.4328
ERROR:swh.storage.proxies.filter:CSV:content;5428;0.1384;5428;23.4328
ERROR:swh.storage.proxies.filter:content add entry count: 5042
ERROR:swh.storage.proxies.filter:content add missing: 5042 (0.1229)
ERROR:swh.storage.proxies.filter:content added in 20.2149
ERROR:swh.storage.proxies.filter:CSV:content;5042;0.1229;5042;20.2149
ERROR:swh.storage.proxies.filter:content add entry count: 3386
ERROR:swh.storage.proxies.filter:content add missing: 3386 (0.1011)
ERROR:swh.storage.proxies.filter:content added in 14.4604
ERROR:swh.storage.proxies.filter:CSV:content;3386;0.1011;3386;14.4604
ERROR:swh.storage.proxies.filter:content add entry count: 2217
ERROR:swh.storage.proxies.filter:content add missing: 2217 (0.0616)
ERROR:swh.storage.proxies.filter:content added in 11.5533
ERROR:swh.storage.proxies.filter:CSV:content;2217;0.0616;2217;11.5533
ERROR:swh.storage.proxies.filter:content add entry count: 3180
ERROR:swh.storage.proxies.filter:content add missing: 3180 (0.0893)
ERROR:swh.storage.proxies.filter:content added in 14.5537
ERROR:swh.storage.proxies.filter:CSV:content;3180;0.0893;3180;14.5537
ERROR:swh.storage.proxies.filter:content add entry count: 1222
ERROR:swh.storage.proxies.filter:content add missing: 1222 (0.0340)
ERROR:swh.storage.proxies.filter:content added in 7.2338
ERROR:swh.storage.proxies.filter:CSV:content;1222;0.0340;1222;7.2338
ERROR:swh.storage.proxies.filter:content add entry count: 749
ERROR:swh.storage.proxies.filter:content add missing: 749 (0.0260)
ERROR:swh.storage.proxies.filter:content added in 6.1385
ERROR:swh.storage.proxies.filter:CSV:content;749;0.0260;749;6.1385
ERROR:swh.storage.proxies.filter:content add entry count: 1406
ERROR:swh.storage.proxies.filter:content add missing: 1406 (0.0375)
ERROR:swh.storage.proxies.filter:content added in 7.1650
ERROR:swh.storage.proxies.filter:CSV:content;1406;0.0375;1406;7.1650
ERROR:swh.storage.proxies.filter:content add entry count: 2659
ERROR:swh.storage.proxies.filter:content add missing: 2659 (0.0737)
ERROR:swh.storage.proxies.filter:content added in 13.8714
ERROR:swh.storage.proxies.filter:CSV:content;2659;0.0737;2659;13.8714
ERROR:swh.storage.proxies.filter:content add entry count: 1945
ERROR:swh.storage.proxies.filter:content add missing: 1945 (0.0506)
ERROR:swh.storage.proxies.filter:content added in 11.2016
ERROR:swh.storage.proxies.filter:CSV:content;1945;0.0506;1945;11.2016
ERROR:swh.storage.proxies.filter:content add entry count: 2168
ERROR:swh.storage.proxies.filter:content add missing: 2168 (0.0554)
ERROR:swh.storage.proxies.filter:content added in 10.3397
ERROR:swh.storage.proxies.filter:CSV:content;2168;0.0554;2168;10.3397
ERROR:swh.storage.proxies.filter:content add entry count: 1519
ERROR:swh.storage.proxies.filter:content add missing: 1519 (0.0411)
ERROR:swh.storage.proxies.filter:content added in 8.2451
ERROR:swh.storage.proxies.filter:CSV:content;1519;0.0411;1519;8.2451
ERROR:swh.storage.proxies.filter:content add entry count: 2552
ERROR:swh.storage.proxies.filter:content add missing: 2552 (0.0652)
ERROR:swh.storage.proxies.filter:content added in 13.7769
ERROR:swh.storage.proxies.filter:CSV:content;2552;0.0652;2552;13.7769
ERROR:swh.storage.proxies.filter:content add entry count: 2098
ERROR:swh.storage.proxies.filter:content add missing: 2098 (0.0563)
ERROR:swh.storage.proxies.filter:content added in 8.9757
ERROR:swh.storage.proxies.filter:CSV:content;2098;0.0563;2098;8.9757
ERROR:swh.storage.proxies.filter:content add entry count: 3863
ERROR:swh.storage.proxies.filter:content add missing: 3863 (0.0955)
ERROR:swh.storage.proxies.filter:content added in 18.9552
ERROR:swh.storage.proxies.filter:CSV:content;3863;0.0955;3863;18.9552
ERROR:swh.storage.proxies.filter:content add entry count: 1770
ERROR:swh.storage.proxies.filter:content add missing: 1770 (0.0467)
ERROR:swh.storage.proxies.filter:content added in 8.7692
ERROR:swh.storage.proxies.filter:CSV:content;1770;0.0467;1770;8.7692
ERROR:swh.storage.proxies.filter:content add entry count: 3068
ERROR:swh.storage.proxies.filter:content add missing: 3068 (0.0788)
ERROR:swh.storage.proxies.filter:content added in 15.0271
ERROR:swh.storage.proxies.filter:CSV:content;3068;0.0788;3068;15.0271
ERROR:swh.storage.proxies.filter:content add entry count: 2725
ERROR:swh.storage.proxies.filter:content add missing: 2725 (0.0680)
ERROR:swh.storage.proxies.filter:content added in 11.8489
ERROR:swh.storage.proxies.filter:CSV:content;2725;0.0680;2725;11.8489
ERROR:swh.storage.proxies.filter:content add entry count: 2552
ERROR:swh.storage.proxies.filter:content add missing: 2552 (0.0654)
ERROR:swh.storage.proxies.filter:content added in 12.8631
ERROR:swh.storage.proxies.filter:CSV:content;2552;0.0654;2552;12.8631
ERROR:swh.storage.proxies.filter:content add entry count: 3772
ERROR:swh.storage.proxies.filter:content add missing: 3772 (0.0947)
ERROR:swh.storage.proxies.filter:content added in 15.9394
ERROR:swh.storage.proxies.filter:CSV:content;3772;0.0947;3772;15.9394
ERROR:swh.storage.proxies.filter:content add entry count: 2150
ERROR:swh.storage.proxies.filter:content add missing: 2150 (0.0553)
ERROR:swh.storage.proxies.filter:content added in 11.9662
ERROR:swh.storage.proxies.filter:CSV:content;2150;0.0553;2150;11.9662
ERROR:swh.storage.proxies.filter:content add entry count: 1551
ERROR:swh.storage.proxies.filter:content add missing: 1551 (0.0421)
ERROR:swh.storage.proxies.filter:content added in 8.7006
ERROR:swh.storage.proxies.filter:CSV:content;1551;0.0421;1551;8.7006
ERROR:swh.storage.proxies.filter:content add entry count: 1595
ERROR:swh.storage.proxies.filter:content add missing: 1595 (0.0438)
ERROR:swh.storage.proxies.filter:content added in 8.1599
ERROR:swh.storage.proxies.filter:CSV:content;1595;0.0438;1595;8.1599
ERROR:swh.storage.proxies.filter:content add entry count: 1529
ERROR:swh.storage.proxies.filter:content add missing: 1529 (0.0459)
ERROR:swh.storage.proxies.filter:content added in 9.6660
ERROR:swh.storage.proxies.filter:CSV:content;1529;0.0459;1529;9.6660
ERROR:swh.storage.proxies.filter:content add entry count: 1483
ERROR:swh.storage.proxies.filter:content add missing: 1483 (0.0403)
ERROR:swh.storage.proxies.filter:content added in 9.5947
ERROR:swh.storage.proxies.filter:CSV:content;1483;0.0403;1483;9.5947
ERROR:swh.storage.proxies.filter:content add entry count: 2574
ERROR:swh.storage.proxies.filter:content add missing: 2574 (0.0652)
ERROR:swh.storage.proxies.filter:content added in 10.9315
ERROR:swh.storage.proxies.filter:CSV:content;2574;0.0652;2574;10.9315
ERROR:swh.storage.proxies.filter:content add entry count: 1164
ERROR:swh.storage.proxies.filter:content add missing: 1164 (0.0322)
ERROR:swh.storage.proxies.filter:content added in 8.6641
ERROR:swh.storage.proxies.filter:CSV:content;1164;0.0322;1164;8.6641
ERROR:swh.storage.proxies.filter:content add entry count: 1900
ERROR:swh.storage.proxies.filter:content add missing: 1900 (0.0543)
ERROR:swh.storage.proxies.filter:content added in 11.0664
ERROR:swh.storage.proxies.filter:CSV:content;1900;0.0543;1900;11.0664
ERROR:swh.storage.proxies.filter:content add entry count: 2499
ERROR:swh.storage.proxies.filter:content add missing: 2499 (0.0636)
ERROR:swh.storage.proxies.filter:content added in 10.9217
ERROR:swh.storage.proxies.filter:CSV:content;2499;0.0636;2499;10.9217
ERROR:swh.storage.proxies.filter:content add entry count: 1065
ERROR:swh.storage.proxies.filter:content add missing: 1065 (0.0298)
ERROR:swh.storage.proxies.filter:content added in 8.1823
ERROR:swh.storage.proxies.filter:CSV:content;1065;0.0298;1065;8.1823
ERROR:swh.storage.proxies.filter:content add entry count: 1177
ERROR:swh.storage.proxies.filter:content add missing: 1177 (0.0332)
ERROR:swh.storage.proxies.filter:content added in 8.0597
ERROR:swh.storage.proxies.filter:CSV:content;1177;0.0332;1177;8.0597
ERROR:swh.storage.proxies.filter:content add entry count: 2557
ERROR:swh.storage.proxies.filter:content add missing: 2557 (0.0650)
ERROR:swh.storage.proxies.filter:content added in 11.1489
ERROR:swh.storage.proxies.filter:CSV:content;2557;0.0650;2557;11.1489
ERROR:swh.storage.proxies.filter:content add entry count: 1815
ERROR:swh.storage.proxies.filter:content add missing: 1815 (0.0482)
ERROR:swh.storage.proxies.filter:content added in 10.9217
ERROR:swh.storage.proxies.filter:CSV:content;1815;0.0482;1815;10.9217
ERROR:swh.storage.proxies.filter:content add entry count: 2029
ERROR:swh.storage.proxies.filter:content add missing: 2029 (0.0528)
ERROR:swh.storage.proxies.filter:content added in 13.7916
ERROR:swh.storage.proxies.filter:CSV:content;2029;0.0528;2029;13.7916
ERROR:swh.storage.proxies.filter:content add entry count: 2985
ERROR:swh.storage.proxies.filter:content add missing: 2985 (0.0755)
ERROR:swh.storage.proxies.filter:content added in 14.6731
ERROR:swh.storage.proxies.filter:CSV:content;2985;0.0755;2985;14.6731
ERROR:swh.storage.proxies.filter:content add entry count: 454
ERROR:swh.storage.proxies.filter:content add missing: 454 (0.0160)
ERROR:swh.storage.proxies.filter:content added in 5.4390
ERROR:swh.storage.proxies.filter:CSV:content;454;0.0160;454;5.4390
ERROR:swh.storage.proxies.filter:content add entry count: 455
ERROR:swh.storage.proxies.filter:content add missing: 455 (0.0158)
ERROR:swh.storage.proxies.filter:content added in 4.9442
ERROR:swh.storage.proxies.filter:CSV:content;455;0.0158;455;4.9442
ERROR:swh.storage.proxies.filter:content add entry count: 457
ERROR:swh.storage.proxies.filter:content add missing: 457 (0.0159)
ERROR:swh.storage.proxies.filter:content added in 4.9365
ERROR:swh.storage.proxies.filter:CSV:content;457;0.0159;457;4.9365
ERROR:swh.storage.proxies.filter:content add entry count: 458
ERROR:swh.storage.proxies.filter:content add missing: 458 (0.0164)
ERROR:swh.storage.proxies.filter:content added in 5.0480
ERROR:swh.storage.proxies.filter:CSV:content;458;0.0164;458;5.0480
ERROR:swh.storage.proxies.filter:content add entry count: 416
ERROR:swh.storage.proxies.filter:content add missing: 416 (0.0150)
ERROR:swh.storage.proxies.filter:content added in 4.9378
ERROR:swh.storage.proxies.filter:CSV:content;416;0.0150;416;4.9378
ERROR:swh.storage.proxies.filter:content add entry count: 406
ERROR:swh.storage.proxies.filter:content add missing: 406 (0.0149)
ERROR:swh.storage.proxies.filter:content added in 5.4160
ERROR:swh.storage.proxies.filter:CSV:content;406;0.0149;406;5.4160
ERROR:swh.storage.proxies.filter:content add entry count: 7202
ERROR:swh.storage.proxies.filter:content add missing: 7202 (0.1726)
ERROR:swh.storage.proxies.filter:content added in 30.0861
ERROR:swh.storage.proxies.filter:CSV:content;7202;0.1726;7202;30.0861
ERROR:swh.storage.proxies.filter:content add entry count: 9529
ERROR:swh.storage.proxies.filter:content add missing: 9529 (0.2406)
ERROR:swh.storage.proxies.filter:content added in 39.3810
ERROR:swh.storage.proxies.filter:CSV:content;9529;0.2406;9529;39.3810
ERROR:swh.storage.proxies.filter:content add entry count: 7099
ERROR:swh.storage.proxies.filter:content add missing: 7099 (0.1706)
ERROR:swh.storage.proxies.filter:content added in 29.3635
ERROR:swh.storage.proxies.filter:CSV:content;7099;0.1706;7099;29.3635
ERROR:swh.storage.proxies.filter:content add entry count: 3272
ERROR:swh.storage.proxies.filter:content add missing: 3272 (0.0842)
ERROR:swh.storage.proxies.filter:content added in 16.8439
ERROR:swh.storage.proxies.filter:CSV:content;3272;0.0842;3272;16.8439
ERROR:swh.storage.proxies.filter:content add entry count: 3030
ERROR:swh.storage.proxies.filter:content add missing: 3030 (0.0868)
ERROR:swh.storage.proxies.filter:content added in 13.3479
ERROR:swh.storage.proxies.filter:CSV:content;3030;0.0868;3030;13.3479
ERROR:swh.storage.proxies.filter:content add entry count: 2904
ERROR:swh.storage.proxies.filter:content add missing: 2904 (0.0749)
ERROR:swh.storage.proxies.filter:content added in 15.0640
ERROR:swh.storage.proxies.filter:CSV:content;2904;0.0749;2904;15.0640
ERROR:swh.storage.proxies.filter:content add entry count: 4245
ERROR:swh.storage.proxies.filter:content add missing: 4245 (0.1042)
ERROR:swh.storage.proxies.filter:content added in 19.6007
ERROR:swh.storage.proxies.filter:CSV:content;4245;0.1042;4245;19.6007
ERROR:swh.storage.proxies.filter:content add entry count: 2072
ERROR:swh.storage.proxies.filter:content add missing: 2072 (0.0534)
ERROR:swh.storage.proxies.filter:content added in 11.0275
ERROR:swh.storage.proxies.filter:CSV:content;2072;0.0534;2072;11.0275
ERROR:swh.storage.proxies.filter:content add entry count: 374
ERROR:swh.storage.proxies.filter:content add missing: 374 (0.0138)
ERROR:swh.storage.proxies.filter:content added in 4.7682
ERROR:swh.storage.proxies.filter:CSV:content;374;0.0138;374;4.7682
ERROR:swh.storage.proxies.filter:content add entry count: 339
ERROR:swh.storage.proxies.filter:content add missing: 339 (0.0130)
ERROR:swh.storage.proxies.filter:content added in 4.7498
ERROR:swh.storage.proxies.filter:CSV:content;339;0.0130;339;4.7498
ERROR:swh.storage.proxies.filter:content add entry count: 326
ERROR:swh.storage.proxies.filter:content add missing: 326 (0.0128)
ERROR:swh.storage.proxies.filter:content added in 4.5879
ERROR:swh.storage.proxies.filter:CSV:content;326;0.0128;326;4.5879
ERROR:swh.storage.proxies.filter:content add entry count: 1035
ERROR:swh.storage.proxies.filter:content add missing: 1035 (0.0296)
ERROR:swh.storage.proxies.filter:content added in 7.4811
ERROR:swh.storage.proxies.filter:CSV:content;1035;0.0296;1035;7.4811
ERROR:swh.storage.proxies.filter:content add entry count: 2255
ERROR:swh.storage.proxies.filter:content add missing: 2255 (0.0582)
ERROR:swh.storage.proxies.filter:content added in 9.7464
ERROR:swh.storage.proxies.filter:CSV:content;2255;0.0582;2255;9.7464
ERROR:swh.storage.proxies.filter:content add entry count: 3273
ERROR:swh.storage.proxies.filter:content add missing: 3273 (0.0814)
ERROR:swh.storage.proxies.filter:content added in 16.1977
ERROR:swh.storage.proxies.filter:CSV:content;3273;0.0814;3273;16.1977
ERROR:swh.storage.proxies.filter:content add entry count: 4298
ERROR:swh.storage.proxies.filter:content add missing: 4298 (0.1123)
ERROR:swh.storage.proxies.filter:content added in 18.2452
ERROR:swh.storage.proxies.filter:CSV:content;4298;0.1123;4298;18.2452
ERROR:swh.storage.proxies.filter:content add entry count: 3015
ERROR:swh.storage.proxies.filter:content add missing: 3015 (0.0757)
ERROR:swh.storage.proxies.filter:content added in 15.3584
ERROR:swh.storage.proxies.filter:CSV:content;3015;0.0757;3015;15.3584
ERROR:swh.storage.proxies.filter:content add entry count: 3902
ERROR:swh.storage.proxies.filter:content add missing: 3902 (0.0970)
ERROR:swh.storage.proxies.filter:content added in 16.7390
ERROR:swh.storage.proxies.filter:CSV:content;3902;0.0970;3902;16.7390
ERROR:swh.storage.proxies.filter:content add entry count: 2787
ERROR:swh.storage.proxies.filter:content add missing: 2787 (0.0690)
ERROR:swh.storage.proxies.filter:content added in 13.6100
ERROR:swh.storage.proxies.filter:CSV:content;2787;0.0690;2787;13.6100
ERROR:swh.storage.proxies.filter:content add entry count: 2312
ERROR:swh.storage.proxies.filter:content add missing: 2312 (0.0599)
ERROR:swh.storage.proxies.filter:content added in 11.0060
ERROR:swh.storage.proxies.filter:CSV:content;2312;0.0599;2312;11.0060
ERROR:swh.storage.proxies.filter:content add entry count: 2070
ERROR:swh.storage.proxies.filter:content add missing: 2070 (0.0530)
ERROR:swh.storage.proxies.filter:content added in 11.7443
ERROR:swh.storage.proxies.filter:CSV:content;2070;0.0530;2070;11.7443
ERROR:swh.storage.proxies.filter:content add entry count: 2835
ERROR:swh.storage.proxies.filter:content add missing: 2835 (0.0712)
ERROR:swh.storage.proxies.filter:content added in 12.0567
ERROR:swh.storage.proxies.filter:CSV:content;2835;0.0712;2835;12.0567
ERROR:swh.storage.proxies.filter:content add entry count: 1176
ERROR:swh.storage.proxies.filter:content add missing: 1176 (0.0327)
ERROR:swh.storage.proxies.filter:content added in 8.8296
ERROR:swh.storage.proxies.filter:CSV:content;1176;0.0327;1176;8.8296
ERROR:swh.storage.proxies.filter:content add entry count: 2903
ERROR:swh.storage.proxies.filter:content add missing: 2903 (0.0772)
ERROR:swh.storage.proxies.filter:content added in 13.4138
ERROR:swh.storage.proxies.filter:CSV:content;2903;0.0772;2903;13.4138
ERROR:swh.storage.proxies.filter:content add entry count: 3814
ERROR:swh.storage.proxies.filter:content add missing: 3814 (0.0955)
ERROR:swh.storage.proxies.filter:content added in 22.5210
ERROR:swh.storage.proxies.filter:CSV:content;3814;0.0955;3814;22.5210
ERROR:swh.storage.proxies.filter:content add entry count: 2979
ERROR:swh.storage.proxies.filter:content add missing: 2979 (0.0756)
ERROR:swh.storage.proxies.filter:content added in 12.6717
ERROR:swh.storage.proxies.filter:CSV:content;2979;0.0756;2979;12.6717
ERROR:swh.storage.proxies.filter:content add entry count: 2535
ERROR:swh.storage.proxies.filter:content add missing: 2535 (0.0639)
ERROR:swh.storage.proxies.filter:content added in 13.2294
ERROR:swh.storage.proxies.filter:CSV:content;2535;0.0639;2535;13.2294
ERROR:swh.storage.proxies.filter:content add entry count: 3377
ERROR:swh.storage.proxies.filter:content add missing: 3377 (0.0814)
ERROR:swh.storage.proxies.filter:content added in 14.9483
ERROR:swh.storage.proxies.filter:CSV:content;3377;0.0814;3377;14.9483
ERROR:swh.storage.proxies.filter:content add entry count: 3041
ERROR:swh.storage.proxies.filter:content add missing: 3041 (0.0776)
ERROR:swh.storage.proxies.filter:content added in 12.9713
ERROR:swh.storage.proxies.filter:CSV:content;3041;0.0776;3041;12.9713
ERROR:swh.storage.proxies.filter:content add entry count: 2897
ERROR:swh.storage.proxies.filter:content add missing: 2897 (0.0723)
ERROR:swh.storage.proxies.filter:content added in 14.9639
ERROR:swh.storage.proxies.filter:CSV:content;2897;0.0723;2897;14.9639
ERROR:swh.storage.proxies.filter:content add entry count: 4604
ERROR:swh.storage.proxies.filter:content add missing: 4604 (0.1132)
ERROR:swh.storage.proxies.filter:content added in 20.9498
ERROR:swh.storage.proxies.filter:CSV:content;4604;0.1132;4604;20.9498
ERROR:swh.storage.proxies.filter:content add entry count: 2584
ERROR:swh.storage.proxies.filter:content add missing: 2584 (0.0667)
ERROR:swh.storage.proxies.filter:content added in 12.3481
ERROR:swh.storage.proxies.filter:CSV:content;2584;0.0667;2584;12.3481
ERROR:swh.storage.proxies.filter:content add entry count: 3304
ERROR:swh.storage.proxies.filter:content add missing: 3304 (0.0834)
ERROR:swh.storage.proxies.filter:content added in 15.9802
ERROR:swh.storage.proxies.filter:CSV:content;3304;0.0834;3304;15.9802
ERROR:swh.storage.proxies.filter:content add entry count: 7331
ERROR:swh.storage.proxies.filter:content add missing: 7331 (0.2199)
ERROR:swh.storage.proxies.filter:content added in 29.8679
ERROR:swh.storage.proxies.filter:CSV:content;7331;0.2199;7331;29.8679
ERROR:swh.storage.proxies.filter:content add entry count: 3820
ERROR:swh.storage.proxies.filter:content add missing: 3820 (0.0941)
ERROR:swh.storage.proxies.filter:content added in 17.7166
ERROR:swh.storage.proxies.filter:CSV:content;3820;0.0941;3820;17.7166
ERROR:swh.storage.proxies.filter:content add entry count: 2618
ERROR:swh.storage.proxies.filter:content add missing: 2618 (0.0678)
ERROR:swh.storage.proxies.filter:content added in 11.9655
ERROR:swh.storage.proxies.filter:CSV:content;2618;0.0678;2618;11.9655
ERROR:swh.storage.proxies.filter:content add entry count: 3271
ERROR:swh.storage.proxies.filter:content add missing: 3271 (0.0819)
ERROR:swh.storage.proxies.filter:content added in 16.0406
ERROR:swh.storage.proxies.filter:CSV:content;3271;0.0819;3271;16.0406
ERROR:swh.storage.proxies.filter:content add entry count: 2403
ERROR:swh.storage.proxies.filter:content add missing: 2403 (0.0592)
ERROR:swh.storage.proxies.filter:content added in 10.9855
ERROR:swh.storage.proxies.filter:CSV:content;2403;0.0592;2403;10.9855
ERROR:swh.storage.proxies.filter:content add entry count: 2266
ERROR:swh.storage.proxies.filter:content add missing: 2266 (0.0684)
ERROR:swh.storage.proxies.filter:content added in 11.5529
ERROR:swh.storage.proxies.filter:CSV:content;2266;0.0684;2266;11.5529
ERROR:swh.storage.proxies.filter:content add entry count: 5024
ERROR:swh.storage.proxies.filter:content add missing: 5024 (0.1227)
ERROR:swh.storage.proxies.filter:content added in 20.8379
ERROR:swh.storage.proxies.filter:CSV:content;5024;0.1227;5024;20.8379
ERROR:swh.storage.proxies.filter:content add entry count: 10000
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2387)
ERROR:swh.storage.proxies.filter:content added in 37.9828
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2387;10000;37.9828
ERROR:swh.storage.proxies.filter:revision add entry count: 1392
ERROR:swh.storage.proxies.filter:revision add missing: 1392 (0.0217)
ERROR:swh.storage.proxies.filter:revision added 0.7600
ERROR:swh.storage.proxies.filter:CSV:revision;1392;0.0217;1392;0.7600
ERROR:swh.storage.proxies.filter:content add entry count: 9898
ERROR:swh.storage.proxies.filter:content add missing: 9898 (0.2379)
ERROR:swh.storage.proxies.filter:content added in 39.8069
ERROR:swh.storage.proxies.filter:CSV:content;9898;0.2379;9898;39.8069
ERROR:swh.storage.proxies.filter:content add entry count: 5384
ERROR:swh.storage.proxies.filter:content add missing: 5384 (0.1301)
ERROR:swh.storage.proxies.filter:content added in 24.7530
ERROR:swh.storage.proxies.filter:CSV:content;5384;0.1301;5384;24.7530
ERROR:swh.storage.proxies.filter:content add entry count: 2100
ERROR:swh.storage.proxies.filter:content add missing: 2100 (0.0534)
ERROR:swh.storage.proxies.filter:content added in 13.1647
ERROR:swh.storage.proxies.filter:CSV:content;2100;0.0534;2100;13.1647
ERROR:swh.storage.proxies.filter:content add entry count: 4290
ERROR:swh.storage.proxies.filter:content add missing: 4290 (0.1155)
ERROR:swh.storage.proxies.filter:content added in 18.1839
ERROR:swh.storage.proxies.filter:CSV:content;4290;0.1155;4290;18.1839
ERROR:swh.storage.proxies.filter:content add entry count: 1695
ERROR:swh.storage.proxies.filter:content add missing: 1695 (0.0456)
ERROR:swh.storage.proxies.filter:content added in 10.0679
ERROR:swh.storage.proxies.filter:CSV:content;1695;0.0456;1695;10.0679
ERROR:swh.storage.proxies.filter:content add entry count: 4117
ERROR:swh.storage.proxies.filter:content add missing: 4117 (0.1023)
ERROR:swh.storage.proxies.filter:content added in 17.5919
ERROR:swh.storage.proxies.filter:CSV:content;4117;0.1023;4117;17.5919
ERROR:swh.storage.proxies.filter:content add entry count: 4705
ERROR:swh.storage.proxies.filter:content add missing: 4705 (0.1154)
ERROR:swh.storage.proxies.filter:content added in 19.1428
ERROR:swh.storage.proxies.filter:CSV:content;4705;0.1154;4705;19.1428
ERROR:swh.storage.proxies.filter:content add entry count: 5217
ERROR:swh.storage.proxies.filter:content add missing: 5217 (0.1280)
ERROR:swh.storage.proxies.filter:content added in 22.5143
ERROR:swh.storage.proxies.filter:CSV:content;5217;0.1280;5217;22.5143
ERROR:swh.storage.proxies.filter:content add entry count: 1952
ERROR:swh.storage.proxies.filter:content add missing: 1952 (0.0505)
ERROR:swh.storage.proxies.filter:content added in 10.5209
ERROR:swh.storage.proxies.filter:CSV:content;1952;0.0505;1952;10.5209
ERROR:swh.storage.proxies.filter:content add entry count: 2429
ERROR:swh.storage.proxies.filter:content add missing: 2429 (0.0626)
ERROR:swh.storage.proxies.filter:content added in 13.0796
ERROR:swh.storage.proxies.filter:CSV:content;2429;0.0626;2429;13.0796
ERROR:swh.storage.proxies.filter:content add entry count: 3054
ERROR:swh.storage.proxies.filter:content add missing: 3054 (0.0985)
ERROR:swh.storage.proxies.filter:content added in 15.6531
ERROR:swh.storage.proxies.filter:CSV:content;3054;0.0985;3054;15.6531
ERROR:swh.storage.proxies.filter:content add entry count: 3875
ERROR:swh.storage.proxies.filter:content add missing: 3875 (0.0981)
ERROR:swh.storage.proxies.filter:content added in 16.9586
ERROR:swh.storage.proxies.filter:CSV:content;3875;0.0981;3875;16.9586
ERROR:swh.storage.proxies.filter:content add entry count: 4050
ERROR:swh.storage.proxies.filter:content add missing: 4050 (0.1117)
ERROR:swh.storage.proxies.filter:content added in 18.6979
ERROR:swh.storage.proxies.filter:CSV:content;4050;0.1117;4050;18.6979
ERROR:swh.storage.proxies.filter:content add entry count: 3283
ERROR:swh.storage.proxies.filter:content add missing: 3283 (0.0825)
ERROR:swh.storage.proxies.filter:content added in 13.8856
ERROR:swh.storage.proxies.filter:CSV:content;3283;0.0825;3283;13.8856
ERROR:swh.storage.proxies.filter:content add entry count: 4065
ERROR:swh.storage.proxies.filter:content add missing: 4065 (0.0966)
ERROR:swh.storage.proxies.filter:content added in 19.8552
ERROR:swh.storage.proxies.filter:CSV:content;4065;0.0966;4065;19.8552
ERROR:swh.storage.proxies.filter:content add entry count: 3442
ERROR:swh.storage.proxies.filter:content add missing: 3442 (0.0867)
ERROR:swh.storage.proxies.filter:content added in 14.7308
ERROR:swh.storage.proxies.filter:CSV:content;3442;0.0867;3442;14.7308
ERROR:swh.storage.proxies.filter:content add entry count: 4216
ERROR:swh.storage.proxies.filter:content add missing: 4216 (0.1041)
ERROR:swh.storage.proxies.filter:content added in 17.9633
ERROR:swh.storage.proxies.filter:CSV:content;4216;0.1041;4216;17.9633
ERROR:swh.storage.proxies.filter:content add entry count: 4785
ERROR:swh.storage.proxies.filter:content add missing: 4785 (0.1262)
ERROR:swh.storage.proxies.filter:content added in 22.5270
ERROR:swh.storage.proxies.filter:CSV:content;4785;0.1262;4785;22.5270
ERROR:swh.storage.proxies.filter:content add entry count: 1727
ERROR:swh.storage.proxies.filter:content add missing: 1727 (0.0454)
ERROR:swh.storage.proxies.filter:content added in 8.3366
ERROR:swh.storage.proxies.filter:CSV:content;1727;0.0454;1727;8.3366
ERROR:swh.storage.proxies.filter:content add entry count: 3957
ERROR:swh.storage.proxies.filter:content add missing: 3957 (0.0977)
ERROR:swh.storage.proxies.filter:content added in 19.2601
ERROR:swh.storage.proxies.filter:CSV:content;3957;0.0977;3957;19.2601
ERROR:swh.storage.proxies.filter:content add entry count: 4622
ERROR:swh.storage.proxies.filter:content add missing: 4622 (0.1144)
ERROR:swh.storage.proxies.filter:content added in 19.1720
ERROR:swh.storage.proxies.filter:CSV:content;4622;0.1144;4622;19.1720
ERROR:swh.storage.proxies.filter:content add entry count: 2703
ERROR:swh.storage.proxies.filter:content add missing: 2703 (0.0661)
ERROR:swh.storage.proxies.filter:content added in 12.0133
ERROR:swh.storage.proxies.filter:CSV:content;2703;0.0661;2703;12.0133
ERROR:swh.storage.proxies.filter:content add entry count: 2609
ERROR:swh.storage.proxies.filter:content add missing: 2609 (0.0689)
ERROR:swh.storage.proxies.filter:content added in 11.2818
ERROR:swh.storage.proxies.filter:CSV:content;2609;0.0689;2609;11.2818
ERROR:swh.storage.proxies.filter:content add entry count: 1995
ERROR:swh.storage.proxies.filter:content add missing: 1995 (0.0537)
ERROR:swh.storage.proxies.filter:content added in 11.8368
ERROR:swh.storage.proxies.filter:CSV:content;1995;0.0537;1995;11.8368
ERROR:swh.storage.proxies.filter:content add entry count: 3622
ERROR:swh.storage.proxies.filter:content add missing: 3622 (0.0955)
ERROR:swh.storage.proxies.filter:content added in 20.9017
ERROR:swh.storage.proxies.filter:CSV:content;3622;0.0955;3622;20.9017
ERROR:swh.storage.proxies.filter:content add entry count: 2688
ERROR:swh.storage.proxies.filter:content add missing: 2688 (0.0693)
ERROR:swh.storage.proxies.filter:content added in 11.8265
ERROR:swh.storage.proxies.filter:CSV:content;2688;0.0693;2688;11.8265
ERROR:swh.storage.proxies.filter:content add entry count: 5338
ERROR:swh.storage.proxies.filter:content add missing: 5338 (0.1327)
ERROR:swh.storage.proxies.filter:content added in 24.5037
ERROR:swh.storage.proxies.filter:CSV:content;5338;0.1327;5338;24.5037
ERROR:swh.storage.proxies.filter:content add entry count: 7158
ERROR:swh.storage.proxies.filter:content add missing: 7158 (0.1760)
ERROR:swh.storage.proxies.filter:content added in 29.3254
ERROR:swh.storage.proxies.filter:CSV:content;7158;0.1760;7158;29.3254
ERROR:swh.storage.proxies.filter:content add entry count: 3375
ERROR:swh.storage.proxies.filter:content add missing: 3375 (0.0973)
ERROR:swh.storage.proxies.filter:content added in 14.7863
ERROR:swh.storage.proxies.filter:CSV:content;3375;0.0973;3375;14.7863
ERROR:swh.storage.proxies.filter:content add entry count: 2534
ERROR:swh.storage.proxies.filter:content add missing: 2534 (0.0670)
ERROR:swh.storage.proxies.filter:content added in 12.8940
ERROR:swh.storage.proxies.filter:CSV:content;2534;0.0670;2534;12.8940
ERROR:swh.storage.proxies.filter:content add entry count: 2303
ERROR:swh.storage.proxies.filter:content add missing: 2303 (0.0604)
ERROR:swh.storage.proxies.filter:content added in 10.9358
ERROR:swh.storage.proxies.filter:CSV:content;2303;0.0604;2303;10.9358
ERROR:swh.storage.proxies.filter:content add entry count: 2875
ERROR:swh.storage.proxies.filter:content add missing: 2875 (0.0726)
ERROR:swh.storage.proxies.filter:content added in 14.7198
ERROR:swh.storage.proxies.filter:CSV:content;2875;0.0726;2875;14.7198
ERROR:swh.storage.proxies.filter:content add entry count: 4277
ERROR:swh.storage.proxies.filter:content add missing: 4277 (0.1143)
ERROR:swh.storage.proxies.filter:content added in 18.0356
ERROR:swh.storage.proxies.filter:CSV:content;4277;0.1143;4277;18.0356
ERROR:swh.storage.proxies.filter:content add entry count: 3136
ERROR:swh.storage.proxies.filter:content add missing: 3136 (0.0794)
ERROR:swh.storage.proxies.filter:content added in 13.4379
ERROR:swh.storage.proxies.filter:CSV:content;3136;0.0794;3136;13.4379
ERROR:swh.storage.proxies.filter:content add entry count: 3364
ERROR:swh.storage.proxies.filter:content add missing: 3364 (0.0860)
ERROR:swh.storage.proxies.filter:content added in 16.7812
ERROR:swh.storage.proxies.filter:CSV:content;3364;0.0860;3364;16.7812
ERROR:swh.storage.proxies.filter:content add entry count: 4476
ERROR:swh.storage.proxies.filter:content add missing: 4476 (0.1167)
ERROR:swh.storage.proxies.filter:content added in 18.8053
ERROR:swh.storage.proxies.filter:CSV:content;4476;0.1167;4476;18.8053
ERROR:swh.storage.proxies.filter:content add entry count: 3491
ERROR:swh.storage.proxies.filter:content add missing: 3491 (0.1005)
ERROR:swh.storage.proxies.filter:content added in 16.3280
ERROR:swh.storage.proxies.filter:CSV:content;3491;0.1005;3491;16.3280
ERROR:swh.storage.proxies.filter:content add entry count: 3454
ERROR:swh.storage.proxies.filter:content add missing: 3454 (0.0875)
ERROR:swh.storage.proxies.filter:content added in 15.7479
ERROR:swh.storage.proxies.filter:CSV:content;3454;0.0875;3454;15.7479
ERROR:swh.storage.proxies.filter:content add entry count: 5582
ERROR:swh.storage.proxies.filter:content add missing: 5582 (0.1399)
ERROR:swh.storage.proxies.filter:content added in 22.9670
ERROR:swh.storage.proxies.filter:CSV:content;5582;0.1399;5582;22.9670
ERROR:swh.storage.proxies.filter:content add entry count: 3857
ERROR:swh.storage.proxies.filter:content add missing: 3857 (0.0984)
ERROR:swh.storage.proxies.filter:content added in 16.5133
ERROR:swh.storage.proxies.filter:CSV:content;3857;0.0984;3857;16.5133
ERROR:swh.storage.proxies.filter:content add entry count: 2142
ERROR:swh.storage.proxies.filter:content add missing: 2142 (0.0556)
ERROR:swh.storage.proxies.filter:content added in 12.2265
ERROR:swh.storage.proxies.filter:CSV:content;2142;0.0556;2142;12.2265
ERROR:swh.storage.proxies.filter:content add entry count: 4906
ERROR:swh.storage.proxies.filter:content add missing: 4906 (0.1238)
ERROR:swh.storage.proxies.filter:content added in 20.5372
ERROR:swh.storage.proxies.filter:CSV:content;4906;0.1238;4906;20.5372
ERROR:swh.storage.proxies.filter:content add entry count: 5046
ERROR:swh.storage.proxies.filter:content add missing: 5046 (0.1456)
ERROR:swh.storage.proxies.filter:content added in 21.1025
ERROR:swh.storage.proxies.filter:CSV:content;5046;0.1456;5046;21.1025
ERROR:swh.storage.proxies.filter:content add entry count: 6446
ERROR:swh.storage.proxies.filter:content add missing: 6446 (0.1579)
ERROR:swh.storage.proxies.filter:content added in 26.7849
ERROR:swh.storage.proxies.filter:CSV:content;6446;0.1579;6446;26.7849
ERROR:swh.storage.proxies.filter:content add entry count: 2298
ERROR:swh.storage.proxies.filter:content add missing: 2298 (0.0605)
ERROR:swh.storage.proxies.filter:content added in 15.3768
ERROR:swh.storage.proxies.filter:CSV:content;2298;0.0605;2298;15.3768
ERROR:swh.storage.proxies.filter:content add entry count: 3480
ERROR:swh.storage.proxies.filter:content add missing: 3480 (0.1081)
ERROR:swh.storage.proxies.filter:content added in 14.7654
ERROR:swh.storage.proxies.filter:CSV:content;3480;0.1081;3480;14.7654
ERROR:swh.storage.proxies.filter:content add entry count: 5642
ERROR:swh.storage.proxies.filter:content add missing: 5642 (0.1388)
ERROR:swh.storage.proxies.filter:content added in 23.2581
ERROR:swh.storage.proxies.filter:CSV:content;5642;0.1388;5642;23.2581
ERROR:swh.storage.proxies.filter:content add entry count: 5117
ERROR:swh.storage.proxies.filter:content add missing: 5117 (0.1289)
ERROR:swh.storage.proxies.filter:content added in 23.3785
ERROR:swh.storage.proxies.filter:CSV:content;5117;0.1289;5117;23.3785
ERROR:swh.storage.proxies.filter:content add entry count: 2823
ERROR:swh.storage.proxies.filter:content add missing: 2823 (0.0737)
ERROR:swh.storage.proxies.filter:content added in 12.7086
ERROR:swh.storage.proxies.filter:CSV:content;2823;0.0737;2823;12.7086
ERROR:swh.storage.proxies.filter:content add entry count: 4497
ERROR:swh.storage.proxies.filter:content add missing: 4497 (0.1142)
ERROR:swh.storage.proxies.filter:content added in 18.9828
ERROR:swh.storage.proxies.filter:CSV:content;4497;0.1142;4497;18.9828
ERROR:swh.storage.proxies.filter:content add entry count: 3979
ERROR:swh.storage.proxies.filter:content add missing: 3979 (0.1002)
ERROR:swh.storage.proxies.filter:content added in 18.9209
ERROR:swh.storage.proxies.filter:CSV:content;3979;0.1002;3979;18.9209
ERROR:swh.storage.proxies.filter:content add entry count: 2759
ERROR:swh.storage.proxies.filter:content add missing: 2759 (0.0721)
ERROR:swh.storage.proxies.filter:content added in 11.9041
ERROR:swh.storage.proxies.filter:CSV:content;2759;0.0721;2759;11.9041
ERROR:swh.storage.proxies.filter:content add entry count: 4739
ERROR:swh.storage.proxies.filter:content add missing: 4739 (0.1275)
ERROR:swh.storage.proxies.filter:content added in 17.1223
ERROR:swh.storage.proxies.filter:CSV:content;4739;0.1275;4739;17.1223
ERROR:swh.storage.proxies.filter:content add entry count: 3633
ERROR:swh.storage.proxies.filter:content add missing: 3633 (0.0929)
ERROR:swh.storage.proxies.filter:content added in 17.9316
ERROR:swh.storage.proxies.filter:CSV:content;3633;0.0929;3633;17.9316
ERROR:swh.storage.proxies.filter:content add entry count: 3008
ERROR:swh.storage.proxies.filter:content add missing: 3008 (0.0781)
ERROR:swh.storage.proxies.filter:content added in 12.7502
ERROR:swh.storage.proxies.filter:CSV:content;3008;0.0781;3008;12.7502
ERROR:swh.storage.proxies.filter:content add entry count: 2759
ERROR:swh.storage.proxies.filter:content add missing: 2759 (0.0805)
ERROR:swh.storage.proxies.filter:content added in 14.2542
ERROR:swh.storage.proxies.filter:CSV:content;2759;0.0805;2759;14.2542
ERROR:swh.storage.proxies.filter:content add entry count: 2405
ERROR:swh.storage.proxies.filter:content add missing: 2405 (0.0627)
ERROR:swh.storage.proxies.filter:content added in 10.2863
ERROR:swh.storage.proxies.filter:CSV:content;2405;0.0627;2405;10.2863
ERROR:swh.storage.proxies.filter:content add entry count: 2039
ERROR:swh.storage.proxies.filter:content add missing: 2039 (0.0540)
ERROR:swh.storage.proxies.filter:content added in 12.6559
ERROR:swh.storage.proxies.filter:CSV:content;2039;0.0540;2039;12.6559
ERROR:swh.storage.proxies.filter:content add entry count: 2987
ERROR:swh.storage.proxies.filter:content add missing: 2987 (0.0767)
ERROR:swh.storage.proxies.filter:content added in 13.7094
ERROR:swh.storage.proxies.filter:CSV:content;2987;0.0767;2987;13.7094
ERROR:swh.storage.proxies.filter:content add entry count: 2468
ERROR:swh.storage.proxies.filter:content add missing: 2468 (0.0652)
ERROR:swh.storage.proxies.filter:content added in 13.1617
ERROR:swh.storage.proxies.filter:CSV:content;2468;0.0652;2468;13.1617
ERROR:swh.storage.proxies.filter:content add entry count: 2339
ERROR:swh.storage.proxies.filter:content add missing: 2339 (0.0613)
ERROR:swh.storage.proxies.filter:content added in 12.4455
ERROR:swh.storage.proxies.filter:CSV:content;2339;0.0613;2339;12.4455
ERROR:swh.storage.proxies.filter:content add entry count: 1374
ERROR:swh.storage.proxies.filter:content add missing: 1374 (0.0404)
ERROR:swh.storage.proxies.filter:content added in 7.1799
ERROR:swh.storage.proxies.filter:CSV:content;1374;0.0404;1374;7.1799
ERROR:swh.storage.proxies.filter:content add entry count: 848
ERROR:swh.storage.proxies.filter:content add missing: 848 (0.0267)
ERROR:swh.storage.proxies.filter:content added in 7.2610
ERROR:swh.storage.proxies.filter:CSV:content;848;0.0267;848;7.2610
ERROR:swh.storage.proxies.filter:content add entry count: 1012
ERROR:swh.storage.proxies.filter:content add missing: 1012 (0.0287)
ERROR:swh.storage.proxies.filter:content added in 6.8336
ERROR:swh.storage.proxies.filter:CSV:content;1012;0.0287;1012;6.8336
ERROR:swh.storage.proxies.filter:content add entry count: 1352
ERROR:swh.storage.proxies.filter:content add missing: 1352 (0.0382)
ERROR:swh.storage.proxies.filter:content added in 7.7780
ERROR:swh.storage.proxies.filter:CSV:content;1352;0.0382;1352;7.7780
ERROR:swh.storage.proxies.filter:content add entry count: 1304
ERROR:swh.storage.proxies.filter:content add missing: 1304 (0.0367)
ERROR:swh.storage.proxies.filter:content added in 9.4474
ERROR:swh.storage.proxies.filter:CSV:content;1304;0.0367;1304;9.4474
ERROR:swh.storage.proxies.filter:content add entry count: 1565
ERROR:swh.storage.proxies.filter:content add missing: 1565 (0.0426)
ERROR:swh.storage.proxies.filter:content added in 10.2692
ERROR:swh.storage.proxies.filter:CSV:content;1565;0.0426;1565;10.2692
ERROR:swh.storage.proxies.filter:content add entry count: 1447
ERROR:swh.storage.proxies.filter:content add missing: 1447 (0.0398)
ERROR:swh.storage.proxies.filter:content added in 7.8823
ERROR:swh.storage.proxies.filter:CSV:content;1447;0.0398;1447;7.8823
ERROR:swh.storage.proxies.filter:content add entry count: 1627
ERROR:swh.storage.proxies.filter:content add missing: 1627 (0.0445)
ERROR:swh.storage.proxies.filter:content added in 10.0214
ERROR:swh.storage.proxies.filter:CSV:content;1627;0.0445;1627;10.0214
ERROR:swh.storage.proxies.filter:content add entry count: 1332
ERROR:swh.storage.proxies.filter:content add missing: 1332 (0.0372)
ERROR:swh.storage.proxies.filter:content added in 9.0602
ERROR:swh.storage.proxies.filter:CSV:content;1332;0.0372;1332;9.0602
ERROR:swh.storage.proxies.filter:content add entry count: 1800
ERROR:swh.storage.proxies.filter:content add missing: 1800 (0.0602)
ERROR:swh.storage.proxies.filter:content added in 8.8875
ERROR:swh.storage.proxies.filter:CSV:content;1800;0.0602;1800;8.8875
ERROR:swh.storage.proxies.filter:content add entry count: 2177
ERROR:swh.storage.proxies.filter:content add missing: 2177 (0.0612)
ERROR:swh.storage.proxies.filter:content added in 11.2505
ERROR:swh.storage.proxies.filter:CSV:content;2177;0.0612;2177;11.2505
ERROR:swh.storage.proxies.filter:content add entry count: 5099
ERROR:swh.storage.proxies.filter:content add missing: 5099 (0.1315)
ERROR:swh.storage.proxies.filter:content added in 25.6838
ERROR:swh.storage.proxies.filter:CSV:content;5099;0.1315;5099;25.6838
ERROR:swh.storage.proxies.filter:content add entry count: 2334
ERROR:swh.storage.proxies.filter:content add missing: 2334 (0.0621)
ERROR:swh.storage.proxies.filter:content added in 12.7001
ERROR:swh.storage.proxies.filter:CSV:content;2334;0.0621;2334;12.7001
ERROR:swh.storage.proxies.filter:content add entry count: 2776
ERROR:swh.storage.proxies.filter:content add missing: 2776 (0.0726)
ERROR:swh.storage.proxies.filter:content added in 12.0690
ERROR:swh.storage.proxies.filter:CSV:content;2776;0.0726;2776;12.0690
ERROR:swh.storage.proxies.filter:content add entry count: 1339
ERROR:swh.storage.proxies.filter:content add missing: 1339 (0.0372)
ERROR:swh.storage.proxies.filter:content added in 9.2723
ERROR:swh.storage.proxies.filter:CSV:content;1339;0.0372;1339;9.2723
ERROR:swh.storage.proxies.filter:content add entry count: 1684
ERROR:swh.storage.proxies.filter:content add missing: 1684 (0.0457)
ERROR:swh.storage.proxies.filter:content added in 10.2961
ERROR:swh.storage.proxies.filter:CSV:content;1684;0.0457;1684;10.2961
ERROR:swh.storage.proxies.filter:content add entry count: 1122
ERROR:swh.storage.proxies.filter:content add missing: 1122 (0.0309)
ERROR:swh.storage.proxies.filter:content added in 6.2951
ERROR:swh.storage.proxies.filter:CSV:content;1122;0.0309;1122;6.2951
ERROR:swh.storage.proxies.filter:content add entry count: 2177
ERROR:swh.storage.proxies.filter:content add missing: 2177 (0.0691)
ERROR:swh.storage.proxies.filter:content added in 11.4887
ERROR:swh.storage.proxies.filter:CSV:content;2177;0.0691;2177;11.4887
ERROR:swh.storage.proxies.filter:content add entry count: 882
ERROR:swh.storage.proxies.filter:content add missing: 882 (0.0271)
ERROR:swh.storage.proxies.filter:content added in 7.5335
ERROR:swh.storage.proxies.filter:CSV:content;882;0.0271;882;7.5335
ERROR:swh.storage.proxies.filter:content add entry count: 570
ERROR:swh.storage.proxies.filter:content add missing: 570 (0.0182)
ERROR:swh.storage.proxies.filter:content added in 5.6286
ERROR:swh.storage.proxies.filter:CSV:content;570;0.0182;570;5.6286
ERROR:swh.storage.proxies.filter:content add entry count: 1178
ERROR:swh.storage.proxies.filter:content add missing: 1178 (0.0332)
ERROR:swh.storage.proxies.filter:content added in 7.0088
ERROR:swh.storage.proxies.filter:CSV:content;1178;0.0332;1178;7.0088
ERROR:swh.storage.proxies.filter:content add entry count: 2646
ERROR:swh.storage.proxies.filter:content add missing: 2646 (0.0699)
ERROR:swh.storage.proxies.filter:content added in 14.3203
ERROR:swh.storage.proxies.filter:CSV:content;2646;0.0699;2646;14.3203
ERROR:swh.storage.proxies.filter:content add entry count: 2246
ERROR:swh.storage.proxies.filter:content add missing: 2246 (0.0609)
ERROR:swh.storage.proxies.filter:content added in 10.2682
ERROR:swh.storage.proxies.filter:CSV:content;2246;0.0609;2246;10.2682
ERROR:swh.storage.proxies.filter:content add entry count: 1425
ERROR:swh.storage.proxies.filter:content add missing: 1425 (0.0386)
ERROR:swh.storage.proxies.filter:content added in 9.9384
ERROR:swh.storage.proxies.filter:CSV:content;1425;0.0386;1425;9.9384
ERROR:swh.storage.proxies.filter:content add entry count: 1455
ERROR:swh.storage.proxies.filter:content add missing: 1455 (0.0406)
ERROR:swh.storage.proxies.filter:content added in 9.8113
ERROR:swh.storage.proxies.filter:CSV:content;1455;0.0406;1455;9.8113
ERROR:swh.storage.proxies.filter:content add entry count: 1608
ERROR:swh.storage.proxies.filter:content add missing: 1608 (0.0438)
ERROR:swh.storage.proxies.filter:content added in 8.0766
ERROR:swh.storage.proxies.filter:CSV:content;1608;0.0438;1608;8.0766
ERROR:swh.storage.proxies.filter:content add entry count: 1910
ERROR:swh.storage.proxies.filter:content add missing: 1910 (0.0494)
ERROR:swh.storage.proxies.filter:content added in 10.9824
ERROR:swh.storage.proxies.filter:CSV:content;1910;0.0494;1910;10.9824
ERROR:swh.storage.proxies.filter:content add entry count: 5474
ERROR:swh.storage.proxies.filter:content add missing: 5474 (0.1328)
ERROR:swh.storage.proxies.filter:content added in 22.8541
ERROR:swh.storage.proxies.filter:CSV:content;5474;0.1328;5474;22.8541
ERROR:swh.storage.proxies.filter:content add entry count: 2676
ERROR:swh.storage.proxies.filter:content add missing: 2676 (0.0678)
ERROR:swh.storage.proxies.filter:content added in 14.7379
ERROR:swh.storage.proxies.filter:CSV:content;2676;0.0678;2676;14.7379
ERROR:swh.storage.proxies.filter:content add entry count: 1527
ERROR:swh.storage.proxies.filter:content add missing: 1527 (0.0419)
ERROR:swh.storage.proxies.filter:content added in 7.8811
ERROR:swh.storage.proxies.filter:CSV:content;1527;0.0419;1527;7.8811
ERROR:swh.storage.proxies.filter:content add entry count: 1948
ERROR:swh.storage.proxies.filter:content add missing: 1948 (0.0535)
ERROR:swh.storage.proxies.filter:content added in 10.8869
ERROR:swh.storage.proxies.filter:CSV:content;1948;0.0535;1948;10.8869
ERROR:swh.storage.proxies.filter:content add entry count: 1689
ERROR:swh.storage.proxies.filter:content add missing: 1689 (0.0457)
ERROR:swh.storage.proxies.filter:content added in 8.5555
ERROR:swh.storage.proxies.filter:CSV:content;1689;0.0457;1689;8.5555
ERROR:swh.storage.proxies.filter:content add entry count: 243
ERROR:swh.storage.proxies.filter:content add missing: 243 (0.0111)
ERROR:swh.storage.proxies.filter:content added in 4.5469
ERROR:swh.storage.proxies.filter:CSV:content;243;0.0111;243;4.5469
ERROR:swh.storage.proxies.filter:content add entry count: 242
ERROR:swh.storage.proxies.filter:content add missing: 242 (0.0130)
ERROR:swh.storage.proxies.filter:content added in 4.8460
ERROR:swh.storage.proxies.filter:CSV:content;242;0.0130;242;4.8460
ERROR:swh.storage.proxies.filter:content add entry count: 756
ERROR:swh.storage.proxies.filter:content add missing: 756 (0.0225)
ERROR:swh.storage.proxies.filter:content added in 6.7854
ERROR:swh.storage.proxies.filter:CSV:content;756;0.0225;756;6.7854
ERROR:swh.storage.proxies.filter:content add entry count: 492
ERROR:swh.storage.proxies.filter:content add missing: 492 (0.0167)
ERROR:swh.storage.proxies.filter:content added in 5.3242
ERROR:swh.storage.proxies.filter:CSV:content;492;0.0167;492;5.3242
ERROR:swh.storage.proxies.filter:content add entry count: 1285
ERROR:swh.storage.proxies.filter:content add missing: 1285 (0.0364)
ERROR:swh.storage.proxies.filter:content added in 7.4231
ERROR:swh.storage.proxies.filter:CSV:content;1285;0.0364;1285;7.4231
ERROR:swh.storage.proxies.filter:content add entry count: 1238
ERROR:swh.storage.proxies.filter:content add missing: 1238 (0.0341)
ERROR:swh.storage.proxies.filter:content added in 8.6812
ERROR:swh.storage.proxies.filter:CSV:content;1238;0.0341;1238;8.6812
ERROR:swh.storage.proxies.filter:content add entry count: 2943
ERROR:swh.storage.proxies.filter:content add missing: 2943 (0.0740)
ERROR:swh.storage.proxies.filter:content added in 15.2864
ERROR:swh.storage.proxies.filter:CSV:content;2943;0.0740;2943;15.2864
ERROR:swh.storage.proxies.filter:content add entry count: 2709
ERROR:swh.storage.proxies.filter:content add missing: 2709 (0.0710)
ERROR:swh.storage.proxies.filter:content added in 11.7365
ERROR:swh.storage.proxies.filter:CSV:content;2709;0.0710;2709;11.7365
ERROR:swh.storage.proxies.filter:content add entry count: 1401
ERROR:swh.storage.proxies.filter:content add missing: 1401 (0.0437)
ERROR:swh.storage.proxies.filter:content added in 9.7087
ERROR:swh.storage.proxies.filter:CSV:content;1401;0.0437;1401;9.7087
ERROR:swh.storage.proxies.filter:content add entry count: 1616
ERROR:swh.storage.proxies.filter:content add missing: 1616 (0.0431)
ERROR:swh.storage.proxies.filter:content added in 10.0475
ERROR:swh.storage.proxies.filter:CSV:content;1616;0.0431;1616;10.0475
ERROR:swh.storage.proxies.filter:content add entry count: 2391
ERROR:swh.storage.proxies.filter:content add missing: 2391 (0.0932)
ERROR:swh.storage.proxies.filter:content added in 11.3124
ERROR:swh.storage.proxies.filter:CSV:content;2391;0.0932;2391;11.3124
ERROR:swh.storage.proxies.filter:content add entry count: 1442
ERROR:swh.storage.proxies.filter:content add missing: 1442 (0.0401)
ERROR:swh.storage.proxies.filter:content added in 10.2084
ERROR:swh.storage.proxies.filter:CSV:content;1442;0.0401;1442;10.2084
ERROR:swh.storage.proxies.filter:content add entry count: 1416
ERROR:swh.storage.proxies.filter:content add missing: 1416 (0.0393)
ERROR:swh.storage.proxies.filter:content added in 8.4248
ERROR:swh.storage.proxies.filter:CSV:content;1416;0.0393;1416;8.4248
ERROR:swh.storage.proxies.filter:content add entry count: 1958
ERROR:swh.storage.proxies.filter:content add missing: 1958 (0.0528)
ERROR:swh.storage.proxies.filter:content added in 10.3213
ERROR:swh.storage.proxies.filter:CSV:content;1958;0.0528;1958;10.3213
ERROR:swh.storage.proxies.filter:content add entry count: 1927
ERROR:swh.storage.proxies.filter:content add missing: 1927 (0.0550)
ERROR:swh.storage.proxies.filter:content added in 11.6200
ERROR:swh.storage.proxies.filter:CSV:content;1927;0.0550;1927;11.6200
ERROR:swh.storage.proxies.filter:content add entry count: 724
ERROR:swh.storage.proxies.filter:content add missing: 724 (0.0233)
ERROR:swh.storage.proxies.filter:content added in 5.1908
ERROR:swh.storage.proxies.filter:CSV:content;724;0.0233;724;5.1908
ERROR:swh.storage.proxies.filter:content add entry count: 311
ERROR:swh.storage.proxies.filter:content add missing: 311 (0.0134)
ERROR:swh.storage.proxies.filter:content added in 3.9821
ERROR:swh.storage.proxies.filter:CSV:content;311;0.0134;311;3.9821
ERROR:swh.storage.proxies.filter:content add entry count: 939
ERROR:swh.storage.proxies.filter:content add missing: 939 (0.0288)
ERROR:swh.storage.proxies.filter:content added in 5.6314
ERROR:swh.storage.proxies.filter:CSV:content;939;0.0288;939;5.6314
ERROR:swh.storage.proxies.filter:content add entry count: 2371
ERROR:swh.storage.proxies.filter:content add missing: 2371 (0.0631)
ERROR:swh.storage.proxies.filter:content added in 11.6792
ERROR:swh.storage.proxies.filter:CSV:content;2371;0.0631;2371;11.6792
ERROR:swh.storage.proxies.filter:content add entry count: 1329
ERROR:swh.storage.proxies.filter:content add missing: 1329 (0.0366)
ERROR:swh.storage.proxies.filter:content added in 9.1926
ERROR:swh.storage.proxies.filter:CSV:content;1329;0.0366;1329;9.1926
ERROR:swh.storage.proxies.filter:content add entry count: 1705
ERROR:swh.storage.proxies.filter:content add missing: 1705 (0.0461)
ERROR:swh.storage.proxies.filter:content added in 14.6425
ERROR:swh.storage.proxies.filter:CSV:content;1705;0.0461;1705;14.6425
ERROR:swh.storage.proxies.filter:content add entry count: 2293
ERROR:swh.storage.proxies.filter:content add missing: 2293 (0.0711)
ERROR:swh.storage.proxies.filter:content added in 11.4779
ERROR:swh.storage.proxies.filter:CSV:content;2293;0.0711;2293;11.4779
ERROR:swh.storage.proxies.filter:content add entry count: 3865
ERROR:swh.storage.proxies.filter:content add missing: 3865 (0.1014)
ERROR:swh.storage.proxies.filter:content added in 17.7544
ERROR:swh.storage.proxies.filter:CSV:content;3865;0.1014;3865;17.7544
ERROR:swh.storage.proxies.filter:content add entry count: 3548
ERROR:swh.storage.proxies.filter:content add missing: 3548 (0.0932)
ERROR:swh.storage.proxies.filter:content added in 15.1420
ERROR:swh.storage.proxies.filter:CSV:content;3548;0.0932;3548;15.1420
ERROR:swh.storage.proxies.filter:content add entry count: 2340
ERROR:swh.storage.proxies.filter:content add missing: 2340 (0.0724)
ERROR:swh.storage.proxies.filter:content added in 12.8432
ERROR:swh.storage.proxies.filter:CSV:content;2340;0.0724;2340;12.8432
ERROR:swh.storage.proxies.filter:content add entry count: 2080
ERROR:swh.storage.proxies.filter:content add missing: 2080 (0.0560)
ERROR:swh.storage.proxies.filter:content added in 10.1542
ERROR:swh.storage.proxies.filter:CSV:content;2080;0.0560;2080;10.1542
ERROR:swh.storage.proxies.filter:content add entry count: 2586
ERROR:swh.storage.proxies.filter:content add missing: 2586 (0.0679)
ERROR:swh.storage.proxies.filter:content added in 13.0399
ERROR:swh.storage.proxies.filter:CSV:content;2586;0.0679;2586;13.0399
ERROR:swh.storage.proxies.filter:content add entry count: 2045
ERROR:swh.storage.proxies.filter:content add missing: 2045 (0.0537)
ERROR:swh.storage.proxies.filter:content added in 11.8212
ERROR:swh.storage.proxies.filter:CSV:content;2045;0.0537;2045;11.8212
ERROR:swh.storage.proxies.filter:content add entry count: 2906
ERROR:swh.storage.proxies.filter:content add missing: 2906 (0.0762)
ERROR:swh.storage.proxies.filter:content added in 12.8370
ERROR:swh.storage.proxies.filter:CSV:content;2906;0.0762;2906;12.8370
ERROR:swh.storage.proxies.filter:content add entry count: 3383
ERROR:swh.storage.proxies.filter:content add missing: 3383 (0.0872)
ERROR:swh.storage.proxies.filter:content added in 16.7811
ERROR:swh.storage.proxies.filter:CSV:content;3383;0.0872;3383;16.7811
ERROR:swh.storage.proxies.filter:content add entry count: 2305
ERROR:swh.storage.proxies.filter:content add missing: 2305 (0.0604)
ERROR:swh.storage.proxies.filter:content added in 10.4799
ERROR:swh.storage.proxies.filter:CSV:content;2305;0.0604;2305;10.4799
ERROR:swh.storage.proxies.filter:content add entry count: 1787
ERROR:swh.storage.proxies.filter:content add missing: 1787 (0.0481)
ERROR:swh.storage.proxies.filter:content added in 10.9524
ERROR:swh.storage.proxies.filter:CSV:content;1787;0.0481;1787;10.9524
ERROR:swh.storage.proxies.filter:content add entry count: 3320
ERROR:swh.storage.proxies.filter:content add missing: 3320 (0.0877)
ERROR:swh.storage.proxies.filter:content added in 14.0878
ERROR:swh.storage.proxies.filter:CSV:content;3320;0.0877;3320;14.0878
ERROR:swh.storage.proxies.filter:content add entry count: 4599
ERROR:swh.storage.proxies.filter:content add missing: 4599 (0.1178)
ERROR:swh.storage.proxies.filter:content added in 21.4880
ERROR:swh.storage.proxies.filter:CSV:content;4599;0.1178;4599;21.4880
ERROR:swh.storage.proxies.filter:content add entry count: 2816
ERROR:swh.storage.proxies.filter:content add missing: 2816 (0.0740)
ERROR:swh.storage.proxies.filter:content added in 12.9053
ERROR:swh.storage.proxies.filter:CSV:content;2816;0.0740;2816;12.9053
ERROR:swh.storage.proxies.filter:content add entry count: 2233
ERROR:swh.storage.proxies.filter:content add missing: 2233 (0.0854)
ERROR:swh.storage.proxies.filter:content added in 12.6429
ERROR:swh.storage.proxies.filter:CSV:content;2233;0.0854;2233;12.6429
ERROR:swh.storage.proxies.filter:content add entry count: 5361
ERROR:swh.storage.proxies.filter:content add missing: 5361 (0.1364)
ERROR:swh.storage.proxies.filter:content added in 22.1889
ERROR:swh.storage.proxies.filter:CSV:content;5361;0.1364;5361;22.1889
ERROR:swh.storage.proxies.filter:content add entry count: 2338
ERROR:swh.storage.proxies.filter:content add missing: 2338 (0.0625)
ERROR:swh.storage.proxies.filter:content added in 11.1862
ERROR:swh.storage.proxies.filter:CSV:content;2338;0.0625;2338;11.1862
ERROR:swh.storage.proxies.filter:content add entry count: 6288
ERROR:swh.storage.proxies.filter:content add missing: 6288 (0.1594)
ERROR:swh.storage.proxies.filter:content added in 27.2731
ERROR:swh.storage.proxies.filter:CSV:content;6288;0.1594;6288;27.2731
ERROR:swh.storage.proxies.filter:content add entry count: 1281
ERROR:swh.storage.proxies.filter:content add missing: 1281 (0.0413)
ERROR:swh.storage.proxies.filter:content added in 7.0403
ERROR:swh.storage.proxies.filter:CSV:content;1281;0.0413;1281;7.0403
ERROR:swh.storage.proxies.filter:content add entry count: 2658
ERROR:swh.storage.proxies.filter:content add missing: 2658 (0.0686)
ERROR:swh.storage.proxies.filter:content added in 14.1598
ERROR:swh.storage.proxies.filter:CSV:content;2658;0.0686;2658;14.1598
ERROR:swh.storage.proxies.filter:content add entry count: 1799
ERROR:swh.storage.proxies.filter:content add missing: 1799 (0.0491)
ERROR:swh.storage.proxies.filter:content added in 8.7278
ERROR:swh.storage.proxies.filter:CSV:content;1799;0.0491;1799;8.7278
ERROR:swh.storage.proxies.filter:content add entry count: 2510
ERROR:swh.storage.proxies.filter:content add missing: 2510 (0.0742)
ERROR:swh.storage.proxies.filter:content added in 13.2024
ERROR:swh.storage.proxies.filter:CSV:content;2510;0.0742;2510;13.2024
ERROR:swh.storage.proxies.filter:content add entry count: 2899
ERROR:swh.storage.proxies.filter:content add missing: 2899 (0.0761)
ERROR:swh.storage.proxies.filter:content added in 13.6527
ERROR:swh.storage.proxies.filter:CSV:content;2899;0.0761;2899;13.6527
ERROR:swh.storage.proxies.filter:content add entry count: 4360
ERROR:swh.storage.proxies.filter:content add missing: 4360 (0.1113)
ERROR:swh.storage.proxies.filter:content added in 19.7613
ERROR:swh.storage.proxies.filter:CSV:content;4360;0.1113;4360;19.7613
ERROR:swh.storage.proxies.filter:content add entry count: 2473
ERROR:swh.storage.proxies.filter:content add missing: 2473 (0.0738)
ERROR:swh.storage.proxies.filter:content added in 10.9405
ERROR:swh.storage.proxies.filter:CSV:content;2473;0.0738;2473;10.9405
ERROR:swh.storage.proxies.filter:content add entry count: 3294
ERROR:swh.storage.proxies.filter:content add missing: 3294 (0.0857)
ERROR:swh.storage.proxies.filter:content added in 17.2203
ERROR:swh.storage.proxies.filter:CSV:content;3294;0.0857;3294;17.2203
ERROR:swh.storage.proxies.filter:content add entry count: 2763
ERROR:swh.storage.proxies.filter:content add missing: 2763 (0.0958)
ERROR:swh.storage.proxies.filter:content added in 12.0171
ERROR:swh.storage.proxies.filter:CSV:content;2763;0.0958;2763;12.0171
ERROR:swh.storage.proxies.filter:content add entry count: 3175
ERROR:swh.storage.proxies.filter:content add missing: 3175 (0.0884)
ERROR:swh.storage.proxies.filter:content added in 16.4531
ERROR:swh.storage.proxies.filter:CSV:content;3175;0.0884;3175;16.4531
ERROR:swh.storage.proxies.filter:content add entry count: 3281
ERROR:swh.storage.proxies.filter:content add missing: 3281 (0.0830)
ERROR:swh.storage.proxies.filter:content added in 14.1899
ERROR:swh.storage.proxies.filter:CSV:content;3281;0.0830;3281;14.1899
ERROR:swh.storage.proxies.filter:content add entry count: 3359
ERROR:swh.storage.proxies.filter:content add missing: 3359 (0.0877)
ERROR:swh.storage.proxies.filter:content added in 17.0022
ERROR:swh.storage.proxies.filter:CSV:content;3359;0.0877;3359;17.0022
ERROR:swh.storage.proxies.filter:content add entry count: 2892
ERROR:swh.storage.proxies.filter:content add missing: 2892 (0.0766)
ERROR:swh.storage.proxies.filter:content added in 12.5711
ERROR:swh.storage.proxies.filter:CSV:content;2892;0.0766;2892;12.5711
ERROR:swh.storage.proxies.filter:content add entry count: 3006
ERROR:swh.storage.proxies.filter:content add missing: 3006 (0.0978)
ERROR:swh.storage.proxies.filter:content added in 15.7472
ERROR:swh.storage.proxies.filter:CSV:content;3006;0.0978;3006;15.7472
DEBUG:swh.loader.git.loader:packfile_read_count_blob=648472
ERROR:swh.storage.proxies.filter:content add entry count: 2141
ERROR:swh.storage.proxies.filter:content add missing: 2141 (0.0570)
ERROR:swh.storage.proxies.filter:content added in 6.8200
ERROR:swh.storage.proxies.filter:CSV:content;2141;0.0570;2141;6.8200
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.2290)
ERROR:swh.storage.proxies.filter:directory added 58.5291
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.2290;10000;58.5291
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0976)
ERROR:swh.storage.proxies.filter:directory added 75.1630
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0976;10000;75.1630
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1053)
ERROR:swh.storage.proxies.filter:directory added 78.2189
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1053;10000;78.2189
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1022)
ERROR:swh.storage.proxies.filter:directory added 58.3493
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1022;10000;58.3493
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1018)
ERROR:swh.storage.proxies.filter:directory added 41.4683
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1018;10000;41.4683
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0910)
ERROR:swh.storage.proxies.filter:directory added 30.9576
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0910;10000;30.9576
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1126)
ERROR:swh.storage.proxies.filter:directory added 29.0920
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1126;10000;29.0920
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1013)
ERROR:swh.storage.proxies.filter:directory added 56.8623
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1013;10000;56.8623
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1014)
ERROR:swh.storage.proxies.filter:directory added 189.5843
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1014;10000;189.5843
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1027)
ERROR:swh.storage.proxies.filter:directory added 221.7116
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1027;10000;221.7116
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1094)
ERROR:swh.storage.proxies.filter:directory added 77.7299
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1094;10000;77.7299
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1025)
ERROR:swh.storage.proxies.filter:directory added 35.7806
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1025;10000;35.7806
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1024)
ERROR:swh.storage.proxies.filter:directory added 31.9817
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1024;10000;31.9817
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1021)
ERROR:swh.storage.proxies.filter:directory added 36.2667
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1021;10000;36.2667
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1026)
ERROR:swh.storage.proxies.filter:directory added 43.0151
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1026;10000;43.0151
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1005)
ERROR:swh.storage.proxies.filter:directory added 61.5202
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1005;10000;61.5202
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1008)
ERROR:swh.storage.proxies.filter:directory added 102.1578
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1008;10000;102.1578
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1033)
ERROR:swh.storage.proxies.filter:directory added 34.4530
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1033;10000;34.4530
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1037)
ERROR:swh.storage.proxies.filter:directory added 53.4371
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1037;10000;53.4371
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1051)
ERROR:swh.storage.proxies.filter:directory added 43.7932
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1051;10000;43.7932
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1026)
ERROR:swh.storage.proxies.filter:directory added 42.8792
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1026;10000;42.8792
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1045)
ERROR:swh.storage.proxies.filter:directory added 142.3027
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1045;10000;142.3027
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1024)
ERROR:swh.storage.proxies.filter:directory added 58.3357
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1024;10000;58.3357
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1026)
ERROR:swh.storage.proxies.filter:directory added 56.0434
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1026;10000;56.0434
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1194)
ERROR:swh.storage.proxies.filter:directory added 68.2724
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1194;10000;68.2724
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1027)
ERROR:swh.storage.proxies.filter:directory added 88.1775
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1027;10000;88.1775
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1067)
ERROR:swh.storage.proxies.filter:directory added 34.9278
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1067;10000;34.9278
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1045)
ERROR:swh.storage.proxies.filter:directory added 46.1764
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1045;10000;46.1764
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1033)
ERROR:swh.storage.proxies.filter:directory added 58.1465
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1033;10000;58.1465
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1032)
ERROR:swh.storage.proxies.filter:directory added 89.6812
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1032;10000;89.6812
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1043)
ERROR:swh.storage.proxies.filter:directory added 87.3931
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1043;10000;87.3931
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1037)
ERROR:swh.storage.proxies.filter:directory added 31.2926
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1037;10000;31.2926
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1034)
ERROR:swh.storage.proxies.filter:directory added 55.0789
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1034;10000;55.0789
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1049)
ERROR:swh.storage.proxies.filter:directory added 73.7401
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1049;10000;73.7401
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1062)
ERROR:swh.storage.proxies.filter:directory added 42.4257
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1062;10000;42.4257
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1043)
ERROR:swh.storage.proxies.filter:directory added 34.5926
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1043;10000;34.5926
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1044)
ERROR:swh.storage.proxies.filter:directory added 97.7000
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1044;10000;97.7000
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1049)
ERROR:swh.storage.proxies.filter:directory added 81.4549
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1049;10000;81.4549
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1048)
ERROR:swh.storage.proxies.filter:directory added 33.6957
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1048;10000;33.6957
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1035)
ERROR:swh.storage.proxies.filter:directory added 37.8099
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1035;10000;37.8099
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1055)
ERROR:swh.storage.proxies.filter:directory added 41.3627
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1055;10000;41.3627
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0985)
ERROR:swh.storage.proxies.filter:directory added 84.2020
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0985;10000;84.2020
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1057)
ERROR:swh.storage.proxies.filter:directory added 35.1523
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1057;10000;35.1523
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1048)
ERROR:swh.storage.proxies.filter:directory added 31.6186
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1048;10000;31.6186
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0964)
ERROR:swh.storage.proxies.filter:directory added 32.5999
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0964;10000;32.5999
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0976)
ERROR:swh.storage.proxies.filter:directory added 62.4858
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0976;10000;62.4858
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1097)
ERROR:swh.storage.proxies.filter:directory added 45.5021
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1097;10000;45.5021
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1068)
ERROR:swh.storage.proxies.filter:directory added 34.4461
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1068;10000;34.4461
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1060)
ERROR:swh.storage.proxies.filter:directory added 39.5448
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1060;10000;39.5448
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1048)
ERROR:swh.storage.proxies.filter:directory added 39.3421
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1048;10000;39.3421
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1046)
ERROR:swh.storage.proxies.filter:directory added 38.8587
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1046;10000;38.8587
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1047)
ERROR:swh.storage.proxies.filter:directory added 57.8750
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1047;10000;57.8750
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1052)
ERROR:swh.storage.proxies.filter:directory added 64.8861
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1052;10000;64.8861
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1050)
ERROR:swh.storage.proxies.filter:directory added 57.8963
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1050;10000;57.8963
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1048)
ERROR:swh.storage.proxies.filter:directory added 56.5254
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1048;10000;56.5254
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1033)
ERROR:swh.storage.proxies.filter:directory added 63.9720
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1033;10000;63.9720
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1142)
ERROR:swh.storage.proxies.filter:directory added 102.8062
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1142;10000;102.8062
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1161)
ERROR:swh.storage.proxies.filter:directory added 126.1318
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1161;10000;126.1318
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1128)
ERROR:swh.storage.proxies.filter:directory added 40.6218
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1128;10000;40.6218
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1062)
ERROR:swh.storage.proxies.filter:directory added 51.3815
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1062;10000;51.3815
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1208)
ERROR:swh.storage.proxies.filter:directory added 48.6233
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1208;10000;48.6233
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1047)
ERROR:swh.storage.proxies.filter:directory added 60.3043
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1047;10000;60.3043
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0950)
ERROR:swh.storage.proxies.filter:directory added 53.4686
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0950;10000;53.4686
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1154)
ERROR:swh.storage.proxies.filter:directory added 114.5015
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1154;10000;114.5015
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1095)
ERROR:swh.storage.proxies.filter:directory added 49.6667
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1095;10000;49.6667
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0979)
ERROR:swh.storage.proxies.filter:directory added 44.1014
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0979;10000;44.1014
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1086)
ERROR:swh.storage.proxies.filter:directory added 38.3484
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1086;10000;38.3484
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1067)
ERROR:swh.storage.proxies.filter:directory added 39.6076
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1067;10000;39.6076
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1051)
ERROR:swh.storage.proxies.filter:directory added 37.8200
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1051;10000;37.8200
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1047)
ERROR:swh.storage.proxies.filter:directory added 37.4646
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1047;10000;37.4646
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1062)
ERROR:swh.storage.proxies.filter:directory added 74.6478
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1062;10000;74.6478
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1075)
ERROR:swh.storage.proxies.filter:directory added 44.3942
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1075;10000;44.3942
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1056)
ERROR:swh.storage.proxies.filter:directory added 49.9119
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1056;10000;49.9119
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1198)
ERROR:swh.storage.proxies.filter:directory added 39.9777
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1198;10000;39.9777
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0983)
ERROR:swh.storage.proxies.filter:directory added 40.0965
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0983;10000;40.0965
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1038)
ERROR:swh.storage.proxies.filter:directory added 26.0959
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1038;10000;26.0959
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1088)
ERROR:swh.storage.proxies.filter:directory added 93.2860
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1088;10000;93.2860
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1090)
ERROR:swh.storage.proxies.filter:directory added 34.3327
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1090;10000;34.3327
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1346)
ERROR:swh.storage.proxies.filter:directory added 69.4513
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1346;10000;69.4513
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1093)
ERROR:swh.storage.proxies.filter:directory added 35.3436
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1093;10000;35.3436
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1067)
ERROR:swh.storage.proxies.filter:directory added 82.8778
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1067;10000;82.8778
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1111)
ERROR:swh.storage.proxies.filter:directory added 22.6176
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1111;10000;22.6176
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1064)
ERROR:swh.storage.proxies.filter:directory added 32.0227
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1064;10000;32.0227
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1118)
ERROR:swh.storage.proxies.filter:directory added 28.2860
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1118;10000;28.2860
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1200)
ERROR:swh.storage.proxies.filter:directory added 38.7517
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1200;10000;38.7517
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1068)
ERROR:swh.storage.proxies.filter:directory added 35.0494
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1068;10000;35.0494
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1063)
ERROR:swh.storage.proxies.filter:directory added 27.4984
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1063;10000;27.4984
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0982)
ERROR:swh.storage.proxies.filter:directory added 37.6095
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0982;10000;37.6095
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1054)
ERROR:swh.storage.proxies.filter:directory added 38.5577
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1054;10000;38.5577
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1061)
ERROR:swh.storage.proxies.filter:directory added 33.2499
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1061;10000;33.2499
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1080)
ERROR:swh.storage.proxies.filter:directory added 33.5796
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1080;10000;33.5796
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1099)
ERROR:swh.storage.proxies.filter:directory added 31.1978
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1099;10000;31.1978
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1057)
ERROR:swh.storage.proxies.filter:directory added 25.2487
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1057;10000;25.2487
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1059)
ERROR:swh.storage.proxies.filter:directory added 25.7222
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1059;10000;25.7222
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1074)
ERROR:swh.storage.proxies.filter:directory added 52.2775
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1074;10000;52.2775
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1011)
ERROR:swh.storage.proxies.filter:directory added 40.7776
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1011;10000;40.7776
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1067)
ERROR:swh.storage.proxies.filter:directory added 35.1729
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1067;10000;35.1729
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1076)
ERROR:swh.storage.proxies.filter:directory added 38.1679
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1076;10000;38.1679
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1199)
ERROR:swh.storage.proxies.filter:directory added 46.7997
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1199;10000;46.7997
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1069)
ERROR:swh.storage.proxies.filter:directory added 34.0530
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1069;10000;34.0530
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1230)
ERROR:swh.storage.proxies.filter:directory added 31.4538
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1230;10000;31.4538
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1067)
ERROR:swh.storage.proxies.filter:directory added 38.7599
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1067;10000;38.7599
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1113)
ERROR:swh.storage.proxies.filter:directory added 42.0980
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1113;10000;42.0980
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1067)
ERROR:swh.storage.proxies.filter:directory added 28.3949
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1067;10000;28.3949
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1078)
ERROR:swh.storage.proxies.filter:directory added 38.6809
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1078;10000;38.6809
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1177)
ERROR:swh.storage.proxies.filter:directory added 40.7523
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1177;10000;40.7523
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1068)
ERROR:swh.storage.proxies.filter:directory added 54.8287
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1068;10000;54.8287
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1113)
ERROR:swh.storage.proxies.filter:directory added 33.8202
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1113;10000;33.8202
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1086)
ERROR:swh.storage.proxies.filter:directory added 39.0201
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1086;10000;39.0201
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1055)
ERROR:swh.storage.proxies.filter:directory added 51.1018
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1055;10000;51.1018
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1123)
ERROR:swh.storage.proxies.filter:directory added 39.9207
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1123;10000;39.9207
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1094)
ERROR:swh.storage.proxies.filter:directory added 145.6328
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1094;10000;145.6328
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1229)
ERROR:swh.storage.proxies.filter:directory added 32.6575
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1229;10000;32.6575
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1108)
ERROR:swh.storage.proxies.filter:directory added 29.2334
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1108;10000;29.2334
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1105)
ERROR:swh.storage.proxies.filter:directory added 35.1566
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1105;10000;35.1566
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1079)
ERROR:swh.storage.proxies.filter:directory added 40.6083
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1079;10000;40.6083
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1051)
ERROR:swh.storage.proxies.filter:directory added 75.0010
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1051;10000;75.0010
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1320)
ERROR:swh.storage.proxies.filter:directory added 50.7905
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1320;10000;50.7905
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1123)
ERROR:swh.storage.proxies.filter:directory added 27.2113
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1123;10000;27.2113
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1095)
ERROR:swh.storage.proxies.filter:directory added 35.9493
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1095;10000;35.9493
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1186)
ERROR:swh.storage.proxies.filter:directory added 39.3272
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1186;10000;39.3272
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1091)
ERROR:swh.storage.proxies.filter:directory added 36.4271
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1091;10000;36.4271
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1114)
ERROR:swh.storage.proxies.filter:directory added 33.8438
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1114;10000;33.8438
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1134)
ERROR:swh.storage.proxies.filter:directory added 25.4974
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1134;10000;25.4974
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1114)
ERROR:swh.storage.proxies.filter:directory added 26.4954
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1114;10000;26.4954
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1093)
ERROR:swh.storage.proxies.filter:directory added 22.6059
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1093;10000;22.6059
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1354)
ERROR:swh.storage.proxies.filter:directory added 21.9457
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1354;10000;21.9457
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1086)
ERROR:swh.storage.proxies.filter:directory added 21.8929
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1086;10000;21.8929
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1123)
ERROR:swh.storage.proxies.filter:directory added 22.8098
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1123;10000;22.8098
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1085)
ERROR:swh.storage.proxies.filter:directory added 21.2305
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1085;10000;21.2305
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1116)
ERROR:swh.storage.proxies.filter:directory added 27.4478
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1116;10000;27.4478
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1096)
ERROR:swh.storage.proxies.filter:directory added 22.4529
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1096;10000;22.4529
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1117)
ERROR:swh.storage.proxies.filter:directory added 25.6912
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1117;10000;25.6912
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1147)
ERROR:swh.storage.proxies.filter:directory added 24.4463
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1147;10000;24.4463
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1087)
ERROR:swh.storage.proxies.filter:directory added 48.6834
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1087;10000;48.6834
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1039)
ERROR:swh.storage.proxies.filter:directory added 84.0862
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1039;10000;84.0862
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1175)
ERROR:swh.storage.proxies.filter:directory added 307.4833
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1175;10000;307.4833
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1279)
ERROR:swh.storage.proxies.filter:directory added 73.6205
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1279;10000;73.6205
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1221)
ERROR:swh.storage.proxies.filter:directory added 85.4361
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1221;10000;85.4361
DEBUG:swh.loader.git.loader:packfile_read_count_tree=1392510
ERROR:swh.storage.proxies.filter:directory add entry count: 2510
ERROR:swh.storage.proxies.filter:directory add missing: 2510 (0.0348)
ERROR:swh.storage.proxies.filter:directory added 9.0394
ERROR:swh.storage.proxies.filter:CSV:directory;2510;0.0348;2510;9.0394
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.2102)
ERROR:swh.storage.proxies.filter:revision added 5.5576
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.2102;10000;5.5576
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0874)
ERROR:swh.storage.proxies.filter:revision added 5.2911
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0874;10000;5.2911
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0965)
ERROR:swh.storage.proxies.filter:revision added 5.0834
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0965;10000;5.0834
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0960)
ERROR:swh.storage.proxies.filter:revision added 5.1386
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0960;10000;5.1386
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0929)
ERROR:swh.storage.proxies.filter:revision added 5.1806
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0929;10000;5.1806
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0985)
ERROR:swh.storage.proxies.filter:revision added 5.2480
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0985;10000;5.2480
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0942)
ERROR:swh.storage.proxies.filter:revision added 5.1583
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0942;10000;5.1583
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.1060)
ERROR:swh.storage.proxies.filter:revision added 5.0817
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.1060;10000;5.0817
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0980)
ERROR:swh.storage.proxies.filter:revision added 5.3098
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0980;10000;5.3098
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0962)
ERROR:swh.storage.proxies.filter:revision added 5.1914
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0962;10000;5.1914
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0972)
ERROR:swh.storage.proxies.filter:revision added 5.1369
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0972;10000;5.1369
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.1217)
ERROR:swh.storage.proxies.filter:revision added 5.0935
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.1217;10000;5.0935
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0990)
ERROR:swh.storage.proxies.filter:revision added 5.2136
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0990;10000;5.2136
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0959)
ERROR:swh.storage.proxies.filter:revision added 5.1168
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0959;10000;5.1168
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0989)
ERROR:swh.storage.proxies.filter:revision added 5.1153
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0989;10000;5.1153
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0955)
ERROR:swh.storage.proxies.filter:revision added 5.2050
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0955;10000;5.2050
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0904)
ERROR:swh.storage.proxies.filter:revision added 5.1611
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0904;10000;5.1611
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0964)
ERROR:swh.storage.proxies.filter:revision added 5.0608
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0964;10000;5.0608
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0966)
ERROR:swh.storage.proxies.filter:revision added 5.1899
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0966;10000;5.1899
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0954)
ERROR:swh.storage.proxies.filter:revision added 5.2119
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0954;10000;5.2119
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0973)
ERROR:swh.storage.proxies.filter:revision added 5.1950
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0973;10000;5.1950
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0968)
ERROR:swh.storage.proxies.filter:revision added 5.1458
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0968;10000;5.1458
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0971)
ERROR:swh.storage.proxies.filter:revision added 5.0884
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0971;10000;5.0884
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0972)
ERROR:swh.storage.proxies.filter:revision added 5.1173
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0972;10000;5.1173
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0986)
ERROR:swh.storage.proxies.filter:revision added 5.2697
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0986;10000;5.2697
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0992)
ERROR:swh.storage.proxies.filter:revision added 5.2438
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0992;10000;5.2438
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.1100)
ERROR:swh.storage.proxies.filter:revision added 5.3473
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.1100;10000;5.3473
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0980)
ERROR:swh.storage.proxies.filter:revision added 5.2220
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0980;10000;5.2220
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0991)
ERROR:swh.storage.proxies.filter:revision added 5.2175
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0991;10000;5.2175
DEBUG:swh.loader.git.loader:packfile_read_count_commit=294598
DEBUG:swh.loader.git.loader:packfile_read_count_tag=200
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/torvalds/linux
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f3f38fb2990> to fetch pack at /torvalds/linux
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 2630984, done.
Counting objects: 100% (457755/457755), done.
Compressing objects: 100% (126693/126693), done.
Total 2630984 (delta 429267), reused 331057 (delta 331057), pack-reused 2173229
DEBUG:swh.loader.git.loader:fetched_pack_size=1037215817
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1496 refs for repo https://github.com/torvalds/linux
ERROR:swh.storage.proxies.filter:content add entry count: 6362
ERROR:swh.storage.proxies.filter:content add missing: 6362 (0.2114)
ERROR:swh.storage.proxies.filter:content added in 21.9738
ERROR:swh.storage.proxies.filter:CSV:content;6362;0.2114;6362;21.9738
ERROR:swh.storage.proxies.filter:content add entry count: 283
ERROR:swh.storage.proxies.filter:content add missing: 283 (0.0132)
ERROR:swh.storage.proxies.filter:content added in 4.4976
ERROR:swh.storage.proxies.filter:CSV:content;283;0.0132;283;4.4976
ERROR:swh.storage.proxies.filter:content add entry count: 292
ERROR:swh.storage.proxies.filter:content add missing: 292 (0.0141)
ERROR:swh.storage.proxies.filter:content added in 4.7333
ERROR:swh.storage.proxies.filter:CSV:content;292;0.0141;292;4.7333
ERROR:swh.storage.proxies.filter:content add entry count: 302
ERROR:swh.storage.proxies.filter:content add missing: 302 (0.0134)
ERROR:swh.storage.proxies.filter:content added in 4.9200
ERROR:swh.storage.proxies.filter:CSV:content;302;0.0134;302;4.9200
ERROR:swh.storage.proxies.filter:content add entry count: 7824
ERROR:swh.storage.proxies.filter:content add missing: 7824 (0.2159)
ERROR:swh.storage.proxies.filter:content added in 32.0804
ERROR:swh.storage.proxies.filter:CSV:content;7824;0.2159;7824;32.0804
ERROR:swh.storage.proxies.filter:content add entry count: 10000
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2743)
ERROR:swh.storage.proxies.filter:content added in 44.8648
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2743;10000;44.8648
ERROR:swh.storage.proxies.filter:revision add entry count: 4598
ERROR:swh.storage.proxies.filter:revision add missing: 4598 (0.0612)
ERROR:swh.storage.proxies.filter:revision added 2.2917
ERROR:swh.storage.proxies.filter:CSV:revision;4598;0.0612;4598;2.2917
ERROR:swh.storage.proxies.filter:content add entry count: 8035
ERROR:swh.storage.proxies.filter:content add missing: 8035 (0.2278)
ERROR:swh.storage.proxies.filter:content added in 33.2176
ERROR:swh.storage.proxies.filter:CSV:content;8035;0.2278;8035;33.2176
ERROR:swh.storage.proxies.filter:content add entry count: 4254
ERROR:swh.storage.proxies.filter:content add missing: 4254 (0.1152)
ERROR:swh.storage.proxies.filter:content added in 17.9580
ERROR:swh.storage.proxies.filter:CSV:content;4254;0.1152;4254;17.9580
ERROR:swh.storage.proxies.filter:content add entry count: 4199
ERROR:swh.storage.proxies.filter:content add missing: 4199 (0.1136)
ERROR:swh.storage.proxies.filter:content added in 20.1366
ERROR:swh.storage.proxies.filter:CSV:content;4199;0.1136;4199;20.1366
ERROR:swh.storage.proxies.filter:content add entry count: 3016
ERROR:swh.storage.proxies.filter:content add missing: 3016 (0.0818)
ERROR:swh.storage.proxies.filter:content added in 12.5011
ERROR:swh.storage.proxies.filter:CSV:content;3016;0.0818;3016;12.5011
ERROR:swh.storage.proxies.filter:content add entry count: 2987
ERROR:swh.storage.proxies.filter:content add missing: 2987 (0.0790)
ERROR:swh.storage.proxies.filter:content added in 15.3205
ERROR:swh.storage.proxies.filter:CSV:content;2987;0.0790;2987;15.3205
ERROR:swh.storage.proxies.filter:content add entry count: 163
ERROR:swh.storage.proxies.filter:content add missing: 163 (0.0092)
ERROR:swh.storage.proxies.filter:content added in 2.7639
ERROR:swh.storage.proxies.filter:CSV:content;163;0.0092;163;2.7639
ERROR:swh.storage.proxies.filter:content add entry count: 1078
ERROR:swh.storage.proxies.filter:content add missing: 1078 (0.0312)
ERROR:swh.storage.proxies.filter:content added in 5.2859
ERROR:swh.storage.proxies.filter:CSV:content;1078;0.0312;1078;5.2859
ERROR:swh.storage.proxies.filter:content add entry count: 2937
ERROR:swh.storage.proxies.filter:content add missing: 2937 (0.0764)
ERROR:swh.storage.proxies.filter:content added in 14.5575
ERROR:swh.storage.proxies.filter:CSV:content;2937;0.0764;2937;14.5575
ERROR:swh.storage.proxies.filter:content add entry count: 5998
ERROR:swh.storage.proxies.filter:content add missing: 5998 (0.1544)
ERROR:swh.storage.proxies.filter:content added in 24.8721
ERROR:swh.storage.proxies.filter:CSV:content;5998;0.1544;5998;24.8721
ERROR:swh.storage.proxies.filter:content add entry count: 4833
ERROR:swh.storage.proxies.filter:content add missing: 4833 (0.1270)
ERROR:swh.storage.proxies.filter:content added in 20.0297
ERROR:swh.storage.proxies.filter:CSV:content;4833;0.1270;4833;20.0297
ERROR:swh.storage.proxies.filter:content add entry count: 3342
ERROR:swh.storage.proxies.filter:content add missing: 3342 (0.0964)
ERROR:swh.storage.proxies.filter:content added in 16.8623
ERROR:swh.storage.proxies.filter:CSV:content;3342;0.0964;3342;16.8623
ERROR:swh.storage.proxies.filter:content add entry count: 4369
ERROR:swh.storage.proxies.filter:content add missing: 4369 (0.1158)
ERROR:swh.storage.proxies.filter:content added in 18.2647
ERROR:swh.storage.proxies.filter:CSV:content;4369;0.1158;4369;18.2647
ERROR:swh.storage.proxies.filter:content add entry count: 4739
ERROR:swh.storage.proxies.filter:content add missing: 4739 (0.1242)
ERROR:swh.storage.proxies.filter:content added in 19.3027
ERROR:swh.storage.proxies.filter:CSV:content;4739;0.1242;4739;19.3027
ERROR:swh.storage.proxies.filter:content add entry count: 2521
ERROR:swh.storage.proxies.filter:content add missing: 2521 (0.0689)
ERROR:swh.storage.proxies.filter:content added in 13.7823
ERROR:swh.storage.proxies.filter:CSV:content;2521;0.0689;2521;13.7823
ERROR:swh.storage.proxies.filter:content add entry count: 2400
ERROR:swh.storage.proxies.filter:content add missing: 2400 (0.0678)
ERROR:swh.storage.proxies.filter:content added in 13.0764
ERROR:swh.storage.proxies.filter:CSV:content;2400;0.0678;2400;13.0764
ERROR:swh.storage.proxies.filter:content add entry count: 2363
ERROR:swh.storage.proxies.filter:content add missing: 2363 (0.0660)
ERROR:swh.storage.proxies.filter:content added in 12.9435
ERROR:swh.storage.proxies.filter:CSV:content;2363;0.0660;2363;12.9435
ERROR:swh.storage.proxies.filter:content add entry count: 2205
ERROR:swh.storage.proxies.filter:content add missing: 2205 (0.0601)
ERROR:swh.storage.proxies.filter:content added in 11.2483
ERROR:swh.storage.proxies.filter:CSV:content;2205;0.0601;2205;11.2483
ERROR:swh.storage.proxies.filter:content add entry count: 2176
ERROR:swh.storage.proxies.filter:content add missing: 2176 (0.0604)
ERROR:swh.storage.proxies.filter:content added in 10.2426
ERROR:swh.storage.proxies.filter:CSV:content;2176;0.0604;2176;10.2426
ERROR:swh.storage.proxies.filter:content add entry count: 3299
ERROR:swh.storage.proxies.filter:content add missing: 3299 (0.0878)
ERROR:swh.storage.proxies.filter:content added in 16.4975
ERROR:swh.storage.proxies.filter:CSV:content;3299;0.0878;3299;16.4975
ERROR:swh.storage.proxies.filter:content add entry count: 3992
ERROR:swh.storage.proxies.filter:content add missing: 3992 (0.1066)
ERROR:swh.storage.proxies.filter:content added in 21.0475
ERROR:swh.storage.proxies.filter:CSV:content;3992;0.1066;3992;21.0475
ERROR:swh.storage.proxies.filter:content add entry count: 3729
ERROR:swh.storage.proxies.filter:content add missing: 3729 (0.1069)
ERROR:swh.storage.proxies.filter:content added in 15.6293
ERROR:swh.storage.proxies.filter:CSV:content;3729;0.1069;3729;15.6293
ERROR:swh.storage.proxies.filter:content add entry count: 3813
ERROR:swh.storage.proxies.filter:content add missing: 3813 (0.1029)
ERROR:swh.storage.proxies.filter:content added in 18.7969
ERROR:swh.storage.proxies.filter:CSV:content;3813;0.1029;3813;18.7969
ERROR:swh.storage.proxies.filter:content add entry count: 4555
ERROR:swh.storage.proxies.filter:content add missing: 4555 (0.1188)
ERROR:swh.storage.proxies.filter:content added in 18.9748
ERROR:swh.storage.proxies.filter:CSV:content;4555;0.1188;4555;18.9748
ERROR:swh.storage.proxies.filter:content add entry count: 5007
ERROR:swh.storage.proxies.filter:content add missing: 5007 (0.1320)
ERROR:swh.storage.proxies.filter:content added in 21.0250
ERROR:swh.storage.proxies.filter:CSV:content;5007;0.1320;5007;21.0250
ERROR:swh.storage.proxies.filter:content add entry count: 5065
ERROR:swh.storage.proxies.filter:content add missing: 5065 (0.1340)
ERROR:swh.storage.proxies.filter:content added in 21.5213
ERROR:swh.storage.proxies.filter:CSV:content;5065;0.1340;5065;21.5213
ERROR:swh.storage.proxies.filter:content add entry count: 7622
ERROR:swh.storage.proxies.filter:content add missing: 7622 (0.1958)
ERROR:swh.storage.proxies.filter:content added in 33.3517
ERROR:swh.storage.proxies.filter:CSV:content;7622;0.1958;7622;33.3517
ERROR:swh.storage.proxies.filter:content add entry count: 3687
ERROR:swh.storage.proxies.filter:content add missing: 3687 (0.1023)
ERROR:swh.storage.proxies.filter:content added in 18.8684
ERROR:swh.storage.proxies.filter:CSV:content;3687;0.1023;3687;18.8684
ERROR:swh.storage.proxies.filter:content add entry count: 5577
ERROR:swh.storage.proxies.filter:content add missing: 5577 (0.1511)
ERROR:swh.storage.proxies.filter:content added in 26.0570
ERROR:swh.storage.proxies.filter:CSV:content;5577;0.1511;5577;26.0570
ERROR:swh.storage.proxies.filter:content add entry count: 5479
ERROR:swh.storage.proxies.filter:content add missing: 5479 (0.1438)
ERROR:swh.storage.proxies.filter:content added in 22.5723
ERROR:swh.storage.proxies.filter:CSV:content;5479;0.1438;5479;22.5723
ERROR:swh.storage.proxies.filter:content add entry count: 3363
ERROR:swh.storage.proxies.filter:content add missing: 3363 (0.0902)
ERROR:swh.storage.proxies.filter:content added in 15.3165
ERROR:swh.storage.proxies.filter:CSV:content;3363;0.0902;3363;15.3165
ERROR:swh.storage.proxies.filter:content add entry count: 237
ERROR:swh.storage.proxies.filter:content add missing: 237 (0.0132)
ERROR:swh.storage.proxies.filter:content added in 4.2832
ERROR:swh.storage.proxies.filter:CSV:content;237;0.0132;237;4.2832
ERROR:swh.storage.proxies.filter:content add entry count: 228
ERROR:swh.storage.proxies.filter:content add missing: 228 (0.0101)
ERROR:swh.storage.proxies.filter:content added in 4.2911
ERROR:swh.storage.proxies.filter:CSV:content;228;0.0101;228;4.2911
ERROR:swh.storage.proxies.filter:content add entry count: 241
ERROR:swh.storage.proxies.filter:content add missing: 241 (0.0108)
ERROR:swh.storage.proxies.filter:content added in 4.4026
ERROR:swh.storage.proxies.filter:CSV:content;241;0.0108;241;4.4026
ERROR:swh.storage.proxies.filter:content add entry count: 259
ERROR:swh.storage.proxies.filter:content add missing: 259 (0.0117)
ERROR:swh.storage.proxies.filter:content added in 4.7340
ERROR:swh.storage.proxies.filter:CSV:content;259;0.0117;259;4.7340
ERROR:swh.storage.proxies.filter:content add entry count: 239
ERROR:swh.storage.proxies.filter:content add missing: 239 (0.0136)
ERROR:swh.storage.proxies.filter:content added in 4.5688
ERROR:swh.storage.proxies.filter:CSV:content;239;0.0136;239;4.5688
ERROR:swh.storage.proxies.filter:content add entry count: 230
ERROR:swh.storage.proxies.filter:content add missing: 230 (0.0108)
ERROR:swh.storage.proxies.filter:content added in 4.2530
ERROR:swh.storage.proxies.filter:CSV:content;230;0.0108;230;4.2530
ERROR:swh.storage.proxies.filter:content add entry count: 1560
ERROR:swh.storage.proxies.filter:content add missing: 1560 (0.0430)
ERROR:swh.storage.proxies.filter:content added in 7.5384
ERROR:swh.storage.proxies.filter:CSV:content;1560;0.0430;1560;7.5384
ERROR:swh.storage.proxies.filter:content add entry count: 1874
ERROR:swh.storage.proxies.filter:content add missing: 1874 (0.0546)
ERROR:swh.storage.proxies.filter:content added in 10.5502
ERROR:swh.storage.proxies.filter:CSV:content;1874;0.0546;1874;10.5502
ERROR:swh.storage.proxies.filter:content add entry count: 6706
ERROR:swh.storage.proxies.filter:content add missing: 6706 (0.1767)
ERROR:swh.storage.proxies.filter:content added in 27.7179
ERROR:swh.storage.proxies.filter:CSV:content;6706;0.1767;6706;27.7179
ERROR:swh.storage.proxies.filter:content add entry count: 3450
ERROR:swh.storage.proxies.filter:content add missing: 3450 (0.0939)
ERROR:swh.storage.proxies.filter:content added in 14.0768
ERROR:swh.storage.proxies.filter:CSV:content;3450;0.0939;3450;14.0768
ERROR:swh.storage.proxies.filter:content add entry count: 1648
ERROR:swh.storage.proxies.filter:content add missing: 1648 (0.0564)
ERROR:swh.storage.proxies.filter:content added in 9.9480
ERROR:swh.storage.proxies.filter:CSV:content;1648;0.0564;1648;9.9480
ERROR:swh.storage.proxies.filter:content add entry count: 1748
ERROR:swh.storage.proxies.filter:content add missing: 1748 (0.0566)
ERROR:swh.storage.proxies.filter:content added in 14.9746
ERROR:swh.storage.proxies.filter:CSV:content;1748;0.0566;1748;14.9746
ERROR:swh.storage.proxies.filter:content add entry count: 271
ERROR:swh.storage.proxies.filter:content add missing: 271 (0.0112)
ERROR:swh.storage.proxies.filter:content added in 4.6695
ERROR:swh.storage.proxies.filter:CSV:content;271;0.0112;271;4.6695
ERROR:swh.storage.proxies.filter:content add entry count: 774
ERROR:swh.storage.proxies.filter:content add missing: 774 (0.0242)
ERROR:swh.storage.proxies.filter:content added in 6.8684
ERROR:swh.storage.proxies.filter:CSV:content;774;0.0242;774;6.8684
ERROR:swh.storage.proxies.filter:content add entry count: 1663
ERROR:swh.storage.proxies.filter:content add missing: 1663 (0.0464)
ERROR:swh.storage.proxies.filter:content added in 9.5376
ERROR:swh.storage.proxies.filter:CSV:content;1663;0.0464;1663;9.5376
ERROR:swh.storage.proxies.filter:content add entry count: 2259
ERROR:swh.storage.proxies.filter:content add missing: 2259 (0.0622)
ERROR:swh.storage.proxies.filter:content added in 10.6570
ERROR:swh.storage.proxies.filter:CSV:content;2259;0.0622;2259;10.6570
ERROR:swh.storage.proxies.filter:content add entry count: 613
ERROR:swh.storage.proxies.filter:content add missing: 613 (0.0203)
ERROR:swh.storage.proxies.filter:content added in 6.2221
ERROR:swh.storage.proxies.filter:CSV:content;613;0.0203;613;6.2221
ERROR:swh.storage.proxies.filter:content add entry count: 2149
ERROR:swh.storage.proxies.filter:content add missing: 2149 (0.0569)
ERROR:swh.storage.proxies.filter:content added in 10.9569
ERROR:swh.storage.proxies.filter:CSV:content;2149;0.0569;2149;10.9569
ERROR:swh.storage.proxies.filter:content add entry count: 2279
ERROR:swh.storage.proxies.filter:content add missing: 2279 (0.0626)
ERROR:swh.storage.proxies.filter:content added in 11.2442
ERROR:swh.storage.proxies.filter:CSV:content;2279;0.0626;2279;11.2442
ERROR:swh.storage.proxies.filter:content add entry count: 2632
ERROR:swh.storage.proxies.filter:content add missing: 2632 (0.0709)
ERROR:swh.storage.proxies.filter:content added in 14.0640
ERROR:swh.storage.proxies.filter:CSV:content;2632;0.0709;2632;14.0640
ERROR:swh.storage.proxies.filter:content add entry count: 2531
ERROR:swh.storage.proxies.filter:content add missing: 2531 (0.0696)
ERROR:swh.storage.proxies.filter:content added in 10.6518
ERROR:swh.storage.proxies.filter:CSV:content;2531;0.0696;2531;10.6518
ERROR:swh.storage.proxies.filter:content add entry count: 2551
ERROR:swh.storage.proxies.filter:content add missing: 2551 (0.0707)
ERROR:swh.storage.proxies.filter:content added in 13.8293
ERROR:swh.storage.proxies.filter:CSV:content;2551;0.0707;2551;13.8293
ERROR:swh.storage.proxies.filter:content add entry count: 3252
ERROR:swh.storage.proxies.filter:content add missing: 3252 (0.0893)
ERROR:swh.storage.proxies.filter:content added in 13.8606
ERROR:swh.storage.proxies.filter:CSV:content;3252;0.0893;3252;13.8606
ERROR:swh.storage.proxies.filter:content add entry count: 1290
ERROR:swh.storage.proxies.filter:content add missing: 1290 (0.0393)
ERROR:swh.storage.proxies.filter:content added in 8.6966
ERROR:swh.storage.proxies.filter:CSV:content;1290;0.0393;1290;8.6966
ERROR:swh.storage.proxies.filter:content add entry count: 2792
ERROR:swh.storage.proxies.filter:content add missing: 2792 (0.0764)
ERROR:swh.storage.proxies.filter:content added in 12.4130
ERROR:swh.storage.proxies.filter:CSV:content;2792;0.0764;2792;12.4130
ERROR:swh.storage.proxies.filter:content add entry count: 1933
ERROR:swh.storage.proxies.filter:content add missing: 1933 (0.0543)
ERROR:swh.storage.proxies.filter:content added in 10.7463
ERROR:swh.storage.proxies.filter:CSV:content;1933;0.0543;1933;10.7463
ERROR:swh.storage.proxies.filter:content add entry count: 5916
ERROR:swh.storage.proxies.filter:content add missing: 5916 (0.1701)
ERROR:swh.storage.proxies.filter:content added in 24.6536
ERROR:swh.storage.proxies.filter:CSV:content;5916;0.1701;5916;24.6536
ERROR:swh.storage.proxies.filter:content add entry count: 9184
ERROR:swh.storage.proxies.filter:content add missing: 9184 (0.2459)
ERROR:swh.storage.proxies.filter:content added in 37.5381
ERROR:swh.storage.proxies.filter:CSV:content;9184;0.2459;9184;37.5381
ERROR:swh.storage.proxies.filter:content add entry count: 5088
ERROR:swh.storage.proxies.filter:content add missing: 5088 (0.1374)
ERROR:swh.storage.proxies.filter:content added in 21.3210
ERROR:swh.storage.proxies.filter:CSV:content;5088;0.1374;5088;21.3210
ERROR:swh.storage.proxies.filter:content add entry count: 2326
ERROR:swh.storage.proxies.filter:content add missing: 2326 (0.0655)
ERROR:swh.storage.proxies.filter:content added in 11.7914
ERROR:swh.storage.proxies.filter:CSV:content;2326;0.0655;2326;11.7914
ERROR:swh.storage.proxies.filter:content add entry count: 1938
ERROR:swh.storage.proxies.filter:content add missing: 1938 (0.0537)
ERROR:swh.storage.proxies.filter:content added in 9.1159
ERROR:swh.storage.proxies.filter:CSV:content;1938;0.0537;1938;9.1159
ERROR:swh.storage.proxies.filter:content add entry count: 4839
ERROR:swh.storage.proxies.filter:content add missing: 4839 (0.1382)
ERROR:swh.storage.proxies.filter:content added in 21.3805
ERROR:swh.storage.proxies.filter:CSV:content;4839;0.1382;4839;21.3805
ERROR:swh.storage.proxies.filter:content add entry count: 3952
ERROR:swh.storage.proxies.filter:content add missing: 3952 (0.1099)
ERROR:swh.storage.proxies.filter:content added in 18.0073
ERROR:swh.storage.proxies.filter:CSV:content;3952;0.1099;3952;18.0073
ERROR:swh.storage.proxies.filter:content add entry count: 3931
ERROR:swh.storage.proxies.filter:content add missing: 3931 (0.1046)
ERROR:swh.storage.proxies.filter:content added in 16.2985
ERROR:swh.storage.proxies.filter:CSV:content;3931;0.1046;3931;16.2985
ERROR:swh.storage.proxies.filter:content add entry count: 2969
ERROR:swh.storage.proxies.filter:content add missing: 2969 (0.0838)
ERROR:swh.storage.proxies.filter:content added in 15.3737
ERROR:swh.storage.proxies.filter:CSV:content;2969;0.0838;2969;15.3737
ERROR:swh.storage.proxies.filter:content add entry count: 1777
ERROR:swh.storage.proxies.filter:content add missing: 1777 (0.0566)
ERROR:swh.storage.proxies.filter:content added in 7.9595
ERROR:swh.storage.proxies.filter:CSV:content;1777;0.0566;1777;7.9595
ERROR:swh.storage.proxies.filter:content add entry count: 4112
ERROR:swh.storage.proxies.filter:content add missing: 4112 (0.1109)
ERROR:swh.storage.proxies.filter:content added in 19.7148
ERROR:swh.storage.proxies.filter:CSV:content;4112;0.1109;4112;19.7148
ERROR:swh.storage.proxies.filter:content add entry count: 4642
ERROR:swh.storage.proxies.filter:content add missing: 4642 (0.1231)
ERROR:swh.storage.proxies.filter:content added in 19.1530
ERROR:swh.storage.proxies.filter:CSV:content;4642;0.1231;4642;19.1530
ERROR:swh.storage.proxies.filter:content add entry count: 1629
ERROR:swh.storage.proxies.filter:content add missing: 1629 (0.0478)
ERROR:swh.storage.proxies.filter:content added in 9.8739
ERROR:swh.storage.proxies.filter:CSV:content;1629;0.0478;1629;9.8739
ERROR:swh.storage.proxies.filter:content add entry count: 5044
ERROR:swh.storage.proxies.filter:content add missing: 5044 (0.1346)
ERROR:swh.storage.proxies.filter:content added in 26.8846
ERROR:swh.storage.proxies.filter:CSV:content;5044;0.1346;5044;26.8846
ERROR:swh.storage.proxies.filter:content add entry count: 5558
ERROR:swh.storage.proxies.filter:content add missing: 5558 (0.1471)
ERROR:swh.storage.proxies.filter:content added in 22.8603
ERROR:swh.storage.proxies.filter:CSV:content;5558;0.1471;5558;22.8603
ERROR:swh.storage.proxies.filter:content add entry count: 7881
ERROR:swh.storage.proxies.filter:content add missing: 7881 (0.2044)
ERROR:swh.storage.proxies.filter:content added in 32.7091
ERROR:swh.storage.proxies.filter:CSV:content;7881;0.2044;7881;32.7091
ERROR:swh.storage.proxies.filter:content add entry count: 2505
ERROR:swh.storage.proxies.filter:content add missing: 2505 (0.0705)
ERROR:swh.storage.proxies.filter:content added in 11.0220
ERROR:swh.storage.proxies.filter:CSV:content;2505;0.0705;2505;11.0220
ERROR:swh.storage.proxies.filter:content add entry count: 3446
ERROR:swh.storage.proxies.filter:content add missing: 3446 (0.0963)
ERROR:swh.storage.proxies.filter:content added in 17.2499
ERROR:swh.storage.proxies.filter:CSV:content;3446;0.0963;3446;17.2499
ERROR:swh.storage.proxies.filter:content add entry count: 3537
ERROR:swh.storage.proxies.filter:content add missing: 3537 (0.0955)
ERROR:swh.storage.proxies.filter:content added in 14.8178
ERROR:swh.storage.proxies.filter:CSV:content;3537;0.0955;3537;14.8178
ERROR:swh.storage.proxies.filter:content add entry count: 5212
ERROR:swh.storage.proxies.filter:content add missing: 5212 (0.1354)
ERROR:swh.storage.proxies.filter:content added in 21.7216
ERROR:swh.storage.proxies.filter:CSV:content;5212;0.1354;5212;21.7216
ERROR:swh.storage.proxies.filter:content add entry count: 3699
ERROR:swh.storage.proxies.filter:content add missing: 3699 (0.1090)
ERROR:swh.storage.proxies.filter:content added in 18.0697
ERROR:swh.storage.proxies.filter:CSV:content;3699;0.1090;3699;18.0697
ERROR:swh.storage.proxies.filter:content add entry count: 3776
ERROR:swh.storage.proxies.filter:content add missing: 3776 (0.0967)
ERROR:swh.storage.proxies.filter:content added in 16.6123
ERROR:swh.storage.proxies.filter:CSV:content;3776;0.0967;3776;16.6123
ERROR:swh.storage.proxies.filter:content add entry count: 4856
ERROR:swh.storage.proxies.filter:content add missing: 4856 (0.1240)
ERROR:swh.storage.proxies.filter:content added in 19.8157
ERROR:swh.storage.proxies.filter:CSV:content;4856;0.1240;4856;19.8157
ERROR:swh.storage.proxies.filter:content add entry count: 3112
ERROR:swh.storage.proxies.filter:content add missing: 3112 (0.0850)
ERROR:swh.storage.proxies.filter:content added in 14.0267
ERROR:swh.storage.proxies.filter:CSV:content;3112;0.0850;3112;14.0267
ERROR:swh.storage.proxies.filter:content add entry count: 2158
ERROR:swh.storage.proxies.filter:content add missing: 2158 (0.0621)
ERROR:swh.storage.proxies.filter:content added in 11.5164
ERROR:swh.storage.proxies.filter:CSV:content;2158;0.0621;2158;11.5164
ERROR:swh.storage.proxies.filter:content add entry count: 5367
ERROR:swh.storage.proxies.filter:content add missing: 5367 (0.1414)
ERROR:swh.storage.proxies.filter:content added in 22.0974
ERROR:swh.storage.proxies.filter:CSV:content;5367;0.1414;5367;22.0974
ERROR:swh.storage.proxies.filter:content add entry count: 5489
ERROR:swh.storage.proxies.filter:content add missing: 5489 (0.1556)
ERROR:swh.storage.proxies.filter:content added in 22.5933
ERROR:swh.storage.proxies.filter:CSV:content;5489;0.1556;5489;22.5933
ERROR:swh.storage.proxies.filter:content add entry count: 4183
ERROR:swh.storage.proxies.filter:content add missing: 4183 (0.1197)
ERROR:swh.storage.proxies.filter:content added in 20.1379
ERROR:swh.storage.proxies.filter:CSV:content;4183;0.1197;4183;20.1379
ERROR:swh.storage.proxies.filter:content add entry count: 3847
ERROR:swh.storage.proxies.filter:content add missing: 3847 (0.1035)
ERROR:swh.storage.proxies.filter:content added in 16.1536
ERROR:swh.storage.proxies.filter:CSV:content;3847;0.1035;3847;16.1536
ERROR:swh.storage.proxies.filter:content add entry count: 3620
ERROR:swh.storage.proxies.filter:content add missing: 3620 (0.0971)
ERROR:swh.storage.proxies.filter:content added in 16.6973
ERROR:swh.storage.proxies.filter:CSV:content;3620;0.0971;3620;16.6973
ERROR:swh.storage.proxies.filter:content add entry count: 4919
ERROR:swh.storage.proxies.filter:content add missing: 4919 (0.1315)
ERROR:swh.storage.proxies.filter:content added in 21.8074
ERROR:swh.storage.proxies.filter:CSV:content;4919;0.1315;4919;21.8074
ERROR:swh.storage.proxies.filter:content add entry count: 3134
ERROR:swh.storage.proxies.filter:content add missing: 3134 (0.0848)
ERROR:swh.storage.proxies.filter:content added in 14.9096
ERROR:swh.storage.proxies.filter:CSV:content;3134;0.0848;3134;14.9096
ERROR:swh.storage.proxies.filter:content add entry count: 4518
ERROR:swh.storage.proxies.filter:content add missing: 4518 (0.1161)
ERROR:swh.storage.proxies.filter:content added in 19.0073
ERROR:swh.storage.proxies.filter:CSV:content;4518;0.1161;4518;19.0073
ERROR:swh.storage.proxies.filter:content add entry count: 4110
ERROR:swh.storage.proxies.filter:content add missing: 4110 (0.1083)
ERROR:swh.storage.proxies.filter:content added in 17.1767
ERROR:swh.storage.proxies.filter:CSV:content;4110;0.1083;4110;17.1767
ERROR:swh.storage.proxies.filter:content add entry count: 2649
ERROR:swh.storage.proxies.filter:content add missing: 2649 (0.0710)
ERROR:swh.storage.proxies.filter:content added in 13.9136
ERROR:swh.storage.proxies.filter:CSV:content;2649;0.0710;2649;13.9136
ERROR:swh.storage.proxies.filter:content add entry count: 3225
ERROR:swh.storage.proxies.filter:content add missing: 3225 (0.0934)
ERROR:swh.storage.proxies.filter:content added in 13.9766
ERROR:swh.storage.proxies.filter:CSV:content;3225;0.0934;3225;13.9766
ERROR:swh.storage.proxies.filter:content add entry count: 5236
ERROR:swh.storage.proxies.filter:content add missing: 5236 (0.1314)
ERROR:swh.storage.proxies.filter:content added in 19.4364
ERROR:swh.storage.proxies.filter:CSV:content;5236;0.1314;5236;19.4364
ERROR:swh.storage.proxies.filter:content add entry count: 4517
ERROR:swh.storage.proxies.filter:content add missing: 4517 (0.1186)
ERROR:swh.storage.proxies.filter:content added in 18.4398
ERROR:swh.storage.proxies.filter:CSV:content;4517;0.1186;4517;18.4398
ERROR:swh.storage.proxies.filter:content add entry count: 6392
ERROR:swh.storage.proxies.filter:content add missing: 6392 (0.1605)
ERROR:swh.storage.proxies.filter:content added in 24.4776
ERROR:swh.storage.proxies.filter:CSV:content;6392;0.1605;6392;24.4776
ERROR:swh.storage.proxies.filter:content add entry count: 4054
ERROR:swh.storage.proxies.filter:content add missing: 4054 (0.1102)
ERROR:swh.storage.proxies.filter:content added in 18.8157
ERROR:swh.storage.proxies.filter:CSV:content;4054;0.1102;4054;18.8157
ERROR:swh.storage.proxies.filter:content add entry count: 2666
ERROR:swh.storage.proxies.filter:content add missing: 2666 (0.0746)
ERROR:swh.storage.proxies.filter:content added in 11.3340
ERROR:swh.storage.proxies.filter:CSV:content;2666;0.0746;2666;11.3340
ERROR:swh.storage.proxies.filter:content add entry count: 3358
ERROR:swh.storage.proxies.filter:content add missing: 3358 (0.0924)
ERROR:swh.storage.proxies.filter:content added in 17.0881
ERROR:swh.storage.proxies.filter:CSV:content;3358;0.0924;3358;17.0881
ERROR:swh.storage.proxies.filter:content add entry count: 1013
ERROR:swh.storage.proxies.filter:content add missing: 1013 (0.0314)
ERROR:swh.storage.proxies.filter:content added in 7.6871
ERROR:swh.storage.proxies.filter:CSV:content;1013;0.0314;1013;7.6871
ERROR:swh.storage.proxies.filter:content add entry count: 1650
ERROR:swh.storage.proxies.filter:content add missing: 1650 (0.0470)
ERROR:swh.storage.proxies.filter:content added in 7.9567
ERROR:swh.storage.proxies.filter:CSV:content;1650;0.0470;1650;7.9567
ERROR:swh.storage.proxies.filter:content add entry count: 2482
ERROR:swh.storage.proxies.filter:content add missing: 2482 (0.0702)
ERROR:swh.storage.proxies.filter:content added in 12.5309
ERROR:swh.storage.proxies.filter:CSV:content;2482;0.0702;2482;12.5309
ERROR:swh.storage.proxies.filter:content add entry count: 2044
ERROR:swh.storage.proxies.filter:content add missing: 2044 (0.0582)
ERROR:swh.storage.proxies.filter:content added in 11.6919
ERROR:swh.storage.proxies.filter:CSV:content;2044;0.0582;2044;11.6919
ERROR:swh.storage.proxies.filter:content add entry count: 2892
ERROR:swh.storage.proxies.filter:content add missing: 2892 (0.0812)
ERROR:swh.storage.proxies.filter:content added in 15.2031
ERROR:swh.storage.proxies.filter:CSV:content;2892;0.0812;2892;15.2031
ERROR:swh.storage.proxies.filter:content add entry count: 1965
ERROR:swh.storage.proxies.filter:content add missing: 1965 (0.0570)
ERROR:swh.storage.proxies.filter:content added in 10.2856
ERROR:swh.storage.proxies.filter:CSV:content;1965;0.0570;1965;10.2856
ERROR:swh.storage.proxies.filter:content add entry count: 3213
ERROR:swh.storage.proxies.filter:content add missing: 3213 (0.0879)
ERROR:swh.storage.proxies.filter:content added in 15.3353
ERROR:swh.storage.proxies.filter:CSV:content;3213;0.0879;3213;15.3353
ERROR:swh.storage.proxies.filter:content add entry count: 2271
ERROR:swh.storage.proxies.filter:content add missing: 2271 (0.0638)
ERROR:swh.storage.proxies.filter:content added in 11.5812
ERROR:swh.storage.proxies.filter:CSV:content;2271;0.0638;2271;11.5812
ERROR:swh.storage.proxies.filter:content add entry count: 1403
ERROR:swh.storage.proxies.filter:content add missing: 1403 (0.0422)
ERROR:swh.storage.proxies.filter:content added in 11.8740
ERROR:swh.storage.proxies.filter:CSV:content;1403;0.0422;1403;11.8740
ERROR:swh.storage.proxies.filter:content add entry count: 1332
ERROR:swh.storage.proxies.filter:content add missing: 1332 (0.0387)
ERROR:swh.storage.proxies.filter:content added in 9.5538
ERROR:swh.storage.proxies.filter:CSV:content;1332;0.0387;1332;9.5538
ERROR:swh.storage.proxies.filter:content add entry count: 2632
ERROR:swh.storage.proxies.filter:content add missing: 2632 (0.0711)
ERROR:swh.storage.proxies.filter:content added in 11.5412
ERROR:swh.storage.proxies.filter:CSV:content;2632;0.0711;2632;11.5412
ERROR:swh.storage.proxies.filter:content add entry count: 4336
ERROR:swh.storage.proxies.filter:content add missing: 4336 (0.1410)
ERROR:swh.storage.proxies.filter:content added in 20.8568
ERROR:swh.storage.proxies.filter:CSV:content;4336;0.1410;4336;20.8568
ERROR:swh.storage.proxies.filter:content add entry count: 2512
ERROR:swh.storage.proxies.filter:content add missing: 2512 (0.0704)
ERROR:swh.storage.proxies.filter:content added in 11.4768
ERROR:swh.storage.proxies.filter:CSV:content;2512;0.0704;2512;11.4768
ERROR:swh.storage.proxies.filter:content add entry count: 614
ERROR:swh.storage.proxies.filter:content add missing: 614 (0.0203)
ERROR:swh.storage.proxies.filter:content added in 6.5610
ERROR:swh.storage.proxies.filter:CSV:content;614;0.0203;614;6.5610
ERROR:swh.storage.proxies.filter:content add entry count: 1384
ERROR:swh.storage.proxies.filter:content add missing: 1384 (0.0397)
ERROR:swh.storage.proxies.filter:content added in 9.3183
ERROR:swh.storage.proxies.filter:CSV:content;1384;0.0397;1384;9.3183
ERROR:swh.storage.proxies.filter:content add entry count: 2244
ERROR:swh.storage.proxies.filter:content add missing: 2244 (0.0642)
ERROR:swh.storage.proxies.filter:content added in 9.7282
ERROR:swh.storage.proxies.filter:CSV:content;2244;0.0642;2244;9.7282
ERROR:swh.storage.proxies.filter:content add entry count: 1215
ERROR:swh.storage.proxies.filter:content add missing: 1215 (0.0361)
ERROR:swh.storage.proxies.filter:content added in 8.7258
ERROR:swh.storage.proxies.filter:CSV:content;1215;0.0361;1215;8.7258
ERROR:swh.storage.proxies.filter:content add entry count: 1244
ERROR:swh.storage.proxies.filter:content add missing: 1244 (0.0386)
ERROR:swh.storage.proxies.filter:content added in 9.0137
ERROR:swh.storage.proxies.filter:CSV:content;1244;0.0386;1244;9.0137
ERROR:swh.storage.proxies.filter:content add entry count: 833
ERROR:swh.storage.proxies.filter:content add missing: 833 (0.0254)
ERROR:swh.storage.proxies.filter:content added in 6.1194
ERROR:swh.storage.proxies.filter:CSV:content;833;0.0254;833;6.1194
ERROR:swh.storage.proxies.filter:content add entry count: 444
ERROR:swh.storage.proxies.filter:content add missing: 444 (0.0165)
ERROR:swh.storage.proxies.filter:content added in 5.2462
ERROR:swh.storage.proxies.filter:CSV:content;444;0.0165;444;5.2462
ERROR:swh.storage.proxies.filter:content add entry count: 320
ERROR:swh.storage.proxies.filter:content add missing: 320 (0.0134)
ERROR:swh.storage.proxies.filter:content added in 4.8827
ERROR:swh.storage.proxies.filter:CSV:content;320;0.0134;320;4.8827
ERROR:swh.storage.proxies.filter:content add entry count: 779
ERROR:swh.storage.proxies.filter:content add missing: 779 (0.0241)
ERROR:swh.storage.proxies.filter:content added in 6.8045
ERROR:swh.storage.proxies.filter:CSV:content;779;0.0241;779;6.8045
ERROR:swh.storage.proxies.filter:content add entry count: 568
ERROR:swh.storage.proxies.filter:content add missing: 568 (0.0189)
ERROR:swh.storage.proxies.filter:content added in 5.8694
ERROR:swh.storage.proxies.filter:CSV:content;568;0.0189;568;5.8694
ERROR:swh.storage.proxies.filter:content add entry count: 1552
ERROR:swh.storage.proxies.filter:content add missing: 1552 (0.0433)
ERROR:swh.storage.proxies.filter:content added in 7.7327
ERROR:swh.storage.proxies.filter:CSV:content;1552;0.0433;1552;7.7327
ERROR:swh.storage.proxies.filter:content add entry count: 1874
ERROR:swh.storage.proxies.filter:content add missing: 1874 (0.0607)
ERROR:swh.storage.proxies.filter:content added in 11.3786
ERROR:swh.storage.proxies.filter:CSV:content;1874;0.0607;1874;11.3786
ERROR:swh.storage.proxies.filter:content add entry count: 1258
ERROR:swh.storage.proxies.filter:content add missing: 1258 (0.0364)
ERROR:swh.storage.proxies.filter:content added in 8.0844
ERROR:swh.storage.proxies.filter:CSV:content;1258;0.0364;1258;8.0844
ERROR:swh.storage.proxies.filter:content add entry count: 1494
ERROR:swh.storage.proxies.filter:content add missing: 1494 (0.0423)
ERROR:swh.storage.proxies.filter:content added in 7.9758
ERROR:swh.storage.proxies.filter:CSV:content;1494;0.0423;1494;7.9758
ERROR:swh.storage.proxies.filter:content add entry count: 1363
ERROR:swh.storage.proxies.filter:content add missing: 1363 (0.0389)
ERROR:swh.storage.proxies.filter:content added in 9.3314
ERROR:swh.storage.proxies.filter:CSV:content;1363;0.0389;1363;9.3314
ERROR:swh.storage.proxies.filter:content add entry count: 1541
ERROR:swh.storage.proxies.filter:content add missing: 1541 (0.0443)
ERROR:swh.storage.proxies.filter:content added in 9.6176
ERROR:swh.storage.proxies.filter:CSV:content;1541;0.0443;1541;9.6176
ERROR:swh.storage.proxies.filter:content add entry count: 1645
ERROR:swh.storage.proxies.filter:content add missing: 1645 (0.0480)
ERROR:swh.storage.proxies.filter:content added in 8.2022
ERROR:swh.storage.proxies.filter:CSV:content;1645;0.0480;1645;8.2022
ERROR:swh.storage.proxies.filter:content add entry count: 2189
ERROR:swh.storage.proxies.filter:content add missing: 2189 (0.0593)
ERROR:swh.storage.proxies.filter:content added in 12.2507
ERROR:swh.storage.proxies.filter:CSV:content;2189;0.0593;2189;12.2507
ERROR:swh.storage.proxies.filter:content add entry count: 1827
ERROR:swh.storage.proxies.filter:content add missing: 1827 (0.0520)
ERROR:swh.storage.proxies.filter:content added in 9.8652
ERROR:swh.storage.proxies.filter:CSV:content;1827;0.0520;1827;9.8652
ERROR:swh.storage.proxies.filter:content add entry count: 943
ERROR:swh.storage.proxies.filter:content add missing: 943 (0.0306)
ERROR:swh.storage.proxies.filter:content added in 6.7277
ERROR:swh.storage.proxies.filter:CSV:content;943;0.0306;943;6.7277
ERROR:swh.storage.proxies.filter:content add entry count: 712
ERROR:swh.storage.proxies.filter:content add missing: 712 (0.0225)
ERROR:swh.storage.proxies.filter:content added in 7.2494
ERROR:swh.storage.proxies.filter:CSV:content;712;0.0225;712;7.2494
ERROR:swh.storage.proxies.filter:content add entry count: 1411
ERROR:swh.storage.proxies.filter:content add missing: 1411 (0.0400)
ERROR:swh.storage.proxies.filter:content added in 9.7196
ERROR:swh.storage.proxies.filter:CSV:content;1411;0.0400;1411;9.7196
ERROR:swh.storage.proxies.filter:content add entry count: 1152
ERROR:swh.storage.proxies.filter:content add missing: 1152 (0.0349)
ERROR:swh.storage.proxies.filter:content added in 7.3999
ERROR:swh.storage.proxies.filter:CSV:content;1152;0.0349;1152;7.3999
ERROR:swh.storage.proxies.filter:content add entry count: 855
ERROR:swh.storage.proxies.filter:content add missing: 855 (0.0262)
ERROR:swh.storage.proxies.filter:content added in 7.2894
ERROR:swh.storage.proxies.filter:CSV:content;855;0.0262;855;7.2894
ERROR:swh.storage.proxies.filter:content add entry count: 901
ERROR:swh.storage.proxies.filter:content add missing: 901 (0.0273)
ERROR:swh.storage.proxies.filter:content added in 7.3841
ERROR:swh.storage.proxies.filter:CSV:content;901;0.0273;901;7.3841
ERROR:swh.storage.proxies.filter:content add entry count: 1326
ERROR:swh.storage.proxies.filter:content add missing: 1326 (0.0411)
ERROR:swh.storage.proxies.filter:content added in 7.5884
ERROR:swh.storage.proxies.filter:CSV:content;1326;0.0411;1326;7.5884
ERROR:swh.storage.proxies.filter:content add entry count: 2114
ERROR:swh.storage.proxies.filter:content add missing: 2114 (0.0603)
ERROR:swh.storage.proxies.filter:content added in 11.2039
ERROR:swh.storage.proxies.filter:CSV:content;2114;0.0603;2114;11.2039
ERROR:swh.storage.proxies.filter:content add entry count: 1001
ERROR:swh.storage.proxies.filter:content add missing: 1001 (0.0302)
ERROR:swh.storage.proxies.filter:content added in 7.4243
ERROR:swh.storage.proxies.filter:CSV:content;1001;0.0302;1001;7.4243
ERROR:swh.storage.proxies.filter:content add entry count: 1730
ERROR:swh.storage.proxies.filter:content add missing: 1730 (0.0491)
ERROR:swh.storage.proxies.filter:content added in 9.4988
ERROR:swh.storage.proxies.filter:CSV:content;1730;0.0491;1730;9.4988
ERROR:swh.storage.proxies.filter:content add entry count: 2390
ERROR:swh.storage.proxies.filter:content add missing: 2390 (0.0672)
ERROR:swh.storage.proxies.filter:content added in 11.7018
ERROR:swh.storage.proxies.filter:CSV:content;2390;0.0672;2390;11.7018
ERROR:swh.storage.proxies.filter:content add entry count: 944
ERROR:swh.storage.proxies.filter:content add missing: 944 (0.0278)
ERROR:swh.storage.proxies.filter:content added in 7.8284
ERROR:swh.storage.proxies.filter:CSV:content;944;0.0278;944;7.8284
ERROR:swh.storage.proxies.filter:content add entry count: 901
ERROR:swh.storage.proxies.filter:content add missing: 901 (0.0269)
ERROR:swh.storage.proxies.filter:content added in 7.0781
ERROR:swh.storage.proxies.filter:CSV:content;901;0.0269;901;7.0781
ERROR:swh.storage.proxies.filter:content add entry count: 603
ERROR:swh.storage.proxies.filter:content add missing: 603 (0.0197)
ERROR:swh.storage.proxies.filter:content added in 5.2506
ERROR:swh.storage.proxies.filter:CSV:content;603;0.0197;603;5.2506
ERROR:swh.storage.proxies.filter:content add entry count: 529
ERROR:swh.storage.proxies.filter:content add missing: 529 (0.0179)
ERROR:swh.storage.proxies.filter:content added in 5.1538
ERROR:swh.storage.proxies.filter:CSV:content;529;0.0179;529;5.1538
ERROR:swh.storage.proxies.filter:content add entry count: 360
ERROR:swh.storage.proxies.filter:content add missing: 360 (0.0133)
ERROR:swh.storage.proxies.filter:content added in 5.1948
ERROR:swh.storage.proxies.filter:CSV:content;360;0.0133;360;5.1948
ERROR:swh.storage.proxies.filter:content add entry count: 634
ERROR:swh.storage.proxies.filter:content add missing: 634 (0.0202)
ERROR:swh.storage.proxies.filter:content added in 6.8159
ERROR:swh.storage.proxies.filter:CSV:content;634;0.0202;634;6.8159
ERROR:swh.storage.proxies.filter:content add entry count: 970
ERROR:swh.storage.proxies.filter:content add missing: 970 (0.0287)
ERROR:swh.storage.proxies.filter:content added in 6.5356
ERROR:swh.storage.proxies.filter:CSV:content;970;0.0287;970;6.5356
ERROR:swh.storage.proxies.filter:content add entry count: 1801
ERROR:swh.storage.proxies.filter:content add missing: 1801 (0.0497)
ERROR:swh.storage.proxies.filter:content added in 9.8417
ERROR:swh.storage.proxies.filter:CSV:content;1801;0.0497;1801;9.8417
ERROR:swh.storage.proxies.filter:content add entry count: 1108
ERROR:swh.storage.proxies.filter:content add missing: 1108 (0.0319)
ERROR:swh.storage.proxies.filter:content added in 8.4746
ERROR:swh.storage.proxies.filter:CSV:content;1108;0.0319;1108;8.4746
ERROR:swh.storage.proxies.filter:content add entry count: 373
ERROR:swh.storage.proxies.filter:content add missing: 373 (0.0140)
ERROR:swh.storage.proxies.filter:content added in 5.0093
ERROR:swh.storage.proxies.filter:CSV:content;373;0.0140;373;5.0093
ERROR:swh.storage.proxies.filter:content add entry count: 1508
ERROR:swh.storage.proxies.filter:content add missing: 1508 (0.0415)
ERROR:swh.storage.proxies.filter:content added in 7.4435
ERROR:swh.storage.proxies.filter:CSV:content;1508;0.0415;1508;7.4435
ERROR:swh.storage.proxies.filter:content add entry count: 2877
ERROR:swh.storage.proxies.filter:content add missing: 2877 (0.0764)
ERROR:swh.storage.proxies.filter:content added in 18.6936
ERROR:swh.storage.proxies.filter:CSV:content;2877;0.0764;2877;18.6936
ERROR:swh.storage.proxies.filter:content add entry count: 906
ERROR:swh.storage.proxies.filter:content add missing: 906 (0.0270)
ERROR:swh.storage.proxies.filter:content added in 7.8535
ERROR:swh.storage.proxies.filter:CSV:content;906;0.0270;906;7.8535
ERROR:swh.storage.proxies.filter:content add entry count: 710
ERROR:swh.storage.proxies.filter:content add missing: 710 (0.0228)
ERROR:swh.storage.proxies.filter:content added in 5.4946
ERROR:swh.storage.proxies.filter:CSV:content;710;0.0228;710;5.4946
ERROR:swh.storage.proxies.filter:content add entry count: 1359
ERROR:swh.storage.proxies.filter:content add missing: 1359 (0.0396)
ERROR:swh.storage.proxies.filter:content added in 8.8939
ERROR:swh.storage.proxies.filter:CSV:content;1359;0.0396;1359;8.8939
ERROR:swh.storage.proxies.filter:content add entry count: 1032
ERROR:swh.storage.proxies.filter:content add missing: 1032 (0.0305)
ERROR:swh.storage.proxies.filter:content added in 7.8425
ERROR:swh.storage.proxies.filter:CSV:content;1032;0.0305;1032;7.8425
ERROR:swh.storage.proxies.filter:content add entry count: 1279
ERROR:swh.storage.proxies.filter:content add missing: 1279 (0.0364)
ERROR:swh.storage.proxies.filter:content added in 7.3559
ERROR:swh.storage.proxies.filter:CSV:content;1279;0.0364;1279;7.3559
ERROR:swh.storage.proxies.filter:content add entry count: 757
ERROR:swh.storage.proxies.filter:content add missing: 757 (0.0239)
ERROR:swh.storage.proxies.filter:content added in 6.6840
ERROR:swh.storage.proxies.filter:CSV:content;757;0.0239;757;6.6840
ERROR:swh.storage.proxies.filter:content add entry count: 445
ERROR:swh.storage.proxies.filter:content add missing: 445 (0.0155)
ERROR:swh.storage.proxies.filter:content added in 6.2882
ERROR:swh.storage.proxies.filter:CSV:content;445;0.0155;445;6.2882
ERROR:swh.storage.proxies.filter:content add entry count: 841
ERROR:swh.storage.proxies.filter:content add missing: 841 (0.0243)
ERROR:swh.storage.proxies.filter:content added in 7.3486
ERROR:swh.storage.proxies.filter:CSV:content;841;0.0243;841;7.3486
ERROR:swh.storage.proxies.filter:content add entry count: 1303
ERROR:swh.storage.proxies.filter:content add missing: 1303 (0.0371)
ERROR:swh.storage.proxies.filter:content added in 7.5463
ERROR:swh.storage.proxies.filter:CSV:content;1303;0.0371;1303;7.5463
ERROR:swh.storage.proxies.filter:content add entry count: 1528
ERROR:swh.storage.proxies.filter:content add missing: 1528 (0.0426)
ERROR:swh.storage.proxies.filter:content added in 9.4796
ERROR:swh.storage.proxies.filter:CSV:content;1528;0.0426;1528;9.4796
ERROR:swh.storage.proxies.filter:content add entry count: 1571
ERROR:swh.storage.proxies.filter:content add missing: 1571 (0.0441)
ERROR:swh.storage.proxies.filter:content added in 9.8403
ERROR:swh.storage.proxies.filter:CSV:content;1571;0.0441;1571;9.8403
ERROR:swh.storage.proxies.filter:content add entry count: 2857
ERROR:swh.storage.proxies.filter:content add missing: 2857 (0.0770)
ERROR:swh.storage.proxies.filter:content added in 13.4324
ERROR:swh.storage.proxies.filter:CSV:content;2857;0.0770;2857;13.4324
ERROR:swh.storage.proxies.filter:content add entry count: 1071
ERROR:swh.storage.proxies.filter:content add missing: 1071 (0.0312)
ERROR:swh.storage.proxies.filter:content added in 9.2093
ERROR:swh.storage.proxies.filter:CSV:content;1071;0.0312;1071;9.2093
ERROR:swh.storage.proxies.filter:content add entry count: 387
ERROR:swh.storage.proxies.filter:content add missing: 387 (0.0139)
ERROR:swh.storage.proxies.filter:content added in 5.1294
ERROR:swh.storage.proxies.filter:CSV:content;387;0.0139;387;5.1294
ERROR:swh.storage.proxies.filter:content add entry count: 283
ERROR:swh.storage.proxies.filter:content add missing: 283 (0.0115)
ERROR:swh.storage.proxies.filter:content added in 4.5900
ERROR:swh.storage.proxies.filter:CSV:content;283;0.0115;283;4.5900
ERROR:swh.storage.proxies.filter:content add entry count: 303
ERROR:swh.storage.proxies.filter:content add missing: 303 (0.0127)
ERROR:swh.storage.proxies.filter:content added in 4.4976
ERROR:swh.storage.proxies.filter:CSV:content;303;0.0127;303;4.4976
ERROR:swh.storage.proxies.filter:content add entry count: 319
ERROR:swh.storage.proxies.filter:content add missing: 319 (0.0133)
ERROR:swh.storage.proxies.filter:content added in 4.5650
ERROR:swh.storage.proxies.filter:CSV:content;319;0.0133;319;4.5650
ERROR:swh.storage.proxies.filter:content add entry count: 3912
ERROR:swh.storage.proxies.filter:content add missing: 3912 (0.1003)
ERROR:swh.storage.proxies.filter:content added in 16.1590
ERROR:swh.storage.proxies.filter:CSV:content;3912;0.1003;3912;16.1590
ERROR:swh.storage.proxies.filter:content add entry count: 7295
ERROR:swh.storage.proxies.filter:content add missing: 7295 (0.2176)
ERROR:swh.storage.proxies.filter:content added in 29.9947
ERROR:swh.storage.proxies.filter:CSV:content;7295;0.2176;7295;29.9947
ERROR:swh.storage.proxies.filter:content add entry count: 5411
ERROR:swh.storage.proxies.filter:content add missing: 5411 (0.1415)
ERROR:swh.storage.proxies.filter:content added in 24.4733
ERROR:swh.storage.proxies.filter:CSV:content;5411;0.1415;5411;24.4733
ERROR:swh.storage.proxies.filter:content add entry count: 3793
ERROR:swh.storage.proxies.filter:content add missing: 3793 (0.1123)
ERROR:swh.storage.proxies.filter:content added in 16.1940
ERROR:swh.storage.proxies.filter:CSV:content;3793;0.1123;3793;16.1940
ERROR:swh.storage.proxies.filter:content add entry count: 6100
ERROR:swh.storage.proxies.filter:content add missing: 6100 (0.1582)
ERROR:swh.storage.proxies.filter:content added in 25.3647
ERROR:swh.storage.proxies.filter:CSV:content;6100;0.1582;6100;25.3647
ERROR:swh.storage.proxies.filter:content add entry count: 2835
ERROR:swh.storage.proxies.filter:content add missing: 2835 (0.0756)
ERROR:swh.storage.proxies.filter:content added in 15.6425
ERROR:swh.storage.proxies.filter:CSV:content;2835;0.0756;2835;15.6425
ERROR:swh.storage.proxies.filter:content add entry count: 407
ERROR:swh.storage.proxies.filter:content add missing: 407 (0.0151)
ERROR:swh.storage.proxies.filter:content added in 5.1052
ERROR:swh.storage.proxies.filter:CSV:content;407;0.0151;407;5.1052
ERROR:swh.storage.proxies.filter:content add entry count: 301
ERROR:swh.storage.proxies.filter:content add missing: 301 (0.0119)
ERROR:swh.storage.proxies.filter:content added in 4.9117
ERROR:swh.storage.proxies.filter:CSV:content;301;0.0119;301;4.9117
ERROR:swh.storage.proxies.filter:content add entry count: 1655
ERROR:swh.storage.proxies.filter:content add missing: 1655 (0.0466)
ERROR:swh.storage.proxies.filter:content added in 8.8948
ERROR:swh.storage.proxies.filter:CSV:content;1655;0.0466;1655;8.8948
ERROR:swh.storage.proxies.filter:content add entry count: 2230
ERROR:swh.storage.proxies.filter:content add missing: 2230 (0.0606)
ERROR:swh.storage.proxies.filter:content added in 11.4969
ERROR:swh.storage.proxies.filter:CSV:content;2230;0.0606;2230;11.4969
ERROR:swh.storage.proxies.filter:content add entry count: 195
ERROR:swh.storage.proxies.filter:content add missing: 195 (0.0089)
ERROR:swh.storage.proxies.filter:content added in 5.1936
ERROR:swh.storage.proxies.filter:CSV:content;195;0.0089;195;5.1936
ERROR:swh.storage.proxies.filter:content add entry count: 2189
ERROR:swh.storage.proxies.filter:content add missing: 2189 (0.0572)
ERROR:swh.storage.proxies.filter:content added in 11.9555
ERROR:swh.storage.proxies.filter:CSV:content;2189;0.0572;2189;11.9555
ERROR:swh.storage.proxies.filter:content add entry count: 1949
ERROR:swh.storage.proxies.filter:content add missing: 1949 (0.0637)
ERROR:swh.storage.proxies.filter:content added in 10.4316
ERROR:swh.storage.proxies.filter:CSV:content;1949;0.0637;1949;10.4316
ERROR:swh.storage.proxies.filter:content add entry count: 3710
ERROR:swh.storage.proxies.filter:content add missing: 3710 (0.0983)
ERROR:swh.storage.proxies.filter:content added in 16.8716
ERROR:swh.storage.proxies.filter:CSV:content;3710;0.0983;3710;16.8716
ERROR:swh.storage.proxies.filter:content add entry count: 3570
ERROR:swh.storage.proxies.filter:content add missing: 3570 (0.0975)
ERROR:swh.storage.proxies.filter:content added in 14.9597
ERROR:swh.storage.proxies.filter:CSV:content;3570;0.0975;3570;14.9597
ERROR:swh.storage.proxies.filter:content add entry count: 1950
ERROR:swh.storage.proxies.filter:content add missing: 1950 (0.0588)
ERROR:swh.storage.proxies.filter:content added in 11.4481
ERROR:swh.storage.proxies.filter:CSV:content;1950;0.0588;1950;11.4481
ERROR:swh.storage.proxies.filter:content add entry count: 899
ERROR:swh.storage.proxies.filter:content add missing: 899 (0.0264)
ERROR:swh.storage.proxies.filter:content added in 7.4291
ERROR:swh.storage.proxies.filter:CSV:content;899;0.0264;899;7.4291
ERROR:swh.storage.proxies.filter:content add entry count: 918
ERROR:swh.storage.proxies.filter:content add missing: 918 (0.0267)
ERROR:swh.storage.proxies.filter:content added in 6.5781
ERROR:swh.storage.proxies.filter:CSV:content;918;0.0267;918;6.5781
ERROR:swh.storage.proxies.filter:content add entry count: 763
ERROR:swh.storage.proxies.filter:content add missing: 763 (0.0230)
ERROR:swh.storage.proxies.filter:content added in 6.3098
ERROR:swh.storage.proxies.filter:CSV:content;763;0.0230;763;6.3098
ERROR:swh.storage.proxies.filter:content add entry count: 1379
ERROR:swh.storage.proxies.filter:content add missing: 1379 (0.0380)
ERROR:swh.storage.proxies.filter:content added in 8.9759
ERROR:swh.storage.proxies.filter:CSV:content;1379;0.0380;1379;8.9759
ERROR:swh.storage.proxies.filter:content add entry count: 218
ERROR:swh.storage.proxies.filter:content add missing: 218 (0.0104)
ERROR:swh.storage.proxies.filter:content added in 5.0886
ERROR:swh.storage.proxies.filter:CSV:content;218;0.0104;218;5.0886
ERROR:swh.storage.proxies.filter:content add entry count: 226
ERROR:swh.storage.proxies.filter:content add missing: 226 (0.0113)
ERROR:swh.storage.proxies.filter:content added in 4.8587
ERROR:swh.storage.proxies.filter:CSV:content;226;0.0113;226;4.8587
ERROR:swh.storage.proxies.filter:content add entry count: 227
ERROR:swh.storage.proxies.filter:content add missing: 227 (0.0100)
ERROR:swh.storage.proxies.filter:content added in 4.7927
ERROR:swh.storage.proxies.filter:CSV:content;227;0.0100;227;4.7927
ERROR:swh.storage.proxies.filter:content add entry count: 229
ERROR:swh.storage.proxies.filter:content add missing: 229 (0.0105)
ERROR:swh.storage.proxies.filter:content added in 4.8243
ERROR:swh.storage.proxies.filter:CSV:content;229;0.0105;229;4.8243
ERROR:swh.storage.proxies.filter:content add entry count: 234
ERROR:swh.storage.proxies.filter:content add missing: 234 (0.0105)
ERROR:swh.storage.proxies.filter:content added in 4.7802
ERROR:swh.storage.proxies.filter:CSV:content;234;0.0105;234;4.7802
ERROR:swh.storage.proxies.filter:content add entry count: 233
ERROR:swh.storage.proxies.filter:content add missing: 233 (0.0117)
ERROR:swh.storage.proxies.filter:content added in 4.8200
ERROR:swh.storage.proxies.filter:CSV:content;233;0.0117;233;4.8200
ERROR:swh.storage.proxies.filter:content add entry count: 244
ERROR:swh.storage.proxies.filter:content add missing: 244 (0.0110)
ERROR:swh.storage.proxies.filter:content added in 4.8698
ERROR:swh.storage.proxies.filter:CSV:content;244;0.0110;244;4.8698
ERROR:swh.storage.proxies.filter:content add entry count: 238
ERROR:swh.storage.proxies.filter:content add missing: 238 (0.0104)
ERROR:swh.storage.proxies.filter:content added in 4.7837
ERROR:swh.storage.proxies.filter:CSV:content;238;0.0104;238;4.7837
ERROR:swh.storage.proxies.filter:content add entry count: 596
ERROR:swh.storage.proxies.filter:content add missing: 596 (0.0193)
ERROR:swh.storage.proxies.filter:content added in 5.4965
ERROR:swh.storage.proxies.filter:CSV:content;596;0.0193;596;5.4965
ERROR:swh.storage.proxies.filter:content add entry count: 2128
ERROR:swh.storage.proxies.filter:content add missing: 2128 (0.0603)
ERROR:swh.storage.proxies.filter:content added in 10.5233
ERROR:swh.storage.proxies.filter:CSV:content;2128;0.0603;2128;10.5233
ERROR:swh.storage.proxies.filter:content add entry count: 469
ERROR:swh.storage.proxies.filter:content add missing: 469 (0.0164)
ERROR:swh.storage.proxies.filter:content added in 5.6185
ERROR:swh.storage.proxies.filter:CSV:content;469;0.0164;469;5.6185
ERROR:swh.storage.proxies.filter:content add entry count: 3073
ERROR:swh.storage.proxies.filter:content add missing: 3073 (0.0799)
ERROR:swh.storage.proxies.filter:content added in 13.1439
ERROR:swh.storage.proxies.filter:CSV:content;3073;0.0799;3073;13.1439
ERROR:swh.storage.proxies.filter:content add entry count: 2717
ERROR:swh.storage.proxies.filter:content add missing: 2717 (0.0720)
ERROR:swh.storage.proxies.filter:content added in 14.2871
ERROR:swh.storage.proxies.filter:CSV:content;2717;0.0720;2717;14.2871
ERROR:swh.storage.proxies.filter:content add entry count: 2723
ERROR:swh.storage.proxies.filter:content add missing: 2723 (0.0789)
ERROR:swh.storage.proxies.filter:content added in 11.8173
ERROR:swh.storage.proxies.filter:CSV:content;2723;0.0789;2723;11.8173
ERROR:swh.storage.proxies.filter:content add entry count: 2484
ERROR:swh.storage.proxies.filter:content add missing: 2484 (0.0672)
ERROR:swh.storage.proxies.filter:content added in 13.5545
ERROR:swh.storage.proxies.filter:CSV:content;2484;0.0672;2484;13.5545
ERROR:swh.storage.proxies.filter:content add entry count: 2656
ERROR:swh.storage.proxies.filter:content add missing: 2656 (0.0729)
ERROR:swh.storage.proxies.filter:content added in 11.4761
ERROR:swh.storage.proxies.filter:CSV:content;2656;0.0729;2656;11.4761
ERROR:swh.storage.proxies.filter:content add entry count: 2706
ERROR:swh.storage.proxies.filter:content add missing: 2706 (0.0729)
ERROR:swh.storage.proxies.filter:content added in 14.5686
ERROR:swh.storage.proxies.filter:CSV:content;2706;0.0729;2706;14.5686
ERROR:swh.storage.proxies.filter:content add entry count: 2811
ERROR:swh.storage.proxies.filter:content add missing: 2811 (0.0750)
ERROR:swh.storage.proxies.filter:content added in 11.9743
ERROR:swh.storage.proxies.filter:CSV:content;2811;0.0750;2811;11.9743
ERROR:swh.storage.proxies.filter:content add entry count: 3327
ERROR:swh.storage.proxies.filter:content add missing: 3327 (0.0878)
ERROR:swh.storage.proxies.filter:content added in 16.8089
ERROR:swh.storage.proxies.filter:CSV:content;3327;0.0878;3327;16.8089
ERROR:swh.storage.proxies.filter:content add entry count: 2298
ERROR:swh.storage.proxies.filter:content add missing: 2298 (0.0620)
ERROR:swh.storage.proxies.filter:content added in 10.3004
ERROR:swh.storage.proxies.filter:CSV:content;2298;0.0620;2298;10.3004
ERROR:swh.storage.proxies.filter:content add entry count: 2142
ERROR:swh.storage.proxies.filter:content add missing: 2142 (0.0585)
ERROR:swh.storage.proxies.filter:content added in 12.0858
ERROR:swh.storage.proxies.filter:CSV:content;2142;0.0585;2142;12.0858
ERROR:swh.storage.proxies.filter:content add entry count: 2024
ERROR:swh.storage.proxies.filter:content add missing: 2024 (0.0553)
ERROR:swh.storage.proxies.filter:content added in 11.1887
ERROR:swh.storage.proxies.filter:CSV:content;2024;0.0553;2024;11.1887
ERROR:swh.storage.proxies.filter:content add entry count: 1407
ERROR:swh.storage.proxies.filter:content add missing: 1407 (0.0400)
ERROR:swh.storage.proxies.filter:content added in 7.1409
ERROR:swh.storage.proxies.filter:CSV:content;1407;0.0400;1407;7.1409
ERROR:swh.storage.proxies.filter:content add entry count: 1401
ERROR:swh.storage.proxies.filter:content add missing: 1401 (0.0380)
ERROR:swh.storage.proxies.filter:content added in 8.8943
ERROR:swh.storage.proxies.filter:CSV:content;1401;0.0380;1401;8.8943
ERROR:swh.storage.proxies.filter:content add entry count: 2157
ERROR:swh.storage.proxies.filter:content add missing: 2157 (0.0580)
ERROR:swh.storage.proxies.filter:content added in 11.8803
ERROR:swh.storage.proxies.filter:CSV:content;2157;0.0580;2157;11.8803
ERROR:swh.storage.proxies.filter:content add entry count: 2010
ERROR:swh.storage.proxies.filter:content add missing: 2010 (0.0556)
ERROR:swh.storage.proxies.filter:content added in 15.4499
ERROR:swh.storage.proxies.filter:CSV:content;2010;0.0556;2010;15.4499
ERROR:swh.storage.proxies.filter:content add entry count: 1645
ERROR:swh.storage.proxies.filter:content add missing: 1645 (0.0467)
ERROR:swh.storage.proxies.filter:content added in 9.7168
ERROR:swh.storage.proxies.filter:CSV:content;1645;0.0467;1645;9.7168
ERROR:swh.storage.proxies.filter:content add entry count: 2328
ERROR:swh.storage.proxies.filter:content add missing: 2328 (0.0671)
ERROR:swh.storage.proxies.filter:content added in 12.7289
ERROR:swh.storage.proxies.filter:CSV:content;2328;0.0671;2328;12.7289
ERROR:swh.storage.proxies.filter:content add entry count: 2203
ERROR:swh.storage.proxies.filter:content add missing: 2203 (0.0605)
ERROR:swh.storage.proxies.filter:content added in 12.6504
ERROR:swh.storage.proxies.filter:CSV:content;2203;0.0605;2203;12.6504
ERROR:swh.storage.proxies.filter:content add entry count: 2901
ERROR:swh.storage.proxies.filter:content add missing: 2901 (0.0750)
ERROR:swh.storage.proxies.filter:content added in 12.5048
ERROR:swh.storage.proxies.filter:CSV:content;2901;0.0750;2901;12.5048
ERROR:swh.storage.proxies.filter:content add entry count: 1361
ERROR:swh.storage.proxies.filter:content add missing: 1361 (0.0385)
ERROR:swh.storage.proxies.filter:content added in 9.1482
ERROR:swh.storage.proxies.filter:CSV:content;1361;0.0385;1361;9.1482
ERROR:swh.storage.proxies.filter:content add entry count: 802
ERROR:swh.storage.proxies.filter:content add missing: 802 (0.0248)
ERROR:swh.storage.proxies.filter:content added in 6.9956
ERROR:swh.storage.proxies.filter:CSV:content;802;0.0248;802;6.9956
ERROR:swh.storage.proxies.filter:content add entry count: 544
ERROR:swh.storage.proxies.filter:content add missing: 544 (0.0185)
ERROR:swh.storage.proxies.filter:content added in 5.3155
ERROR:swh.storage.proxies.filter:CSV:content;544;0.0185;544;5.3155
ERROR:swh.storage.proxies.filter:content add entry count: 905
ERROR:swh.storage.proxies.filter:content add missing: 905 (0.0270)
ERROR:swh.storage.proxies.filter:content added in 5.7416
ERROR:swh.storage.proxies.filter:CSV:content;905;0.0270;905;5.7416
ERROR:swh.storage.proxies.filter:content add entry count: 910
ERROR:swh.storage.proxies.filter:content add missing: 910 (0.0272)
ERROR:swh.storage.proxies.filter:content added in 6.5590
ERROR:swh.storage.proxies.filter:CSV:content;910;0.0272;910;6.5590
ERROR:swh.storage.proxies.filter:content add entry count: 2668
ERROR:swh.storage.proxies.filter:content add missing: 2668 (0.0717)
ERROR:swh.storage.proxies.filter:content added in 11.5965
ERROR:swh.storage.proxies.filter:CSV:content;2668;0.0717;2668;11.5965
ERROR:swh.storage.proxies.filter:content add entry count: 3505
ERROR:swh.storage.proxies.filter:content add missing: 3505 (0.0916)
ERROR:swh.storage.proxies.filter:content added in 17.7895
ERROR:swh.storage.proxies.filter:CSV:content;3505;0.0916;3505;17.7895
ERROR:swh.storage.proxies.filter:content add entry count: 2671
ERROR:swh.storage.proxies.filter:content add missing: 2671 (0.0812)
ERROR:swh.storage.proxies.filter:content added in 13.9136
ERROR:swh.storage.proxies.filter:CSV:content;2671;0.0812;2671;13.9136
ERROR:swh.storage.proxies.filter:content add entry count: 2897
ERROR:swh.storage.proxies.filter:content add missing: 2897 (0.0777)
ERROR:swh.storage.proxies.filter:content added in 13.4448
ERROR:swh.storage.proxies.filter:CSV:content;2897;0.0777;2897;13.4448
ERROR:swh.storage.proxies.filter:content add entry count: 2141
ERROR:swh.storage.proxies.filter:content add missing: 2141 (0.0576)
ERROR:swh.storage.proxies.filter:content added in 11.8011
ERROR:swh.storage.proxies.filter:CSV:content;2141;0.0576;2141;11.8011
ERROR:swh.storage.proxies.filter:content add entry count: 2424
ERROR:swh.storage.proxies.filter:content add missing: 2424 (0.0653)
ERROR:swh.storage.proxies.filter:content added in 10.2063
ERROR:swh.storage.proxies.filter:CSV:content;2424;0.0653;2424;10.2063
ERROR:swh.storage.proxies.filter:content add entry count: 2224
ERROR:swh.storage.proxies.filter:content add missing: 2224 (0.0610)
ERROR:swh.storage.proxies.filter:content added in 12.6620
ERROR:swh.storage.proxies.filter:CSV:content;2224;0.0610;2224;12.6620
ERROR:swh.storage.proxies.filter:content add entry count: 1977
ERROR:swh.storage.proxies.filter:content add missing: 1977 (0.0544)
ERROR:swh.storage.proxies.filter:content added in 10.1596
ERROR:swh.storage.proxies.filter:CSV:content;1977;0.0544;1977;10.1596
ERROR:swh.storage.proxies.filter:content add entry count: 1965
ERROR:swh.storage.proxies.filter:content add missing: 1965 (0.0541)
ERROR:swh.storage.proxies.filter:content added in 10.5019
ERROR:swh.storage.proxies.filter:CSV:content;1965;0.0541;1965;10.5019
ERROR:swh.storage.proxies.filter:content add entry count: 2738
ERROR:swh.storage.proxies.filter:content add missing: 2738 (0.0743)
ERROR:swh.storage.proxies.filter:content added in 14.6059
ERROR:swh.storage.proxies.filter:CSV:content;2738;0.0743;2738;14.6059
ERROR:swh.storage.proxies.filter:content add entry count: 785
ERROR:swh.storage.proxies.filter:content add missing: 785 (0.0242)
ERROR:swh.storage.proxies.filter:content added in 5.8886
ERROR:swh.storage.proxies.filter:CSV:content;785;0.0242;785;5.8886
ERROR:swh.storage.proxies.filter:content add entry count: 353
ERROR:swh.storage.proxies.filter:content add missing: 353 (0.0131)
ERROR:swh.storage.proxies.filter:content added in 5.1145
ERROR:swh.storage.proxies.filter:CSV:content;353;0.0131;353;5.1145
ERROR:swh.storage.proxies.filter:content add entry count: 1275
ERROR:swh.storage.proxies.filter:content add missing: 1275 (0.0360)
ERROR:swh.loader.git.loader.GitLoader:Loading failure, updating to `failed` status
Traceback (most recent call last):
  File "/src/swh-loader-core/swh/loader/core/loader.py", line 339, in load
    self.store_data(create_snapshot=not more_data_to_fetch)
  File "/src/swh-loader-git/swh/loader/git/loader.py", line 416, in store_data
    super().store_data(create_snapshot)
  File "/src/swh-loader-core/swh/loader/core/loader.py", line 451, in store_data
    self.storage.content_add([obj])
  File "/src/swh-storage/swh/storage/proxies/buffer.py", line 111, in content_add
    return self.flush(["content"])
  File "/src/swh-storage/swh/storage/proxies/buffer.py", line 156, in flush
    stats = add_fn(list(batch))
  File "/src/swh-storage/swh/storage/proxies/filter.py", line 52, in content_add
    [x for x in content if x.sha256 in contents_to_add]
  File "/src/swh-storage/swh/storage/api/client.py", line 45, in content_add
    return self.post("content/add", {"content": content})
  File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 278, in post
    return self._decode_response(response)
  File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 354, in _decode_response
    self.raise_for_status(response)
  File "/src/swh-storage/swh/storage/api/client.py", line 29, in raise_for_status
    super().raise_for_status(response)
  File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 344, in raise_for_status
    raise exception from None
swh.core.api.RemoteException: <RemoteException 500 ObjStorageAPIError: [ConnectionError(ProtocolError('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')))]>
ERROR:swh.storage.proxies.filter:content add entry count: 1275
ERROR:swh.storage.proxies.filter:content add missing: 1275 (0.0510)
ERROR:swh.storage.proxies.filter:content added in 8.1969
ERROR:swh.storage.proxies.filter:CSV:content;1275;0.0510;1275;8.1969
{'status': 'failed'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/torvalds/linux"
        User time (seconds): 8261.02
        System time (seconds): 176.85
        Percent of CPU this job got: 30%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 7:35:36
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 2063056
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 195
        Minor (reclaiming a frame) page faults: 39150174
        Voluntary context switches: 264615
        Involuntary context switches: 162105
        Swaps: 0
        File system inputs: 498416
        File system outputs: 4795864
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0
  • staging with patch D6392

ingestion:

(ve) swhworker@worker0:~$ /usr/bin/time -v swh loader run git https://github.com/torvalds/linux
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/torvalds/linux' with type 'git'
Enumerating objects: 8353861, done.
Total 8353861 (delta 0), reused 0 (delta 0), pack-reused 8353861
INFO:swh.loader.git.loader:Listed 1496 refs for repo https://github.com/torvalds/linux
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/torvalds/linux"
        User time (seconds): 19905.21
        System time (seconds): 500.76
        Percent of CPU this job got: 81%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 6:59:16
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 1361324
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 1
        Minor (reclaiming a frame) page faults: 3352158
        Voluntary context switches: 2960050
        Involuntary context switches: 2134013
        Swaps: 0
        File system inputs: 488
        File system outputs: 6838560
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

16:48:27 swh@db1:5432=> select now(), date, status, snapshot from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/torvalds/linux' and ovs.type='git' order by date desc limit 2;
+----------------------------+-------------------------------+---------+--------------------------------------------+
|            now             |             date              | status  |                  snapshot                  |
+----------------------------+-------------------------------+---------+--------------------------------------------+
| 2021-10-02 14:48:35.123+00 | 2021-10-02 13:36:12.560135+00 | full    | \xc2847dfd741eae21606027cf29250d1ebcd63fb4 |
| 2021-10-02 14:48:35.123+00 | 2021-10-02 06:36:57.707116+00 | created | (null)                                     |
+----------------------------+-------------------------------+---------+--------------------------------------------+
(2 rows)

Time: 7.116 ms
  • worker17: production with current v1.1.1

ingestion: 11Mib ram

  swhworker@worker17:~$ /usr/bin/time -v swh loader run git https://github.com/torvalds/linux
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/torvalds/linux' with type 'git'
Enumerating objects: 8353862, done.
Total 8353862 (delta 0), reused 0 (delta 0), pack-reused 8353862
INFO:swh.loader.git.loader.GitLoader:Listed 1496 refs for repo https://github.com/torvalds/linux
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/torvalds/linux"
        User time (seconds): 47134.21
        System time (seconds): 2516.52
        Percent of CPU this job got: 56%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 24:13:11
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 3080408
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 3
        Minor (reclaiming a frame) page faults: 11706500
        Voluntary context switches: 9110909
        Involuntary context switches: 17067607
        Swaps: 0
        File system inputs: 16
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

16:12:36 softwareheritage@belvedere:5432=> select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/torvalds/linux' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+-----------------------------------+--------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
|              now              | id |                url                | origin | visit |             date              | status  | metadata |                  snapshot                  | type |
+-------------------------------+----+-----------------------------------+--------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
| 2021-10-03 14:17:08.705558+00 |  2 | https://github.com/torvalds/linux |      2 |    76 | 2021-10-03 06:44:07.453708+00 | full    | (null)   | \xc2847dfd741eae21606027cf29250d1ebcd63fb4 | git  |
| 2021-10-03 14:17:08.705558+00 |  2 | https://github.com/torvalds/linux |      2 |    76 | 2021-10-02 06:31:00.466815+00 | created | (null)   | (null)                                     | git  |
+-------------------------------+----+-----------------------------------+--------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
(2 rows)

Time: 5.619 ms
  • CocoaPods/Specs
    • staging:

      ingestion:
      • 121Mib ram
      • 23:10:48
      • failed on mismatch hash which is unrelated
(ve) swhworker@worker1:~$ /usr/bin/time -v swh loader run git https://github.com/CocoaPods/Specs
qINFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/CocoaPods/Specs' with type 'git'
Enumerating objects: 5176632, done.
Counting objects: 100% (59/59), done.
Compressing objects: 100% (51/51), done.
Total 5176632 (delta 15), reused 28 (delta 5), pack-reused 5176573
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 33, done.
Counting objects: 100% (10/10), done.
Compressing objects: 100% (10/10), done.
Total 33 (delta 4), reused 0 (delta 0), pack-reused 23
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 4496, done.
Counting objects: 100% (543/543), done.
Compressing objects: 100% (200/200), done.
Total 4496 (delta 410), reused 343 (delta 343), pack-reused 3953
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 2040, done.
Counting objects: 100% (703/703), done.
Compressing objects: 100% (191/191), done.
Total 2040 (delta 577), reused 512 (delta 512), pack-reused 1337
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 25920, done.
Counting objects: 100% (499/499), done.
Compressing objects: 100% (162/162), done.
Total 25920 (delta 397), reused 337 (delta 337), pack-reused 25421
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 1636, done.
Counting objects: 100% (475/475), done.
Compressing objects: 100% (198/198), done.
Total 1636 (delta 350), reused 277 (delta 277), pack-reused 1161
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Enumerating objects: 5561, done.
Counting objects: 100% (549/549), done.
Compressing objects: 100% (227/227), done.
Total 5561 (delta 415), reused 322 (delta 322), pack-reused 5012
INFO:swh.loader.git.loader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
ERROR:swh.loader.git.loader.GitLoader:Loading failure, updating to `failed` status
Traceback (most recent call last):
  File "/home/swhworker/swh-loader-core/swh/loader/core/loader.py", line 339, in load
    self.store_data(create_snapshot=not more_data_to_fetch)
  File "/home/swhworker/swh-loader-git/swh/loader/git/loader.py", line 416, in store_data
    super().store_data(create_snapshot)
  File "/home/swhworker/swh-loader-core/swh/loader/core/loader.py", line 457, in store_data
    for directory in self.get_directories():
  File "/home/swhworker/swh-loader-git/swh/loader/git/loader.py", line 452, in get_directories
    yield converters.dulwich_tree_to_directory(raw_obj)
  File "/home/swhworker/swh-loader-git/swh/loader/git/converters.py", line 104, in dulwich_tree_to_directory
    check_id(dir_)
  File "/home/swhworker/swh-loader-git/swh/loader/git/converters.py", line 39, in check_id
    f"Expected {type(obj).__name__} hash to be {obj.id.hex()}, "
swh.loader.git.converters.HashMismatch: Expected Directory hash to be 4f81b2310d1d1179305326cce9bfd628ded1b5f6, got 3f70740362b567e569f0a84f3a0c0f4ca04836e7
{'status': 'failed'}
        Command being timed: "swh loader run git https://github.com/CocoaPods/Specs"
        User time (seconds): 73818.03
        System time (seconds): 1122.75
        Percent of CPU this job got: 89%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 23:10:48
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 5789344
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 31
        Minor (reclaiming a frame) page faults: 121229650
        Voluntary context switches: 8938885
        Involuntary context switches: 5298174
        Swaps: 0
        File system inputs: 337056
        File system outputs: 1814336
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096

no snapshot given the hash mismatch...
Could be taken care of if we make partial snapshot

  • worker18 (prod)

ingestion (killed):

swhworker@worker18:~$ /usr/bin/time -v swh loader run git https://github.com/CocoaPods/Specs
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/CocoaPods/Specs' with type 'git'
Enumerating objects: 5043861, done.
Counting objects: 100% (59/59), done.
Compressing objects: 100% (51/51), done.
Total 5043861 (delta 15), reused 28 (delta 5), pack-reused 5043802
INFO:swh.loader.git.loader.GitLoader:Listed 14036 refs for repo https://github.com/CocoaPods/Specs
Command terminated by signal 9
        Command being timed: "swh loader run git https://github.com/CocoaPods/Specs"
        User time (seconds): 23710.19
        System time (seconds): 715.48
        Percent of CPU this job got: 66%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 10:09:09
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 14280284
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 505
        Minor (reclaiming a frame) page faults: 9356497
        Voluntary context switches: 3972820
        Involuntary context switches: 5202889
        Swaps: 0
        File system inputs: 86800
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot (None, the snapshot seen is the last visit before this):

18:52:23 softwareheritage@belvedere:5432=> select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/CocoaPods/Specs' and ovs.type='git' order by date desc limit 2;
+-------------------------------+---------+------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
|              now              |   id    |                url                 | origin  | visit |             date              | status  | metadata |                  snapshot                  | type |
+-------------------------------+---------+------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
| 2021-10-02 16:52:32.464487+00 | 7850154 | https://github.com/CocoaPods/Specs | 7850154 |   170 | 2021-10-02 06:41:09.84538+00  | created | (null)   | (null)                                     | git  |
| 2021-10-02 16:52:32.464487+00 | 7850154 | https://github.com/CocoaPods/Specs | 7850154 |   169 | 2021-09-28 01:51:15.710907+00 | full    | (null)   | \x1d0e1caf4a7b996678af34e29bcb922aebb5ee8b | git  |
+-------------------------------+---------+------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
(2 rows)
  • cozy/cozy-stack (order on refs, first tags then branches)
  • docker

ingest:

swh@f33d64889043:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/cozy/cozy-stack
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7f39ce034f50>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 116
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39cb2d8f90> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=3118
DEBUG:swh.loader.git.loader:wanted_refs_count=3118
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 62389, done.
Counting objects: 100% (3707/3707), done.
Compressing objects: 100% (1237/1237), done.
Total 62389 (delta 2525), reused 3489 (delta 2415), pack-reused 58682
DEBUG:swh.loader.git.loader:fetched_pack_size=131019529
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 9201
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 312803
ERROR:swh.storage.proxies.filter:content add missing: 9200 (0.4461)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 51.0180
ERROR:swh.storage.proxies.filter:CSV:content;9201;0.4461;9200;51.0180
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 372
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 12651
ERROR:swh.storage.proxies.filter:content add missing: 372 (0.0166)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.1711
ERROR:swh.storage.proxies.filter:CSV:content;372;0.0166;372;7.1711
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0048)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.2141
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0048;23;5.2141
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0046)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.2303
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0046;23;5.2303
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0048)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.2669
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0048;23;5.2669
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.1882
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0047;23;5.1882
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 3137
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 106661
ERROR:swh.storage.proxies.filter:content add missing: 3137 (0.0725)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 20.8317
ERROR:swh.storage.proxies.filter:CSV:content;3137;0.0725;3137;20.8317
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 46
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1567
ERROR:swh.storage.proxies.filter:content add missing: 46 (0.0051)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.4398
ERROR:swh.storage.proxies.filter:CSV:content;46;0.0051;46;5.4398
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 487
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 16561
ERROR:swh.storage.proxies.filter:content add missing: 487 (0.0153)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.3555
ERROR:swh.storage.proxies.filter:CSV:content;487;0.0153;487;7.3555
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 32
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1091
ERROR:swh.storage.proxies.filter:content add missing: 32 (0.0050)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.3135
ERROR:swh.storage.proxies.filter:CSV:content;32;0.0050;32;5.3135
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 887
ERROR:swh.storage.proxies.filter:content add missing: 26 (0.0048)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.3753
ERROR:swh.storage.proxies.filter:CSV:content;26;0.0048;26;5.3753
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 118
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 4015
ERROR:swh.storage.proxies.filter:content add missing: 118 (0.0073)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.7745
ERROR:swh.storage.proxies.filter:CSV:content;118;0.0073;118;5.7745
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 44
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1499
ERROR:swh.storage.proxies.filter:content add missing: 44 (0.0052)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.2179
ERROR:swh.storage.proxies.filter:CSV:content;44;0.0052;44;5.2179
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 2338
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 79495
ERROR:swh.storage.proxies.filter:content add missing: 2338 (0.0568)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 19.2324
ERROR:swh.storage.proxies.filter:CSV:content;2338;0.0568;2338;19.2324
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0049)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 13.0758
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0049;23;13.0758
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 775
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 26353
ERROR:swh.storage.proxies.filter:content add missing: 775 (0.0224)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 15.8160
ERROR:swh.storage.proxies.filter:CSV:content;775;0.0224;775;15.8160
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 1268
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 43115
ERROR:swh.storage.proxies.filter:content add missing: 1268 (0.0328)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 16.6013
ERROR:swh.storage.proxies.filter:CSV:content;1268;0.0328;1268;16.6013
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 2093
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 71165
ERROR:swh.storage.proxies.filter:content add missing: 2093 (0.0517)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 15.6989
ERROR:swh.storage.proxies.filter:CSV:content;2093;0.0517;2093;15.6989
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=21076
ERROR:swh.storage.proxies.filter:content add entry count: 1024
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 34819
ERROR:swh.storage.proxies.filter:content add missing: 1024 (0.0309)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.8529
ERROR:swh.storage.proxies.filter:CSV:content;1024;0.0309;1024;7.8529
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.3712)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 12.2744
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.3712;10000;12.2744
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0890)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 11.6116
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0890;10000;11.6116
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0895)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 8.8129
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0895;10000;8.8129
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=32041
DEBUG:swh.loader.git.loader:packfile_read_count_commit=9270
DEBUG:swh.loader.git.loader:packfile_read_count_tag=2
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39cb5e9cd0> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 225, done.
Counting objects: 100% (163/163), done.
Compressing objects: 100% (94/94), done.
Total 225 (delta 96), reused 69 (delta 69), pack-reused 62
DEBUG:swh.loader.git.loader:fetched_pack_size=156255
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:packfile_read_count_blob=75
DEBUG:swh.loader.git.loader:packfile_read_count_tree=121
DEBUG:swh.loader.git.loader:packfile_read_count_commit=29
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39ca3a1d10> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 6918, done.
Counting objects: 100% (1786/1786), done.
Compressing objects: 100% (574/574), done.
Total 6918 (delta 1459), reused 1212 (delta 1212), pack-reused 5132
DEBUG:swh.loader.git.loader:fetched_pack_size=11332771
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 2063
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3029
ERROR:swh.storage.proxies.filter:content add missing: 89 (0.0476)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.2570
ERROR:swh.storage.proxies.filter:CSV:content;2063;0.0476;89;0.2570
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=2284
DEBUG:swh.loader.git.loader:packfile_read_count_tree=3592
DEBUG:swh.loader.git.loader:packfile_read_count_commit=1042
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c8fcfed0> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 2847, done.
Counting objects: 100% (1151/1151), done.
Compressing objects: 100% (434/434), done.
Total 2847 (delta 933), reused 717 (delta 717), pack-reused 1696
DEBUG:swh.loader.git.loader:fetched_pack_size=22984168
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 1000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 2519
ERROR:swh.storage.proxies.filter:content add missing: 74 (0.0263)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.3970
ERROR:swh.storage.proxies.filter:CSV:content;1000;0.0263;74;0.3970
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=769
DEBUG:swh.loader.git.loader:packfile_read_count_tree=1554
DEBUG:swh.loader.git.loader:packfile_read_count_commit=524
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c80bf990> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 4129, done.
Counting objects: 100% (1482/1482), done.
Compressing objects: 100% (530/530), done.
Total 4129 (delta 1184), reused 952 (delta 952), pack-reused 2647
DEBUG:swh.loader.git.loader:fetched_pack_size=11802668
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 337
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1703
ERROR:swh.storage.proxies.filter:content add missing: 50 (0.0121)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.8969
ERROR:swh.storage.proxies.filter:CSV:content;337;0.0121;50;0.8969
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 819
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3335
ERROR:swh.storage.proxies.filter:content add missing: 98 (0.0205)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 1.3047
ERROR:swh.storage.proxies.filter:CSV:content;819;0.0205;98;1.3047
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=1274
DEBUG:swh.loader.git.loader:packfile_read_count_tree=2192
DEBUG:swh.loader.git.loader:packfile_read_count_commit=663
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c8f83c10> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 18893, done.
Counting objects: 100% (4013/4013), done.
Compressing objects: 100% (1293/1293), done.
Total 18893 (delta 3319), reused 2754 (delta 2719), pack-reused 14880
DEBUG:swh.loader.git.loader:fetched_pack_size=94318447
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 2838
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3165
ERROR:swh.storage.proxies.filter:content add missing: 93 (0.0616)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.7012
ERROR:swh.storage.proxies.filter:CSV:content;2838;0.0616;93;0.7012
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0052)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0102
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0052;0;0.0102
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0133
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0047;0;0.0133
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0046)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0100
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0046;0;0.0100
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0099
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0047;0;0.0099
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0046)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0103
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0046;0;0.0103
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 534
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 2009
ERROR:swh.storage.proxies.filter:content add missing: 59 (0.0151)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 3.6533
ERROR:swh.storage.proxies.filter:CSV:content;534;0.0151;59;3.6533
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 105
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3573
ERROR:swh.storage.proxies.filter:content add missing: 105 (0.0070)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 7.4421
ERROR:swh.storage.proxies.filter:CSV:content;105;0.0070;105;7.4421
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 2663
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3471
ERROR:swh.storage.proxies.filter:content add missing: 102 (0.0567)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.4699
ERROR:swh.storage.proxies.filter:CSV:content;2663;0.0567;102;0.4699
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 27
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0130
ERROR:swh.storage.proxies.filter:CSV:content;27;0.0047;0;0.0130
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=6766
ERROR:swh.storage.proxies.filter:content add entry count: 667
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 4049
ERROR:swh.storage.proxies.filter:content add missing: 119 (0.0189)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.5319
ERROR:swh.storage.proxies.filter:CSV:content;667;0.0189;119;0.5319
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 68049
ERROR:swh.storage.proxies.filter:directory add missing: 3093 (0.0910)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 3.8403
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0910;3093;3.8403
ERROR:swh.storage.proxies.filter:revision add entry count: 9739
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 214261
ERROR:swh.storage.proxies.filter:revision add missing: 9739 (0.1548)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 4.9907
ERROR:swh.storage.proxies.filter:CSV:revision;9739;0.1548;9739;4.9907
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=9580
DEBUG:swh.loader.git.loader:packfile_read_count_commit=2547
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c9ab2e10> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 445, done.
Counting objects: 100% (246/246), done.
Compressing objects: 100% (208/208), done.
Total 445 (delta 186), reused 38 (delta 38), pack-reused 199
DEBUG:swh.loader.git.loader:fetched_pack_size=3697245
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:packfile_read_count_blob=93
DEBUG:swh.loader.git.loader:packfile_read_count_tree=176
DEBUG:swh.loader.git.loader:packfile_read_count_commit=176
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c9ae9790> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 8552, done.
Counting objects: 100% (2956/2956), done.
Compressing objects: 100% (1048/1048), done.
Total 8552 (delta 2432), reused 1908 (delta 1908), pack-reused 5596
DEBUG:swh.loader.git.loader:fetched_pack_size=9048688
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 1878
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3267
ERROR:swh.storage.proxies.filter:content add missing: 96 (0.0426)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 1.4026
ERROR:swh.storage.proxies.filter:CSV:content;1878;0.0426;96;1.4026
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0103
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0047;0;0.0103
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0051)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0110
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0051;0;0.0110
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0050)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0096
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0050;0;0.0096
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0102
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0047;0;0.0102
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=2894
DEBUG:swh.loader.git.loader:packfile_read_count_tree=4312
DEBUG:swh.loader.git.loader:packfile_read_count_commit=1346
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c9e097d0> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 517, done.
Counting objects: 100% (320/320), done.
Compressing objects: 100% (282/282), done.
Total 517 (delta 247), reused 38 (delta 38), pack-reused 197
DEBUG:swh.loader.git.loader:fetched_pack_size=290150
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:packfile_read_count_blob=121
DEBUG:swh.loader.git.loader:packfile_read_count_tree=198
DEBUG:swh.loader.git.loader:packfile_read_count_commit=198
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c94e9ed0> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 3112, done.
Counting objects: 100% (1295/1295), done.
Compressing objects: 100% (538/538), done.
Total 3112 (delta 1014), reused 757 (delta 757), pack-reused 1817
DEBUG:swh.loader.git.loader:fetched_pack_size=5394988
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 1899
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 8367
ERROR:swh.storage.proxies.filter:content add missing: 246 (0.0433)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 38
ERROR:swh.storage.proxies.filter:content added in 1.6936
ERROR:swh.storage.proxies.filter:CSV:content;1899;0.0433;246;1.6936
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0046)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0104
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0046;0;0.0104
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=1026
DEBUG:swh.loader.git.loader:packfile_read_count_tree=1549
DEBUG:swh.loader.git.loader:packfile_read_count_commit=537
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c9204d50> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 5658, done.
Counting objects: 100% (4231/4231), done.
Compressing objects: 100% (1477/1477), done.
Total 5658 (delta 3030), reused 3631 (delta 2707), pack-reused 1427
DEBUG:swh.loader.git.loader:fetched_pack_size=13046040
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 1230
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 2893
ERROR:swh.storage.proxies.filter:content add missing: 85 (0.0331)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.5424
ERROR:swh.storage.proxies.filter:CSV:content;1230;0.0331;85;0.5424
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 228
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0093)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0159
ERROR:swh.storage.proxies.filter:CSV:content;228;0.0093;0;0.0159
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=2013
ERROR:swh.storage.proxies.filter:content add entry count: 633
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0173)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0107
ERROR:swh.storage.proxies.filter:CSV:content;633;0.0173;0;0.0107
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 35423
ERROR:swh.storage.proxies.filter:directory add missing: 1610 (0.0863)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 1.9590
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0863;1610;1.9590
ERROR:swh.storage.proxies.filter:revision add entry count: 3278
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 24115
ERROR:swh.storage.proxies.filter:revision add missing: 1096 (0.1073)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 0.5856
ERROR:swh.storage.proxies.filter:CSV:revision;3278;0.1073;1096;0.5856
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=2789
DEBUG:swh.loader.git.loader:packfile_read_count_commit=856
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c9094290> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 759, done.
Counting objects: 100% (752/752), done.
Compressing objects: 100% (561/561), done.
Total 759 (delta 345), reused 418 (delta 183), pack-reused 7
DEBUG:swh.loader.git.loader:fetched_pack_size=5997314
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:packfile_read_count_blob=218
DEBUG:swh.loader.git.loader:packfile_read_count_tree=317
DEBUG:swh.loader.git.loader:packfile_read_count_commit=224
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39c877c310> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 152, done.
Counting objects: 100% (129/129), done.
Compressing objects: 100% (101/101), done.
Total 152 (delta 54), reused 50 (delta 27), pack-reused 23
DEBUG:swh.loader.git.loader:fetched_pack_size=2501049
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:packfile_read_count_blob=35
DEBUG:swh.loader.git.loader:packfile_read_count_tree=80
DEBUG:swh.loader.git.loader:packfile_read_count_commit=37
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39cb4bdc10> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 88, done.
Counting objects: 100% (65/65), done.
Compressing objects: 100% (60/60), done.
Total 88 (delta 25), reused 5 (delta 5), pack-reused 23
DEBUG:swh.loader.git.loader:fetched_pack_size=56456
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:packfile_read_count_blob=22
DEBUG:swh.loader.git.loader:packfile_read_count_tree=49
DEBUG:swh.loader.git.loader:packfile_read_count_commit=17
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39cb303d50> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 3812, done.
Counting objects: 100% (915/915), done.
Compressing objects: 100% (342/342), done.
Total 3812 (delta 677), reused 573 (delta 573), pack-reused 2897
DEBUG:swh.loader.git.loader:fetched_pack_size=8370438
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 1315
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 4049
ERROR:swh.storage.proxies.filter:content add missing: 119 (0.0323)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.7481
ERROR:swh.storage.proxies.filter:CSV:content;1315;0.0323;119;0.7481
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=1068
DEBUG:swh.loader.git.loader:packfile_read_count_tree=2070
DEBUG:swh.loader.git.loader:packfile_read_count_commit=674
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f39cb3a0b10> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:asked_refs_count=128
Enumerating objects: 17017, done.
Counting objects: 100% (2669/2669), done.
Compressing objects: 100% (767/767), done.
Total 17017 (delta 2270), reused 1902 (delta 1902), pack-reused 14348
DEBUG:swh.loader.git.loader:fetched_pack_size=55927647
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 2082
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 511
ERROR:swh.storage.proxies.filter:content add missing: 15 (0.0457)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 0.0958
ERROR:swh.storage.proxies.filter:CSV:content;2082;0.0457;15;0.0958
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 57
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0055)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0110
ERROR:swh.storage.proxies.filter:CSV:content;57;0.0055;0;0.0110
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 770
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0203)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0109
ERROR:swh.storage.proxies.filter:CSV:content;770;0.0203;0;0.0109
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.0047)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0099
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0047;0;0.0099
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=5390
ERROR:swh.storage.proxies.filter:content add entry count: 2486
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 205
ERROR:swh.storage.proxies.filter:content add missing: 6 (0.0543)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 35
ERROR:swh.storage.proxies.filter:content added in 0.0581
ERROR:swh.storage.proxies.filter:CSV:content;2486;0.0543;6;0.0581
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 9309
ERROR:swh.storage.proxies.filter:directory add missing: 423 (0.1666)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 0.5868
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1666;423;0.5868
ERROR:swh.storage.proxies.filter:revision add entry count: 1808
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 9089
ERROR:swh.storage.proxies.filter:revision add missing: 413 (0.0211)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 0.2299
ERROR:swh.storage.proxies.filter:CSV:revision;1808;0.0211;413;0.2299
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=8960
DEBUG:swh.loader.git.loader:packfile_read_count_commit=2667
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
ERROR:swh.storage.proxies.filter:directory add entry count: 4259
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 773
ERROR:swh.storage.proxies.filter:directory add missing: 35 (0.0384)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 16
ERROR:swh.storage.proxies.filter:directory added 0.0987
ERROR:swh.storage.proxies.filter:CSV:directory;4259;0.0384;35;0.0987
ERROR:swh.storage.proxies.filter:revision add entry count: 2667
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 421
ERROR:swh.storage.proxies.filter:revision add missing: 19 (0.0251)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 15
ERROR:swh.storage.proxies.filter:revision added 0.0269
ERROR:swh.storage.proxies.filter:CSV:revision;2667;0.0251;19;0.0269
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/add HTTP/1.1" 200 15
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 161.17
        System time (seconds): 8.53
        Percent of CPU this job got: 31%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 8:53.06
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 784084
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 1
        Minor (reclaiming a frame) page faults: 2732881
        Voluntary context switches: 35794
        Involuntary context switches: 2584
        Swaps: 0
        File system inputs: 56
        File system outputs: 255912
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

19:19:51 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/cozy/cozy-stack' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                url                 | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-10-01 17:19:53.136605+00 |  3 | https://github.com/cozy/cozy-stack |      3 |     1 | 2021-10-01 17:00:22.269835+00 | git  | full    | (null)   | \x58f9a6bf461eabdcaf649358eab70455bf58edaf |
| 2021-10-01 17:19:53.136605+00 |  3 | https://github.com/cozy/cozy-stack |      3 |     1 | 2021-10-01 16:51:31.095802+00 | git  | created | (null)   | (null)                                     |
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(2 rows)

Time: 0.576 ms
  • staging

ingestion

(ve) swhworker@worker1:~$ /usr/bin/time -v swh loader run git https://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
Enumerating objects: 62251, done.
Counting objects: 100% (3605/3605), done.
Compressing objects: 100% (1197/1197), done.
Total 62251 (delta 2453), reused 3403 (delta 2354), pack-reused 58646
INFO:swh.loader.git.loader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 95.17
        System time (seconds): 3.70
        Percent of CPU this job got: 45%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 3:35.43
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 172404
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 15
        Minor (reclaiming a frame) page faults: 241055
        Voluntary context switches: 4787
        Involuntary context switches: 5753
        Swaps: 0
        File system inputs: 12296
        File system outputs: 255760
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

16:57:58 swh@db1:5432=> select now(), date, status, snapshot from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/cozy/cozy-stack' and ovs.type='git' order by date desc limit 2;
+-------------------------------+-------------------------------+---------+--------------------------------------------+
|              now              |             date              | status  |                  snapshot                  |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
| 2021-10-03 14:58:06.713749+00 | 2021-10-03 14:53:01.928459+00 | full    | \x58f9a6bf461eabdcaf649358eab70455bf58edaf |
| 2021-10-03 14:58:06.713749+00 | 2021-10-03 14:49:29.383613+00 | created | (null)                                     |
+-------------------------------+-------------------------------+---------+--------------------------------------------+
(2 rows)
  • prod

ingest:

INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
Enumerating objects: 62420, done.
Counting objects: 100% (3774/3774), done.
Compressing objects: 100% (1276/1276), done.
Total 62420 (delta 2557), reused 3549 (delta 2443), pack-reused 58646
INFO:swh.loader.git.loader.GitLoader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 190.67
        System time (seconds): 14.26
        Percent of CPU this job got: 65%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 5:11.26
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 1096400
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 28
        Minor (reclaiming a frame) page faults: 319911
        Voluntary context switches: 6380
        Involuntary context switches: 18708
        Swaps: 0
        File system inputs: 26032
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

16:57:14 softwareheritage@belvedere:5432=> select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/cozy/cozy-stack' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----------+------------------------------------+----------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
|              now              |    id    |                url                 |  origin  | visit |             date              | status  | metadata |                  snapshot                  | type |
+-------------------------------+----------+------------------------------------+----------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
| 2021-10-03 14:57:21.352032+00 | 46238351 | https://github.com/cozy/cozy-stack | 46238351 |    34 | 2021-10-03 14:54:30.482635+00 | full    | (null)   | \x58f9a6bf461eabdcaf649358eab70455bf58edaf | git  |
| 2021-10-03 14:57:21.352032+00 | 46238351 | https://github.com/cozy/cozy-stack | 46238351 |    34 | 2021-10-03 14:49:24.08976+00  | created | (null)   | (null)                                     | git  |
+-------------------------------+----------+------------------------------------+----------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
(2 rows)

Time: 6.239 ms
  • skaffold

master:

$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/GoogleContainerTools/skaffold
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7f06a7d13590>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 130
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/GoogleContainerTools/skaffold' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/GoogleContainerTools/skaffold
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f06a64f4cd0> to fetch pack at /GoogleContainerTools/skaffold
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=3939
DEBUG:swh.loader.git.loader:wanted_refs_count=3939
Enumerating objects: 162851, done.
Counting objects: 100% (6012/6012), done.
Compressing objects: 100% (2455/2455), done.
Total 162851 (delta 3653), reused 5453 (delta 3326), pack-reused 156839
DEBUG:swh.loader.git.loader:fetched_pack_size=243457601
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3958 refs for repo https://github.com/GoogleContainerTools/skaffold
ERROR:swh.storage.proxies.filter:content add entry count: 6373
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 203867
ERROR:swh.storage.proxies.filter:content add missing: 5996 (0.1531)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 22.1677
ERROR:swh.storage.proxies.filter:CSV:content;6373;0.1531;5996;22.1677
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 9943
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 334223
ERROR:swh.storage.proxies.filter:content add missing: 9830 (0.2210)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 39.0092
ERROR:swh.storage.proxies.filter:CSV:content;9943;0.2210;9830;39.0092
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 4428
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 150521
ERROR:swh.storage.proxies.filter:content add missing: 4427 (0.1009)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 18.9527
ERROR:swh.storage.proxies.filter:CSV:content;4428;0.1009;4427;18.9527
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 7285
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 235317
ERROR:swh.storage.proxies.filter:content add missing: 6921 (0.1572)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 27.9886
ERROR:swh.storage.proxies.filter:CSV:content;7285;0.1572;6921;27.9886
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 5359
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 140695
ERROR:swh.storage.proxies.filter:content add missing: 4138 (0.1164)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 18.0771
ERROR:swh.storage.proxies.filter:CSV:content;5359;0.1164;4138;18.0771
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 298897
ERROR:swh.storage.proxies.filter:content add missing: 8791 (0.2513)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 34.8438
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2513;8791;34.8438
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 7305
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 220255
ERROR:swh.storage.proxies.filter:content add missing: 6478 (0.1765)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 27.8841
ERROR:swh.storage.proxies.filter:CSV:content;7305;0.1765;6478;27.8841
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 3
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 103
ERROR:swh.storage.proxies.filter:content add missing: 3 (0.0044)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 6.3087
ERROR:swh.storage.proxies.filter:CSV:content;3;0.0044;3;6.3087
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 623
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 20063
ERROR:swh.storage.proxies.filter:content add missing: 590 (0.0179)
qDEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.0350
ERROR:swh.storage.proxies.filter:CSV:content;623;0.0179;590;7.0350
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 7392
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 231101
ERROR:swh.storage.proxies.filter:content add missing: 6797 (0.1620)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 27.2965
ERROR:swh.storage.proxies.filter:CSV:content;7392;0.1620;6797;27.2965
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 9523
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 298965
ERROR:swh.storage.proxies.filter:content add missing: 8793 (0.2063)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 35.8573
ERROR:swh.storage.proxies.filter:CSV:content;9523;0.2063;8793;35.8573
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=68492
ERROR:swh.storage.proxies.filter:content add entry count: 258
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 8775
ERROR:swh.storage.proxies.filter:content add missing: 258 (0.0109)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 1.6659
ERROR:swh.storage.proxies.filter:CSV:content;258;0.0109;258;1.6659
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 219365
ERROR:swh.storage.proxies.filter:directory add missing: 9971 (0.0855)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 10.9029
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0855;9971;10.9029
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 215603
ERROR:swh.storage.proxies.filter:directory add missing: 9800 (0.0927)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 10.9522
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0927;9800;10.9522
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 218507
ERROR:swh.storage.proxies.filter:directory add missing: 9932 (0.0865)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 14.1629
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0865;9932;14.1629
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 219673
ERROR:swh.storage.proxies.filter:directory add missing: 9985 (0.1021)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 12.7777
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1021;9985;12.7777
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 219343
ERROR:swh.storage.proxies.filter:directory add missing: 9970 (0.0872)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 10.5920
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0872;9970;10.5920
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 218507
ERROR:swh.storage.proxies.filter:directory add missing: 9932 (0.0819)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 9.7271
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0819;9932;9.7271
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 217143
ERROR:swh.storage.proxies.filter:directory add missing: 9870 (0.1107)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 6.3686
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1107;9870;6.3686
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 218639
ERROR:swh.storage.proxies.filter:directory add missing: 9938 (0.0929)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 7.5886
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0929;9938;7.5886
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=80618
ERROR:swh.storage.proxies.filter:directory add entry count: 618
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 13599
ERROR:swh.storage.proxies.filter:directory add missing: 618 (0.0105)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 0.8568
ERROR:swh.storage.proxies.filter:CSV:directory;618;0.0105;618;0.8568
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0815)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 5.1929
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0815;10000;5.1929
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_commit=13664
DEBUG:swh.loader.git.loader:packfile_read_count_tag=77
ERROR:swh.storage.proxies.filter:revision add entry count: 3664
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 80611
ERROR:swh.storage.proxies.filter:revision add missing: 3664 (0.0370)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 1.8461
ERROR:swh.storage.proxies.filter:CSV:revision;3664;0.0370;3664;1.8461
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/add HTTP/1.1" 200 15
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/GoogleContainerTools/skaffold"
        User time (seconds): 123.49
        System time (seconds): 5.79
        Percent of CPU this job got: 26%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 8:01.55
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 613924
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 7
        Minor (reclaiming a frame) page faults: 759222
        Voluntary context switches: 20455
        Involuntary context switches: 2299
        Swaps: 0
        File system inputs: 872
        File system outputs: 475512
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

13:09:49 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/GoogleContainerTools/skaffold' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+--------------------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                       url                        | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+--------------------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-10-01 11:09:50.143544+00 |  4 | https://github.com/GoogleContainerTools/skaffold |      4 |     1 | 2021-10-01 11:08:19.314068+00 | git  | full    | (null)   | \x5e41612a9c0a672ea52ba7e623c420067c4deb89 |
| 2021-10-01 11:09:50.143544+00 |  4 | https://github.com/GoogleContainerTools/skaffold |      4 |     1 | 2021-10-01 11:00:19.436626+00 | git  | created | (null)   | (null)                                     |
+-------------------------------+----+--------------------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(2 rows)

Time: 0.484 ms

improve:

$ swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@f669fb5d0283:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/GoogleContainerTools/skaffold
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7fa00a100e90>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 130
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/GoogleContainerTools/skaffold' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/GoogleContainerTools/skaffold
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7fa007733590> to fetch pack at /GoogleContainerTools/skaffold
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=3939
DEBUG:swh.loader.git.loader:wanted_refs_count=3939
DEBUG:swh.loader.git.loader:asked_refs_count=2000
Enumerating objects: 141719, done.
Counting objects: 100% (4684/4684), done.
Compressing objects: 100% (2136/2136), done.
Total 141719 (delta 2688), reused 4068 (delta 2362), pack-reused 137035
DEBUG:swh.loader.git.loader:fetched_pack_size=141578954
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3958 refs for repo https://github.com/GoogleContainerTools/skaffold
ERROR:swh.storage.proxies.filter:content add entry count: 6039
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 205329
ERROR:swh.storage.proxies.filter:content add missing: 6039 (0.1344)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 20.6199
ERROR:swh.storage.proxies.filter:CSV:content;6039;0.1344;6039;20.6199
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 9263
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 314945
ERROR:swh.storage.proxies.filter:content add missing: 9263 (0.4641)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 37.1100
ERROR:swh.storage.proxies.filter:CSV:content;9263;0.4641;9263;37.1100
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 3651
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 124137
ERROR:swh.storage.proxies.filter:content add missing: 3651 (0.0872)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 15.0221
ERROR:swh.storage.proxies.filter:CSV:content;3651;0.0872;3651;15.0221
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 8756
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 297707
ERROR:swh.storage.proxies.filter:content add missing: 8756 (0.1938)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 34.1592
ERROR:swh.storage.proxies.filter:CSV:content;8756;0.1938;8756;34.1592
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 7362
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 250311
ERROR:swh.storage.proxies.filter:content add missing: 7362 (0.1611)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 28.3367
ERROR:swh.storage.proxies.filter:CSV:content;7362;0.1611;7362;28.3367
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 8020
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 272683
ERROR:swh.storage.proxies.filter:content add missing: 8020 (0.1914)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 31.8892
ERROR:swh.storage.proxies.filter:CSV:content;8020;0.1914;8020;31.8892
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 340003
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2422)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 39.5304
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2422;10000;39.5304
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 9601
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 326437
ERROR:swh.storage.proxies.filter:content add missing: 9601 (0.2280)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 34.7764
ERROR:swh.storage.proxies.filter:CSV:content;9601;0.2280;9601;34.7764
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=62847
ERROR:swh.storage.proxies.filter:content add entry count: 155
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 5273
ERROR:swh.storage.proxies.filter:content add missing: 155 (0.0087)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 38
ERROR:swh.storage.proxies.filter:content added in 0.8986
ERROR:swh.storage.proxies.filter:CSV:content;155;0.0087;155;0.8986
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0799)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 9.9952
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0799;10000;9.9952
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.2489)
qDEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 11.4435
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.2489;10000;11.4435
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0859)
qDEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 13.3891
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0859;10000;13.3891
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0859)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 11.1960
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0859;10000;11.1960
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0912)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 8.7453
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0912;10000;8.7453
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0893)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 7.6126
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0893;10000;7.6126
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=67940
ERROR:swh.storage.proxies.filter:directory add entry count: 7940
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 174683
ERROR:swh.storage.proxies.filter:directory add missing: 7940 (0.0771)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 6.3852
ERROR:swh.storage.proxies.filter:CSV:directory;7940;0.0771;7940;6.3852
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.0747)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 5.2753
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.0747;10000;5.2753
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_commit=10892
DEBUG:swh.loader.git.loader:packfile_read_count_tag=40
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/GoogleContainerTools/skaffold
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7fa0037102d0> to fetch pack at /GoogleContainerTools/skaffold
DEBUG:swh.loader.git.loader:asked_refs_count=1939
Enumerating objects: 26496, done.
Counting objects: 100% (17674/17674), done.
Compressing objects: 100% (10550/10550), done.
Total 26496 (delta 13907), reused 8523 (delta 6982), pack-reused 8822
DEBUG:swh.loader.git.loader:fetched_pack_size=111641869
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3958 refs for repo https://github.com/GoogleContainerTools/skaffold
ERROR:swh.storage.proxies.filter:content add entry count: 60
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 443
ERROR:swh.storage.proxies.filter:content add missing: 13 (0.0067)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 6.5312
ERROR:swh.storage.proxies.filter:CSV:content;60;0.0067;13;6.5312
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 321
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 9931
ERROR:swh.storage.proxies.filter:content add missing: 292 (0.0130)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 6.6591
ERROR:swh.storage.proxies.filter:CSV:content;321;0.0130;292;6.6591
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 2882
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 76095
ERROR:swh.storage.proxies.filter:content add missing: 2238 (0.0769)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 10.5572
ERROR:swh.storage.proxies.filter:CSV:content;2882;0.0769;2238;10.5572
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=7947
ERROR:swh.storage.proxies.filter:content add entry count: 4684
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 105471
ERROR:swh.storage.proxies.filter:content add missing: 3102 (0.1054)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 9.3318
ERROR:swh.storage.proxies.filter:CSV:content;4684;0.1054;3102;9.3318
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 195737
ERROR:swh.storage.proxies.filter:directory add missing: 8897 (0.0907)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 10.1581
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0907;8897;10.1581
ERROR:swh.storage.proxies.filter:revision add entry count: 892
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 19627
ERROR:swh.storage.proxies.filter:revision add missing: 892 (0.0114)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 0.4621
ERROR:swh.storage.proxies.filter:CSV:revision;892;0.0114;892;0.4621
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=15448
DEBUG:swh.loader.git.loader:packfile_read_count_commit=3064
DEBUG:swh.loader.git.loader:packfile_read_count_tag=37
ERROR:swh.storage.proxies.filter:directory add entry count: 5448
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 83185
ERROR:swh.storage.proxies.filter:directory add missing: 3781 (0.0489)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 5.3321
ERROR:swh.storage.proxies.filter:CSV:directory;5448;0.0489;3781;5.3321
ERROR:swh.storage.proxies.filter:revision add entry count: 3064
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 60987
ERROR:swh.storage.proxies.filter:revision add missing: 2772 (0.0286)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 1.3773
ERROR:swh.storage.proxies.filter:CSV:revision;3064;0.0286;2772;1.3773
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/add HTTP/1.1" 200 15
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/GoogleContainerTools/skaffold"
        User time (seconds): 129.52
        System time (seconds): 5.17
        Percent of CPU this job got: 26%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 8:22.84
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 587752
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 378209
        Voluntary context switches: 17217
        Involuntary context switches: 2398
        Swaps: 0
        File system inputs: 0
        File system outputs: 494592
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

sql:

13:37:49 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/GoogleContainerTools/skaffold' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+--------------------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                       url                        | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+--------------------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-10-01 11:37:50.516936+00 |  1 | https://github.com/GoogleContainerTools/skaffold |      1 |     1 | 2021-10-01 11:34:20.821306+00 | git  | full    | (null)   | \x5e41612a9c0a672ea52ba7e623c420067c4deb89 |
| 2021-10-01 11:37:50.516936+00 |  1 | https://github.com/GoogleContainerTools/skaffold |      1 |     1 | 2021-10-01 11:25:59.638977+00 | git  | created | (null)   | (null)                                     |
+-------------------------------+----+--------------------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(2 rows)

Time: 0.536 ms
  • kubernetes/kubectl
swh@660f7be57008:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/kubernetes/kubectl
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7fd2b84e2910>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 119
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/kubernetes/kubectl' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/kubernetes/kubectl
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7fd2b5a8bcd0> to fetch pack at /kubernetes/kubectl
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=868
DEBUG:swh.loader.git.loader:wanted_refs_count=868
Enumerating objects: 53128, done.
Counting objects: 100% (1560/1560), done.
Compressing objects: 100% (699/699), done.
Total 53128 (delta 986), reused 1279 (delta 796), pack-reused 51568
DEBUG:swh.loader.git.loader:fetched_pack_size=78988336
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 872 refs for repo https://github.com/kubernetes/kubectl
ERROR:swh.storage.proxies.filter:content add entry count: 2831
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 96223
ERROR:swh.storage.proxies.filter:content add missing: 2830 (0.0648)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 10.0663
ERROR:swh.storage.proxies.filter:CSV:content;2831;0.0648;2830;10.0663
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 4689
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 159429
ERROR:swh.storage.proxies.filter:content add missing: 4689 (0.1081)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 19.4915
ERROR:swh.storage.proxies.filter:CSV:content;4689;0.1081;4689;19.4915
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 4084
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 138859
ERROR:swh.storage.proxies.filter:content add missing: 4084 (0.0916)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 15.2714
ERROR:swh.storage.proxies.filter:CSV:content;4084;0.0916;4084;15.2714
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 340003
ERROR:swh.storage.proxies.filter:content add missing: 10000 (0.2139)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 37.8653
ERROR:swh.storage.proxies.filter:CSV:content;10000;0.2139;10000;37.8653
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 9956
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 338473
ERROR:swh.storage.proxies.filter:content add missing: 9955 (0.2140)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 47.9261
ERROR:swh.storage.proxies.filter:CSV:content;9956;0.2140;9955;47.9261
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=32758
ERROR:swh.storage.proxies.filter:content add entry count: 1198
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 40735
ERROR:swh.storage.proxies.filter:content add missing: 1198 (0.0314)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 3.9326
ERROR:swh.storage.proxies.filter:CSV:content;1198;0.0314;1198;3.9326
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0824)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 7.0436
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0824;10000;7.0436
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=16696
DEBUG:swh.loader.git.loader:packfile_read_count_commit=3128
DEBUG:swh.loader.git.loader:packfile_read_count_tag=546
ERROR:swh.storage.proxies.filter:directory add entry count: 6696
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 147315
ERROR:swh.storage.proxies.filter:directory add missing: 6696 (0.0596)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 3.0388
ERROR:swh.storage.proxies.filter:CSV:directory;6696;0.0596;6696;3.0388
ERROR:swh.storage.proxies.filter:revision add entry count: 3128
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 68819
ERROR:swh.storage.proxies.filter:revision add missing: 3128 (0.0287)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 1.5739
ERROR:swh.storage.proxies.filter:CSV:revision;3128;0.0287;3128;1.5739
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 16
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/add HTTP/1.1" 200 15
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/kubernetes/kubectl"
        User time (seconds): 32.37
        System time (seconds): 0.51
        Percent of CPU this job got: 18%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 3:01.57
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 685976
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 152888
        Voluntary context switches: 4675
        Involuntary context switches: 439
        Swaps: 0
        File system inputs: 0
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0
  • rancher/dashboard

improve:

swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@b264af18aff8:/$
swh@b264af18aff8:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/rancher/dashboard

DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7fe25f6c3490>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 118
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/rancher/dashboard' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7fe25cac4950> to fetch pack at /rancher/dashboard
INFO:swh.loader.git.loader:##### limit the refs to: 2000
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=1975
DEBUG:swh.loader.git.loader:wanted_refs_count=1975
INFO:swh.loader.git.loader:##### total_wanted_refs: 1975
INFO:swh.loader.git.loader:##### Fetch range [0 : 2000]
INFO:swh.loader.git.loader:##### nb of asked refs: 1975
Enumerating objects: 50339, done.
Counting objects: 100% (50337/50337), done.
Compressing objects: 100% (12904/12904), done.
Total 50339 (delta 36563), reused 50030 (delta 36357), pack-reused 2
DEBUG:swh.loader.git.loader:fetched_pack_size=27477228
INFO:swh.loader.git.loader:#### remote_refs: 2018
INFO:swh.loader.git.loader:#### filtered_remote_refs: 1996
INFO:swh.loader.git.loader:#### symbolic_refs: 1
INFO:swh.loader.git.loader:#### filtered_symbolic_refs: 1
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1996 refs for repo https://github.com/rancher/dashboard
ERROR:swh.storage.proxies.filter:content add entry count: 1000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 34003
ERROR:swh.storage.proxies.filter:content add missing: 1000 (0.0324)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.6058
ERROR:swh.storage.proxies.filter:CSV:content;1000;0.0324;1000;7.6058
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 4276
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 145387
ERROR:swh.storage.proxies.filter:content add missing: 4276 (0.1371)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 18.3317
ERROR:swh.storage.proxies.filter:CSV:content;4276;0.1371;4276;18.3317
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 8879
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 301855
ERROR:swh.storage.proxies.filter:content add missing: 8878 (0.2532)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 36.4808
ERROR:swh.storage.proxies.filter:CSV:content;8879;0.2532;8878;36.4808
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=16529
ERROR:swh.storage.proxies.filter:content add entry count: 2374
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 80719
ERROR:swh.storage.proxies.filter:content add missing: 2374 (0.0750)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.7759
ERROR:swh.storage.proxies.filter:CSV:content;2374;0.0750;2374;7.7759
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1114)
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 27.4452
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1114;10000;27.4452
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1049)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 15.4235
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1049;10000;15.4235
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=27459
DEBUG:swh.loader.git.loader:packfile_read_count_commit=6351
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
ERROR:swh.storage.proxies.filter:directory add entry count: 7459
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 164101
ERROR:swh.storage.proxies.filter:directory add missing: 7459 (0.0822)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 8.0942
ERROR:swh.storage.proxies.filter:CSV:directory;7459;0.0822;7459;8.0942
ERROR:swh.storage.proxies.filter:revision add entry count: 6351
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 139725
ERROR:swh.storage.proxies.filter:revision add missing: 6351 (0.0672)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 3.8579
ERROR:swh.storage.proxies.filter:CSV:revision;6351;0.0672;6351;3.8579
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/add HTTP/1.1" 200 15
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/rancher/dashboard"
        User time (seconds): 49.95
        System time (seconds): 0.56
        Percent of CPU this job got: 29%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 2:49.48
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 400624
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 15
        Minor (reclaiming a frame) page faults: 281069
        Voluntary context switches: 3424
        Involuntary context switches: 852
        Swaps: 0
        File system inputs: 1232
        File system outputs: 64
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

with order

swh@f33d64889043:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/rancher/dashboard
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7f1692a12d90>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/rancher/dashboard' with type 'git'
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168ff34bd0> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=1976
DEBUG:swh.loader.git.loader:wanted_refs_count=1976
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 46524, done.
Counting objects: 100% (5230/5230), done.
Compressing objects: 100% (1893/1893), done.
Total 46524 (delta 3462), reused 4890 (delta 3267), pack-reused 41294
DEBUG:swh.loader.git.loader:fetched_pack_size=24521722
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
ERROR:swh.storage.proxies.filter:content add entry count: 6159
ERROR:swh.storage.proxies.filter:content add missing: 6158 (0.1825)
ERROR:swh.storage.proxies.filter:content added in 34.2035
ERROR:swh.storage.proxies.filter:CSV:content;6159;0.1825;6158;34.2035
ERROR:swh.storage.proxies.filter:content add entry count: 5719
ERROR:swh.storage.proxies.filter:content add missing: 5719 (0.1349)
ERROR:swh.storage.proxies.filter:content added in 35.0477
ERROR:swh.storage.proxies.filter:CSV:content;5719;0.1349;5719;35.0477
DEBUG:swh.loader.git.loader:packfile_read_count_blob=15533
ERROR:swh.storage.proxies.filter:content add entry count: 3655
ERROR:swh.storage.proxies.filter:content add missing: 3655 (0.0912)
ERROR:swh.storage.proxies.filter:content added in 20.4700
ERROR:swh.storage.proxies.filter:CSV:content;3655;0.0912;3655;20.4700
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1201)
ERROR:swh.storage.proxies.filter:directory added 18.4509
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1201;10000;18.4509
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0926)
ERROR:swh.storage.proxies.filter:directory added 13.3198
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0926;10000;13.3198
DEBUG:swh.loader.git.loader:packfile_read_count_tree=25105
DEBUG:swh.loader.git.loader:packfile_read_count_commit=5886
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d5f8550> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 126, done.
Counting objects: 100% (126/126), done.
Compressing objects: 100% (87/87), done.
Total 126 (delta 63), reused 60 (delta 27), pack-reused 0
DEBUG:swh.loader.git.loader:fetched_pack_size=61054
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=22
DEBUG:swh.loader.git.loader:packfile_read_count_tree=82
DEBUG:swh.loader.git.loader:packfile_read_count_commit=22
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d88e4d0> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 6613, done.
Counting objects: 100% (6613/6613), done.
Compressing objects: 100% (2172/2172), done.
Total 6613 (delta 4707), reused 5988 (delta 4386), pack-reused 0
DEBUG:swh.loader.git.loader:fetched_pack_size=1979628
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=2126
DEBUG:swh.loader.git.loader:packfile_read_count_tree=3700
DEBUG:swh.loader.git.loader:packfile_read_count_commit=787
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d4a2ad0> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 3090, done.
Counting objects: 100% (1216/1216), done.
Compressing objects: 100% (455/455), done.
Total 3090 (delta 979), reused 761 (delta 761), pack-reused 1874
DEBUG:swh.loader.git.loader:fetched_pack_size=4540116
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=1005
ERROR:swh.storage.proxies.filter:content add entry count: 3153
ERROR:swh.storage.proxies.filter:content add missing: 236 (0.0674)
ERROR:swh.storage.proxies.filter:content added in 2.8498
ERROR:swh.storage.proxies.filter:CSV:content;3153;0.0674;236;2.8498
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 5478 (0.1032)
ERROR:swh.storage.proxies.filter:directory added 8.8348
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1032;5478;8.8348
ERROR:swh.storage.proxies.filter:revision add entry count: 5930
ERROR:swh.storage.proxies.filter:revision add missing: 5930 (0.0755)
ERROR:swh.storage.proxies.filter:revision added 3.1872
ERROR:swh.storage.proxies.filter:CSV:revision;5930;0.0755;5930;3.1872
DEBUG:swh.loader.git.loader:packfile_read_count_tree=1675
DEBUG:swh.loader.git.loader:packfile_read_count_commit=410
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d4b8110> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 5594, done.
Counting objects: 100% (5594/5594), done.
Compressing objects: 100% (1962/1962), done.
Total 5594 (delta 3783), reused 5045 (delta 3536), pack-reused 0
DEBUG:swh.loader.git.loader:fetched_pack_size=2123113
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=1643
DEBUG:swh.loader.git.loader:packfile_read_count_tree=3210
DEBUG:swh.loader.git.loader:packfile_read_count_commit=741
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d548610> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 2415, done.
Counting objects: 100% (2415/2415), done.
Compressing objects: 100% (978/978), done.
Total 2415 (delta 1527), reused 2106 (delta 1418), pack-reused 0
DEBUG:swh.loader.git.loader:fetched_pack_size=1312527
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=685
DEBUG:swh.loader.git.loader:packfile_read_count_tree=1403
DEBUG:swh.loader.git.loader:packfile_read_count_commit=327
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d509110> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 7272, done.
Counting objects: 100% (5123/5123), done.
Compressing objects: 100% (1677/1677), done.
Total 7272 (delta 3714), reused 4394 (delta 3396), pack-reused 2149
DEBUG:swh.loader.git.loader:fetched_pack_size=3257632
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
ERROR:swh.storage.proxies.filter:content add entry count: 3617
ERROR:swh.storage.proxies.filter:content add missing: 313 (0.0938)
ERROR:swh.storage.proxies.filter:content added in 1.8951
ERROR:swh.storage.proxies.filter:CSV:content;3617;0.0938;313;1.8951
DEBUG:swh.loader.git.loader:packfile_read_count_blob=2265
DEBUG:swh.loader.git.loader:packfile_read_count_tree=3994
DEBUG:swh.loader.git.loader:packfile_read_count_commit=1013
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168c5959d0> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 1927, done.
Counting objects: 100% (1794/1794), done.
Compressing objects: 100% (864/864), done.
Total 1927 (delta 1170), reused 1375 (delta 915), pack-reused 133
DEBUG:swh.loader.git.loader:fetched_pack_size=1464212
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=316
ERROR:swh.storage.proxies.filter:content add entry count: 1292
ERROR:swh.storage.proxies.filter:content add missing: 153 (0.0315)
ERROR:swh.storage.proxies.filter:content added in 1.5031
ERROR:swh.storage.proxies.filter:CSV:content;1292;0.0315;153;1.5031
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
ERROR:swh.storage.proxies.filter:directory add missing: 1306 (0.0907)
ERROR:swh.storage.proxies.filter:directory added 2.9617
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0907;1306;2.9617
ERROR:swh.storage.proxies.filter:revision add entry count: 2491
ERROR:swh.storage.proxies.filter:revision add missing: 226 (0.0445)
ERROR:swh.storage.proxies.filter:revision added 0.1550
ERROR:swh.storage.proxies.filter:CSV:revision;2491;0.0445;226;0.1550
DEBUG:swh.loader.git.loader:packfile_read_count_tree=1206
DEBUG:swh.loader.git.loader:packfile_read_count_commit=405
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168d8b0310> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=200
Enumerating objects: 1611, done.
Counting objects: 100% (1531/1531), done.
Compressing objects: 100% (893/893), done.
Total 1611 (delta 864), reused 1036 (delta 631), pack-reused 80
DEBUG:swh.loader.git.loader:fetched_pack_size=1056161
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=493
DEBUG:swh.loader.git.loader:packfile_read_count_tree=882
DEBUG:swh.loader.git.loader:packfile_read_count_commit=236
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f168e106a50> to fetch pack at /rancher/dashboard
DEBUG:swh.loader.git.loader:asked_refs_count=197
Enumerating objects: 330, done.
Counting objects: 100% (221/221), done.
Compressing objects: 100% (154/154), done.
Total 330 (delta 137), reused 67 (delta 67), pack-reused 109
DEBUG:swh.loader.git.loader:fetched_pack_size=179705
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1997 refs for repo https://github.com/rancher/dashboard
DEBUG:swh.loader.git.loader:packfile_read_count_blob=122
DEBUG:swh.loader.git.loader:packfile_read_count_tree=172
DEBUG:swh.loader.git.loader:packfile_read_count_commit=36
DEBUG:swh.loader.git.loader:packfile_read_count_tag=0
ERROR:swh.storage.proxies.filter:content add entry count: 615
ERROR:swh.storage.proxies.filter:content add missing: 309 (0.0185)
ERROR:swh.storage.proxies.filter:content added in 1.8762
ERROR:swh.storage.proxies.filter:CSV:content;615;0.0185;309;1.8762
ERROR:swh.storage.proxies.filter:directory add entry count: 1429
ERROR:swh.storage.proxies.filter:directory add missing: 693 (0.0202)
ERROR:swh.storage.proxies.filter:directory added 1.1359
ERROR:swh.storage.proxies.filter:CSV:directory;1429;0.0202;693;1.1359
ERROR:swh.storage.proxies.filter:revision add entry count: 677
ERROR:swh.storage.proxies.filter:revision add missing: 201 (0.0113)
ERROR:swh.storage.proxies.filter:revision added 0.1201
ERROR:swh.storage.proxies.filter:CSV:revision;677;0.0113;201;0.1201
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/rancher/dashboard"
        User time (seconds): 64.80
        System time (seconds): 0.99
        Percent of CPU this job got: 28%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 3:51.44
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 406924
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 287992
        Voluntary context switches: 6940
        Involuntary context switches: 1048
        Swaps: 0
        File system inputs: 0
        File system outputs: 32
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

snapshot:

19:19:53 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/rancher/dashboard' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+--------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                 url                  | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+--------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-10-01 17:29:08.771085+00 |  4 | https://github.com/rancher/dashboard |      4 |     3 | 2021-10-01 17:28:04.58653+00  | git  | full    | (null)   | \x288708e1714a26924d51d644bf3399fc8ab68fd2 |
| 2021-10-01 17:29:08.771085+00 |  4 | https://github.com/rancher/dashboard |      4 |     3 | 2021-10-01 17:24:14.922999+00 | git  | created | (null)   | (null)                                     |
+-------------------------------+----+--------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(2 rows)

Time: 2.099 ms
  • hylang/hy

master:

swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@8e8ea5b21f57:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/hylang/hy
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7fde01fb0950>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 109
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/hylang/hy' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 108
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/get_latest HTTP/1.1" 200 167
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/get_branches HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/hylang/hy
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7fddff47bb50> to fetch pack at /hylang/hy
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=1135
DEBUG:swh.loader.git.loader:wanted_refs_count=1135
Enumerating objects: 23638, done.
Counting objects: 100% (2918/2918), done.
Compressing objects: 100% (902/902), done.
Total 23638 (delta 2124), reused 2669 (delta 2008), pack-reused 20720
DEBUG:swh.loader.git.loader:fetched_pack_size=7562834
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 1140 refs for repo https://github.com/hylang/hy
ERROR:swh.storage.proxies.filter:content add entry count: 5530
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.2939)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0139
ERROR:swh.storage.proxies.filter:CSV:content;5530;0.2939;0;0.0139
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_b'blob'=7665
ERROR:swh.storage.proxies.filter:content add entry count: 2135
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add missing: 0 (0.1134)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 33
ERROR:swh.storage.proxies.filter:content added in 0.0108
ERROR:swh.storage.proxies.filter:CSV:content;2135;0.1134;0;0.0108
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add missing: 0 (0.3099)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 16
ERROR:swh.storage.proxies.filter:directory added 0.0049
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.3099;0;0.0049
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_b'tree'=11754
DEBUG:swh.loader.git.loader:packfile_read_count_b'commit'=4188
DEBUG:swh.loader.git.loader:packfile_read_count_b'tag'=31
ERROR:swh.storage.proxies.filter:directory add entry count: 1754
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add missing: 0 (0.0620)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 16
ERROR:swh.storage.proxies.filter:directory added 0.0044
ERROR:swh.storage.proxies.filter:CSV:directory;1754;0.0620;0;0.0044
ERROR:swh.storage.proxies.filter:revision add entry count: 4188
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:revision add missing: 0 (0.0696)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 15
ERROR:swh.storage.proxies.filter:revision added 0.0050
ERROR:swh.storage.proxies.filter:CSV:revision;4188;0.0696;0;0.0050
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/hylang/hy"
        User time (seconds): 15.50
        System time (seconds): 0.22
        Percent of CPU this job got: 81%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:19.28
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 192436
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 71689
        Voluntary context switches: 1015
        Involuntary context switches: 202
        Swaps: 0
        File system inputs: 0
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

improve:

swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@b264af18aff8:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/hylang/hy
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7f31de841a10>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 109
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/hylang/hy' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
Enumerating objects: 23638, done.
Counting objects: 100% (2918/2918), done.
Compressing objects: 100% (902/902), done.
Total 23638 (delta 2124), reused 2669 (delta 2008), pack-reused 20720
DEBUG:swh.loader.git.loader:Fetched pack size: 7562834
INFO:swh.loader.git.loader.GitLoader:Listed 1140 refs for repo https://github.com/hylang/hy
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 188023
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 72593
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 38591
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 92139
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /snapshot/add HTTP/1.1" 200 15
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/hylang/hy"
        User time (seconds): 21.63
        System time (seconds): 0.37
        Percent of CPU this job got: 29%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 1:14.78
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 377248
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 75605
        Voluntary context switches: 1804
        Involuntary context switches: 1062
        Swaps: 0
        File system inputs: 0
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0
  • cozy/cozy-stack

master:

swh@8e8ea5b21f57:/$ /usr/bin/time -v swh --log-level DEBUG loader run git https://github.com/cozy/cozy-stack
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7f8b236b0b50>
DEBUG:swh.core.config:Loading config file /loader.yml
DEBUG:swh.loader.cli:config_file: /loader.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.git.tasks'], 'loader': <class 'swh.loader.git.loader.GitLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.git.loader.GitLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): swh-storage:5002
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/add HTTP/1.1" 200 116
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:Transport url to communicate with server: git://github.com/cozy/cozy-stack
DEBUG:swh.loader.git.loader:Client <dulwich.client.TCPGitClient object at 0x7f8b21cc9990> to fetch pack at /cozy/cozy-stack
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=3117
DEBUG:swh.loader.git.loader:wanted_refs_count=3117
Enumerating objects: 68843, done.
Counting objects: 100% (4028/4028), done.
Compressing objects: 100% (1412/1412), done.
Total 68843 (delta 2677), reused 3773 (delta 2560), pack-reused 64815
DEBUG:swh.loader.git.loader:fetched_pack_size=199635446
DEBUG:swh.loader.git.loader:Protocol used for communication: smart
INFO:swh.loader.git.loader:Listed 3127 refs for repo https://github.com/cozy/cozy-stack
ERROR:swh.storage.proxies.filter:content add entry count: 9112
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 309777
ERROR:swh.storage.proxies.filter:content add missing: 9111 (0.5051)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 34.4187
ERROR:swh.storage.proxies.filter:CSV:content;9112;0.5051;9111;34.4187
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 1164
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 39579
ERROR:swh.storage.proxies.filter:content add missing: 1164 (0.0352)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 8.1075
ERROR:swh.storage.proxies.filter:CSV:content;1164;0.0352;1164;8.1075
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0049)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.5325
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0049;23;5.5325
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0049)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.3553
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0049;23;5.3553
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0049)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.4905
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0049;23;5.4905
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0050)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.5900
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0050;23;5.5900
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 1485
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 50493
ERROR:swh.storage.proxies.filter:content add missing: 1485 (0.0408)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 8.8635
ERROR:swh.storage.proxies.filter:CSV:content;1485;0.0408;1485;8.8635
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 1849
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 62869
ERROR:swh.storage.proxies.filter:content add missing: 1849 (0.0586)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 10.9364
ERROR:swh.storage.proxies.filter:CSV:content;1849;0.0586;1849;10.9364
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 625
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 21253
ERROR:swh.storage.proxies.filter:content add missing: 625 (0.0237)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.1772
ERROR:swh.storage.proxies.filter:CSV:content;625;0.0237;625;7.1772
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 33
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1125
ERROR:swh.storage.proxies.filter:content add missing: 33 (0.0064)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.9669
ERROR:swh.storage.proxies.filter:CSV:content;33;0.0064;33;5.9669
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 30
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1023
ERROR:swh.storage.proxies.filter:content add missing: 30 (0.0048)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.5938
ERROR:swh.storage.proxies.filter:CSV:content;30;0.0048;30;5.5938
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 107
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3641
ERROR:swh.storage.proxies.filter:content add missing: 107 (0.0077)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 6.0994
ERROR:swh.storage.proxies.filter:CSV:content;107;0.0077;107;6.0994
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 45
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 1533
ERROR:swh.storage.proxies.filter:content add missing: 45 (0.0054)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 5.8920
ERROR:swh.storage.proxies.filter:CSV:content;45;0.0054;45;5.8920
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 137
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 4661
ERROR:swh.storage.proxies.filter:content add missing: 137 (0.0097)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 38
ERROR:swh.storage.proxies.filter:content added in 5.7467
ERROR:swh.storage.proxies.filter:CSV:content;137;0.0097;137;5.7467
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 2294
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 77999
ERROR:swh.storage.proxies.filter:content add missing: 2294 (0.0672)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 15.4189
ERROR:swh.storage.proxies.filter:CSV:content;2294;0.0672;2294;15.4189
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 23
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 785
ERROR:swh.storage.proxies.filter:content add missing: 23 (0.0050)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 14.3635
ERROR:swh.storage.proxies.filter:CSV:content;23;0.0050;23;14.3635
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 784
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 26659
ERROR:swh.storage.proxies.filter:content add missing: 784 (0.0244)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 15.0394
ERROR:swh.storage.proxies.filter:CSV:content;784;0.0244;784;15.0394
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 1601
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 54437
ERROR:swh.storage.proxies.filter:content add missing: 1601 (0.0468)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 16.3575
ERROR:swh.storage.proxies.filter:CSV:content;1601;0.0468;1601;16.3575
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 1429
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 48589
ERROR:swh.storage.proxies.filter:content add missing: 1429 (0.0409)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 9.6095
ERROR:swh.storage.proxies.filter:CSV:content;1429;0.0409;1429;9.6095
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 105
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 3573
ERROR:swh.storage.proxies.filter:content add missing: 105 (0.0093)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 37
ERROR:swh.storage.proxies.filter:content added in 8.2610
ERROR:swh.storage.proxies.filter:CSV:content;105;0.0093;105;8.2610
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:content add entry count: 742
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 25231
ERROR:swh.storage.proxies.filter:content add missing: 742 (0.0235)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 7.2126
ERROR:swh.storage.proxies.filter:CSV:content;742;0.0235;742;7.2126
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_blob=22428
ERROR:swh.storage.proxies.filter:content add entry count: 771
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/missing HTTP/1.1" 200 26217
ERROR:swh.storage.proxies.filter:content add missing: 771 (0.0256)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /content/add HTTP/1.1" 200 39
ERROR:swh.storage.proxies.filter:content added in 2.1646
ERROR:swh.storage.proxies.filter:CSV:content;771;0.0256;771;2.1646
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.3215)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 14.6909
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.3215;10000;14.6909
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.0930)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 14.2658
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.0930;10000;14.2658
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
ERROR:swh.storage.proxies.filter:directory add entry count: 10000
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:directory add missing: 10000 (0.1078)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 11.7500
ERROR:swh.storage.proxies.filter:CSV:directory;10000;0.1078;10000;11.7500
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_tree=35150
ERROR:swh.storage.proxies.filter:directory add entry count: 5150
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/missing HTTP/1.1" 200 113303
ERROR:swh.storage.proxies.filter:directory add missing: 5150 (0.0584)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /directory/add HTTP/1.1" 200 18
ERROR:swh.storage.proxies.filter:directory added 5.5696
ERROR:swh.storage.proxies.filter:CSV:directory;5150;0.0584;5150;5.5696
ERROR:swh.storage.proxies.filter:revision add entry count: 10000
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 220003
ERROR:swh.storage.proxies.filter:revision add missing: 10000 (0.1715)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 6.3653
ERROR:swh.storage.proxies.filter:CSV:revision;10000;0.1715;10000;6.3653
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:swh.loader.git.loader:packfile_read_count_commit=11263
DEBUG:swh.loader.git.loader:packfile_read_count_tag=2
ERROR:swh.storage.proxies.filter:revision add entry count: 1263
DEBUG:urllib3.connectionpool:Resetting dropped connection: swh-storage
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/missing HTTP/1.1" 200 27789
ERROR:swh.storage.proxies.filter:revision add missing: 1263 (0.0159)
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /revision/add HTTP/1.1" 200 17
ERROR:swh.storage.proxies.filter:revision added 0.7455
ERROR:swh.storage.proxies.filter:CSV:revision;1263;0.0159;1263;0.7455
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /release/add HTTP/1.1" 200 14
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /origin/visit_status/add HTTP/1.1" 200 26
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /flush HTTP/1.1" 200 1
DEBUG:urllib3.connectionpool:http://swh-storage:5002 "POST /clear/buffer HTTP/1.1" 200 1
{'status': 'eventful'}
        Command being timed: "swh --log-level DEBUG loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 97.09
        System time (seconds): 4.52
        Percent of CPU this job got: 27%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 6:09.10
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 767700
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 4
        Minor (reclaiming a frame) page faults: 593129
        Voluntary context switches: 19161
        Involuntary context switches: 1527
        Swaps: 0
        File system inputs: 6968
        File system outputs: 389960
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

Interesting stuff:

DEBUG:swh.loader.git.loader:fetched_pack_size=199635446
DEBUG:swh.loader.git.loader:local_heads_count=0
DEBUG:swh.loader.git.loader:remote_heads_count=3117
DEBUG:swh.loader.git.loader:wanted_refs_count=3117
DEBUG:swh.loader.git.loader:packfile_read_count_blob=22428
DEBUG:swh.loader.git.loader:packfile_read_count_tree=35150
DEBUG:swh.loader.git.loader:packfile_read_count_commit=11263
DEBUG:swh.loader.git.loader:packfile_read_count_tag=2
  • old cozy/cozy-stack
  • docker-dev with override
18:16:09 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/cozy/cozy-stack' and ovs.type='git' order by date desc limit 4;
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                url                 | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-09-30 16:16:24.727779+00 |  1 | https://github.com/cozy/cozy-stack |      1 |     2 | 2021-09-30 16:16:00.604747+00 | git  | full    | (null)   | \x68dba01dbcf0afdb6130d183d2e8d3e420f15b1b |
| 2021-09-30 16:16:24.727779+00 |  1 | https://github.com/cozy/cozy-stack |      1 |     2 | 2021-09-30 16:15:59.32989+00  | git  | created | (null)   | (null)                                     |
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(4 rows)

Time: 0.612 ms

logs:

$ swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@1da9a15ff22e:/$ /usr/bin/time -v swh loader run git https://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
INFO:swh.loader.git.loader:##### transport url: git://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader:##### limit the refs to: 2000
INFO:swh.loader.git.loader:##### wanted_refs: 3117
INFO:swh.loader.git.loader:##### Fetch range [0 : 2000]
INFO:swh.loader.git.loader:##### nb of fetched refs: 2000
INFO:swh.loader.git.loader:##### nb of fetched refs: 2000
Enumerating objects: 66765, done.
Counting objects: 100% (3877/3877), done.
Compressing objects: 100% (1348/1348), done.
Total 66765 (delta 2588), reused 3624 (delta 2473), pack-reused 62888
INFO:swh.loader.git.loader:##### Fetched pack size: 181200078
INFO:swh.loader.git.loader:#### remote_refs: 3197
INFO:swh.loader.git.loader:#### filtered_remote_refs: 3127
INFO:swh.loader.git.loader:#### symbolic_refs: 1
INFO:swh.loader.git.loader:#### filtered_symbolic_refs: 1
INFO:swh.loader.git.loader:Listed 3126 refs for repo https://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader:##### transport url: git://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader:##### limit the refs to: 2000
INFO:swh.loader.git.loader:##### wanted_refs: 3117
INFO:swh.loader.git.loader:##### Fetch range [2000 : 3117]
INFO:swh.loader.git.loader:##### nb of fetched refs: 1117
Enumerating objects: 64307, done.
Counting objects: 100% (3740/3740), done.
Compressing objects: 100% (1268/1268), done.
Total 64307 (delta 2523), reused 3525 (delta 2418), pack-reused 60567
INFO:swh.loader.git.loader:##### Fetched pack size: 149331238
INFO:swh.loader.git.loader:#### remote_refs: 3197
INFO:swh.loader.git.loader:#### filtered_remote_refs: 3127
INFO:swh.loader.git.loader:#### symbolic_refs: 1
INFO:swh.loader.git.loader:#### filtered_symbolic_refs: 1
INFO:swh.loader.git.loader:Listed 3126 refs for repo https://github.com/cozy/cozy-stack
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 119.58
        System time (seconds): 4.29
        Percent of CPU this job got: 28%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 7:08.98
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 2784576
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 625433
        Voluntary context switches: 36303
        Involuntary context switches: 1842
        Swaps: 0
        File system inputs: 0
        File system outputs: 645584
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

logs (no group by, reading multiple times the smaller packfile)

swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@8c2b74a82792:/$
swh@8c2b74a82792:/$ /usr/bin/time -v swh loader run git https://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
Enumerating objects: 68843, done.
Counting objects: 100% (4028/4028), done.
Compressing objects: 100% (1417/1417), done.
Total 68843 (delta 2674), reused 3770 (delta 2555), pack-reused 64815
INFO:swh.loader.git.loader.GitLoader:Listed 3127 refs for repo https://github.com/cozy/cozy-stack
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 86.25
        System time (seconds): 5.16
        Percent of CPU this job got: 21%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 7:07.99
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 771048
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 545751
        Voluntary context switches: 22600
        Involuntary context switches: 1754
        Swaps: 0
        File system inputs: 0
        File system outputs: 389904
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0
  • docker without override
18:24:44 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/cozy/cozy-stack' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                url                 | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-09-30 16:24:45.270929+00 |  1 | https://github.com/cozy/cozy-stack |      1 |     1 | 2021-09-30 16:24:35.706488+00 | git  | full    | (null)   | \x68dba01dbcf0afdb6130d183d2e8d3e420f15b1b |
| 2021-09-30 16:24:45.270929+00 |  1 | https://github.com/cozy/cozy-stack |      1 |     1 | 2021-09-30 16:18:07.55629+00  | git  | created | (null)   | (null)                                     |
+-------------------------------+----+------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(2 rows)

Time: 2.139 ms

logs:

swh-doco exec swh-loader /bin/bash
+ cd /home/tony/work/inria/repo/swh/swh-environment/docker
+ docker-compose -f docker-compose.yml -f docker-compose.override.yml exec swh-loader /bin/bash
swh@d902ac731424:/$ swh^C
swh@d902ac731424:/$ /usr/bin/time -v swh loader run git https://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
Enumerating objects: 68843, done.
Counting objects: 100% (4028/4028), done.
Compressing objects: 100% (1412/1412), done.
Total 68843 (delta 2677), reused 3773 (delta 2560), pack-reused 64815
INFO:swh.loader.git.loader.GitLoader:Listed 3127 refs for repo https://github.com/cozy/cozy-stack
{'status': 'eventful'}
        Command being timed: "swh loader run git https://github.com/cozy/cozy-stack"
        User time (seconds): 104.66
        System time (seconds): 4.96
        Percent of CPU this job got: 28%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 6:31.43
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 766780
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 528418
        Voluntary context switches: 18964
        Involuntary context switches: 1679
        Swaps: 0
        File system inputs: 0
        File system outputs: 389928
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

  swh@a6ddb051b815:/$ /usr/bin/time -v swh loader run git https://github.com/cozy/cozy-stack
  INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
  Enumerating objects: 68841, done.
  Counting objects: 100% (4026/4026), done.
  Compressing objects: 100% (1412/1412), done.
  Total 68841 (delta 2677), reused 3772 (delta 2558), pack-reused 64815
  INFO:swh.loader.git.loader.GitLoader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
  {'status': 'eventful'}
          Command being timed: "swh loader run git https://github.com/cozy/cozy-stack"
          User time (seconds): 104.65
          System time (seconds): 5.08
          Percent of CPU this job got: 27%
          Elapsed (wall clock) time (h:mm:ss or m:ss): 6:32.20
          Average shared text size (kbytes): 0
          Average unshared data size (kbytes): 0
          Average stack size (kbytes): 0
          Average total size (kbytes): 0
          Maximum resident set size (kbytes): 775628
          Average resident set size (kbytes): 0
          Major (requiring I/O) page faults: 0
          Minor (reclaiming a frame) page faults: 560836
          Voluntary context switches: 20797
          Involuntary context switches: 1396
          Swaps: 0
          File system inputs: 0
          File system outputs: 389992
          Socket messages sent: 0
          Socket messages received: 0
          Signals delivered: 0
          Page size (bytes): 4096
          Exit status: 0
  • Run simple
    • staging
  • Run on staging

logs:

swhworker@worker1:~$ time SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_git.yml swh loader run git https://github.coswhworker@worker1:~$ time SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_git.yml swh loader run git https://github.com/cozy/cozy-stack
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/cozy/cozy-stack' with type 'git'
Enumerating objects: 68841, done.
Counting objects: 100% (4026/4026), done.
Compressing objects: 100% (1411/1411), done.
Total 68841 (delta 2676), reused 3773 (delta 2559), pack-reused 64815
INFO:swh.loader.git.loader.GitLoader:Listed 3128 refs for repo https://github.com/cozy/cozy-stack
{'status': 'eventful'}

real    58m26.944s
user    1m53.073s
sys     0m8.366s

sql:

18:45:04 swh@db1:5432=> select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/cozy/cozy-stack' and ovs.type='git' order by date desc limit 2;
+-------------------------------+---------+------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
|              now              |   id    |                url                 | origin  | visit |             date              | status  | metadata |                  snapshot                  | type |
+-------------------------------+---------+------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
| 2021-09-30 16:45:17.564742+00 | 1411008 | https://github.com/cozy/cozy-stack | 1411008 |     1 | 2021-09-30 16:43:52.188045+00 | full    | (null)   | \x3e22041530f79efd27359cf8c25fc6f5b014abec | git  |
| 2021-09-30 16:45:17.564742+00 | 1411008 | https://github.com/cozy/cozy-stack | 1411008 |     1 | 2021-09-30 15:45:32.462213+00 | created | (null)   | (null)                                     | git  |
+-------------------------------+---------+------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
(2 rows)

Time: 19.525 ms
  • simple dot-files
  • staging
16:06:33 swh@db1:5432=> select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/ardumont/dot-files' and ovs.type='git' order by date desc limit 2;
+-------------------------------+---------+---------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
|              now              |   id    |                  url                  | origin  | visit |             date              | status  | metadata |                  snapshot                  | type |
+-------------------------------+---------+---------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
| 2021-09-30 14:06:34.712062+00 | 1410211 | https://github.com/ardumont/dot-files | 1410211 |     1 | 2021-09-30 14:05:23.908049+00 | full    | (null)   | \x8172027a50ac8d92844a7c462c4913cfdce56b92 | git  |
| 2021-09-30 14:06:34.712062+00 | 1410211 | https://github.com/ardumont/dot-files | 1410211 |     1 | 2021-09-30 13:59:09.933579+00 | created | (null)   | (null)                                     | git  |
+-------------------------------+---------+---------------------------------------+---------+-------+-------------------------------+---------+----------+--------------------------------------------+------+
(2 rows)

Time: 5.185 ms
  • docker
16:07:34 swh-storage@localhost:5434=# select now(), * from origin o inner join origin_visit_status ovs on o.id=ovs.origin where o.url = 'https://github.com/ardumont/dot-files' and ovs.type='git' order by date desc limit 2;
+-------------------------------+----+---------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
|              now              | id |                  url                  | origin | visit |             date              | type | status  | metadata |                  snapshot                  |
+-------------------------------+----+---------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
| 2021-09-30 14:07:36.528774+00 |  1 | https://github.com/ardumont/dot-files |      1 |     6 | 2021-09-30 13:59:09.784122+00 | git  | full    | (null)   | \x8172027a50ac8d92844a7c462c4913cfdce56b92 |
| 2021-09-30 14:07:36.528774+00 |  1 | https://github.com/ardumont/dot-files |      1 |     6 | 2021-09-30 13:58:34.500716+00 | git  | created | (null)   | (null)                                     |
+-------------------------------+----+---------------------------------------+--------+-------+-------------------------------+------+---------+----------+--------------------------------------------+
(2 rows)
About · Developer information · Legal