Page MenuHomeSoftware Heritage
Harbormaster B871 Build 1166

Build 1166
Public
Actions

Properties

Buildable
B871: rDSTOa8ce0d9208f1: swh.storage.tests: Refactor reading the indexer tools
Build Plan
Plan 2 Software Heritage Python tests
Status
Failed

Lint

When
Completed at Jun 1 2017, 4:58 PM · Built instantly
Status
Failed

Build Log 3915 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1/usr/bin/python3: No module named flake8
2make: *** [check] Error 1
3

Build Log 3914 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1python3 -m flake8 swh bin/swh-storage-add-dir
2../Makefile.python:25: recipe for target 'check' failed
3

Python tests

When
Completed at Jun 1 2017, 4:58 PM · Built for 11 s
Status
Failed
1 empty logs are hidden. Show all logs.

Build Log 3913 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1W: unknown repository 'swh-environment', you might want to remove it
2W: unknown repository 'swh-lister-github', you might want to remove it
3W: unknown repository 'swh-lister-bitbucket', you might want to remove it
4Failure: ImportError (No module named 'aiohttp') ... ERROR
5Failure: ImportError (No module named 'aiohttp') ... ERROR
6Failure: ImportError (No module named 'aiohttp') ... ERROR
7ctags_to_db (test_converters.TestConverters) ... ok
8db_to_author (test_converters.TestConverters) ... ok
9db_to_ctags (test_converters.TestConverters) ... ok
10db_to_git_headers (test_converters.TestConverters) ... ok
11db_to_language (test_converters.TestConverters) ... ok
12db_to_mimetype (test_converters.TestConverters) ... ok
13db_to_release (test_converters.TestConverters) ... ok
14db_to_revision (test_converters.TestConverters) ... ok
15
16======================================================================
17ERROR: Failure: ImportError (No module named 'aiohttp')
18----------------------------------------------------------------------
19Traceback (most recent call last):
20 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
21 raise self.exc_val.with_traceback(self.tb)
22 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
23 addr.filename, addr.module)
24 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
25 return self.importFromDir(dir_path, fqname)
26 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
27 mod = load_module(part_fqname, fh, filename, desc)
28 File "/usr/lib/python3.4/imp.py", line 235, in load_module
29 return load_source(name, filename, file)
30 File "/usr/lib/python3.4/imp.py", line 171, in load_source
31 module = methods.load()
32 File "<frozen importlib._bootstrap>", line 1220, in load
33 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
34 File "<frozen importlib._bootstrap>", line 1129, in _exec
35 File "<frozen importlib._bootstrap>", line 1471, in exec_module
36 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
37 File "/home/temp-drydock/drydock/workingcopy-169/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
38 import aiohttp
39ImportError: No module named 'aiohttp'
40
41======================================================================
42ERROR: Failure: ImportError (No module named 'aiohttp')
43----------------------------------------------------------------------
44Traceback (most recent call last):
45 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
46 raise self.exc_val.with_traceback(self.tb)
47 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
48 addr.filename, addr.module)
49 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
50 return self.importFromDir(dir_path, fqname)
51 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
52 mod = load_module(part_fqname, fh, filename, desc)
53 File "/usr/lib/python3.4/imp.py", line 235, in load_module
54 return load_source(name, filename, file)
55 File "/usr/lib/python3.4/imp.py", line 171, in load_source
56 module = methods.load()
57 File "<frozen importlib._bootstrap>", line 1220, in load
58 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
59 File "<frozen importlib._bootstrap>", line 1129, in _exec
60 File "<frozen importlib._bootstrap>", line 1471, in exec_module
61 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
62 File "/home/temp-drydock/drydock/workingcopy-169/repo/swh-storage/swh/storage/tests/test_api_client.py", line 10, in <module>
63 from swh.storage.tests.server_testing import ServerTestFixture
64 File "/home/temp-drydock/drydock/workingcopy-169/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
65 import aiohttp
66ImportError: No module named 'aiohttp'
67
68======================================================================
69ERROR: Failure: ImportError (No module named 'aiohttp')
70----------------------------------------------------------------------
71Traceback (most recent call last):
72 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
73 raise self.exc_val.with_traceback(self.tb)
74 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
75 addr.filename, addr.module)
76 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
77 return self.importFromDir(dir_path, fqname)
78 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
79 mod = load_module(part_fqname, fh, filename, desc)
80 File "/usr/lib/python3.4/imp.py", line 235, in load_module
81 return load_source(name, filename, file)
82 File "/usr/lib/python3.4/imp.py", line 171, in load_source
83 module = methods.load()
84 File "<frozen importlib._bootstrap>", line 1220, in load
85 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
86 File "<frozen importlib._bootstrap>", line 1129, in _exec
87 File "<frozen importlib._bootstrap>", line 1471, in exec_module
88 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
89 File "/home/temp-drydock/drydock/workingcopy-169/repo/swh-storage/swh/storage/tests/test_archiver.py", line 19, in <module>
90 from server_testing import ServerTestFixtureAsync
91 File "/home/temp-drydock/drydock/workingcopy-169/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
92 import aiohttp
93ImportError: No module named 'aiohttp'
94
95----------------------------------------------------------------------
96Ran 11 tests in 3.392s
97
98FAILED (errors=3)
99

Update environment from working copy

When
Completed at Jun 1 2017, 4:57 PM · Built for 1 m, 1 s
Status
Passed

Build Log 3897 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: command failed
2

Build Log 3896 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-core
2mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-core
3ssh_exchange_identification: Connection closed by remote host
4fatal: Could not read from remote repository.
5
6Please make sure you have the correct access rights
7and the repository exists.
8
9mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-cloner-git
10mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-cloner-git
11Already up-to-date.
12
13mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-fetcher-googlecode
14mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-fetcher-googlecode
15Already up-to-date.
16
17mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/snippets
18mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/snippets
19From ssh://forge.softwareheritage.org/diffusion/59/code-snippets
20 10ee1e1..49ffa63 master -> origin/master
21Updating 10ee1e1..49ffa63
22Fast-forward
23 ardumont/graph_bar.py | 47 +++++++++++++++++++++++++++++++++++++++++++
24 ardumont/read_from_archive.py | 34 +++++++++++++++++++++++++++++++
25 ardumont/send-batch-sha1s.sh | 30 +++++++++++++++++++++++++++
26 olasd/azure/provision-vm.sh | 18 +++++------------
27 4 files changed, 116 insertions(+), 13 deletions(-)
28 create mode 100755 ardumont/graph_bar.py
29 create mode 100755 ardumont/read_from_archive.py
30 create mode 100755 ardumont/send-batch-sha1s.sh
31
32mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-journal
33mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-journal
34Already up-to-date.
35
36mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-indexer
37mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-indexer
38From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
39 71dac8f..6371109 master -> origin/master
40 * [new tag] v0.0.25 -> v0.0.25
41 * [new tag] v0.0.26 -> v0.0.26
42 * [new tag] v0.0.27 -> v0.0.27
43 * [new tag] v0.0.28 -> v0.0.28
44Updating 71dac8f..6371109
45Fast-forward
46 swh/indexer/__init__.py | 4 +-
47 swh/indexer/ctags.py | 20 +++---
48 swh/indexer/fossology_license.py | 59 ++++++++++-------
49 swh/indexer/indexer.py | 85 +++++++++++++++++-------
50 swh/indexer/language.py | 61 ++++++++++++++----
51 swh/indexer/mimetype.py | 13 ++--
52 swh/indexer/orchestrator.py | 136 ++++++++++++++++++++++++---------------
53 swh/indexer/rehash.py | 44 +++++++------
54 swh/indexer/tasks.py | 2 +-
55 9 files changed, 268 insertions(+), 156 deletions(-)
56
57mr checkout: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-lister
58mr checkout: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-lister
59Cloning into 'swh-lister'...
60
61mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-antelink
62mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-antelink
63Already up-to-date.
64
65mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-debian
66mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-debian
67Already up-to-date.
68
69mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-core
70mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-core
71Already up-to-date.
72
73mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-dir
74mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-dir
75Already up-to-date.
76
77mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-mercurial
78mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-mercurial
79From ssh://forge.softwareheritage.org/source/swh-loader-mercurial
80 09caf66..dbd3c73 master -> origin/master
81Updating 09caf66..dbd3c73
82Fast-forward
83 swh/foo/bar.py | 4 -
84 swh/loader/mercurial/archive_extract.py | 45 ++++
85 swh/loader/mercurial/base.py | 457 ++++++++++++++++++++++++++++++++
86 swh/loader/mercurial/bundle_loader.py | 322 ++++++++++++++++++++++
87 swh/loader/mercurial/converters.py | 90 +++++++
88 swh/loader/mercurial/slow_loader.py | 416 +++++++++++++++++++++++++++++
89 6 files changed, 1330 insertions(+), 4 deletions(-)
90 delete mode 100644 swh/foo/bar.py
91 create mode 100644 swh/loader/mercurial/archive_extract.py
92 create mode 100644 swh/loader/mercurial/base.py
93 create mode 100644 swh/loader/mercurial/bundle_loader.py
94 create mode 100644 swh/loader/mercurial/converters.py
95 create mode 100644 swh/loader/mercurial/slow_loader.py
96
97mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-git
98mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-git
99Already up-to-date.
100
101mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-svn
102mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-svn
103Already up-to-date.
104
105mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-tar
106mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-loader-tar
107Already up-to-date.
108
109mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-mirror-forge
110mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-mirror-forge
111Already up-to-date.
112
113mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-model
114mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-model
115Already up-to-date.
116
117mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-objstorage
118mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-objstorage
119Already up-to-date.
120
121mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-py-template
122mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-py-template
123Already up-to-date.
124
125mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-scheduler
126mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-scheduler
127From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
128 f758291..07ea766 master -> origin/master
129Updating f758291..07ea766
130Fast-forward
131 bin/swh-worker-control | 269 +++++++++++++++++++++++++++++++++
132 setup.py | 2 +-
133 swh/scheduler/celery_backend/config.py | 9 ++
134 3 files changed, 279 insertions(+), 1 deletion(-)
135 create mode 100755 bin/swh-worker-control
136
137mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-storage-testdata
138mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-storage-testdata
139Already up-to-date.
140
141mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-web-ui
142mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-web-ui
143From ssh://forge.softwareheritage.org/diffusion/DWUI/swh-web-ui
144 06d1446..3471862 master -> origin/master
145Updating 06d1446..3471862
146Fast-forward
147 swh/web/ui/main.py | 35 ++++++++++++++++++++++++++---------
148 swh/web/ui/tests/test_app.py | 10 ++++++++--
149 2 files changed, 34 insertions(+), 11 deletions(-)
150
151mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-storage
152mr update: /home/temp-drydock/drydock/workingcopy-169/repo/swh-environment/swh-storage
153From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
154 76ed458..5ff3979 master -> origin/master
155Updating 76ed458..5ff3979
156Fast-forward
157 docs/vault-blueprint.md | 139 -------------
158 sql/swh-data.sql | 3 +
159 sql/swh-func.sql | 134 +++++-------
160 sql/swh-indexes.sql | 2 +-
161 sql/swh-schema.sql | 2 +-
162 sql/upgrades/105.sql | 31 +++
163 swh/storage/api/client.py | 3 +
164 swh/storage/api/server.py | 6 +
165 swh/storage/converters.py | 38 ++--
166 swh/storage/db.py | 48 +++--
167 swh/storage/storage.py | 61 +++---
168 swh/storage/tests/server_testing.py | 107 ++++++++--
169 swh/storage/tests/test_archiver.py | 8 +-
170 swh/storage/tests/test_converters.py | 55 ++++-
171 swh/storage/tests/test_storage.py | 321 ++++++++++++++++-------------
172 swh/storage/vault/api/client.py | 27 ---
173 swh/storage/vault/api/cooking_tasks.py | 27 ---
174 swh/storage/vault/api/server.py | 98 ---------
175 swh/storage/vault/cache.py | 53 -----
176 swh/storage/vault/conf.yaml | 0
177 swh/storage/vault/cookers/__init__.py | 14 --
178 swh/storage/vault/cookers/base.py | 221 --------------------
179 swh/storage/vault/cookers/directory.py | 24 ---
180 swh/storage/vault/cookers/revision_flat.py | 33 ---
181 swh/storage/vault/cookers/revision_git.py | 204 ------------------
182 25 files changed, 508 insertions(+), 1151 deletions(-)
183 delete mode 100644 docs/vault-blueprint.md
184 create mode 100644 sql/upgrades/105.sql
185 delete mode 100644 swh/storage/vault/api/client.py
186 delete mode 100644 swh/storage/vault/api/cooking_tasks.py
187 delete mode 100644 swh/storage/vault/api/server.py
188 delete mode 100644 swh/storage/vault/cache.py
189 delete mode 100644 swh/storage/vault/conf.yaml
190 delete mode 100644 swh/storage/vault/cookers/__init__.py
191 delete mode 100644 swh/storage/vault/cookers/base.py
192 delete mode 100644 swh/storage/vault/cookers/directory.py
193 delete mode 100644 swh/storage/vault/cookers/revision_flat.py
194 delete mode 100644 swh/storage/vault/cookers/revision_git.py
195
196mr update: finished (22 ok; 1 failed)
197

Clone on Software Heritage Worker

When
Completed at Jun 1 2017, 4:56 PM · Built for 1 s
Status
Passed

Event Timeline

About · Developer information · Legal