Page MenuHomeSoftware Heritage
Harbormaster B869 Build 1164

Build 1164
Public
Actions

Properties

Buildable
B869: rDSTO45a923bb5edb: swh.storage: mimetype endpoints: use indexer_configuration_id
Build Plan
Plan 2 Software Heritage Python tests
Status
Failed

Lint

When
Completed at Jun 1 2017, 4:57 PM · Built for 3 s
Status
Failed

Build Log 3911 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1/usr/bin/python3: No module named flake8
2make: *** [check] Error 1
3

Build Log 3910 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1python3 -m flake8 swh bin/swh-storage-add-dir
2../Makefile.python:25: recipe for target 'check' failed
3

Python tests

When
Completed at Jun 1 2017, 4:58 PM · Built for 12 s
Status
Failed
1 empty logs are hidden. Show all logs.

Build Log 3909 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1W: unknown repository 'swh-environment', you might want to remove it
2W: unknown repository 'swh-lister-github', you might want to remove it
3W: unknown repository 'swh-lister-bitbucket', you might want to remove it
4Failure: ImportError (No module named 'aiohttp') ... ERROR
5Failure: ImportError (No module named 'aiohttp') ... ERROR
6Failure: ImportError (No module named 'aiohttp') ... ERROR
7ctags_to_db (test_converters.TestConverters) ... ok
8db_to_author (test_converters.TestConverters) ... ok
9db_to_ctags (test_converters.TestConverters) ... ok
10db_to_git_headers (test_converters.TestConverters) ... ok
11db_to_language (test_converters.TestConverters) ... ok
12db_to_mimetype (test_converters.TestConverters) ... ok
13db_to_release (test_converters.TestConverters) ... ok
14db_to_revision (test_converters.TestConverters) ... ok
15
16======================================================================
17ERROR: Failure: ImportError (No module named 'aiohttp')
18----------------------------------------------------------------------
19Traceback (most recent call last):
20 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
21 raise self.exc_val.with_traceback(self.tb)
22 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
23 addr.filename, addr.module)
24 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
25 return self.importFromDir(dir_path, fqname)
26 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
27 mod = load_module(part_fqname, fh, filename, desc)
28 File "/usr/lib/python3.4/imp.py", line 235, in load_module
29 return load_source(name, filename, file)
30 File "/usr/lib/python3.4/imp.py", line 171, in load_source
31 module = methods.load()
32 File "<frozen importlib._bootstrap>", line 1220, in load
33 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
34 File "<frozen importlib._bootstrap>", line 1129, in _exec
35 File "<frozen importlib._bootstrap>", line 1471, in exec_module
36 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
37 File "/home/temp-drydock/drydock/workingcopy-171/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
38 import aiohttp
39ImportError: No module named 'aiohttp'
40
41======================================================================
42ERROR: Failure: ImportError (No module named 'aiohttp')
43----------------------------------------------------------------------
44Traceback (most recent call last):
45 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
46 raise self.exc_val.with_traceback(self.tb)
47 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
48 addr.filename, addr.module)
49 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
50 return self.importFromDir(dir_path, fqname)
51 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
52 mod = load_module(part_fqname, fh, filename, desc)
53 File "/usr/lib/python3.4/imp.py", line 235, in load_module
54 return load_source(name, filename, file)
55 File "/usr/lib/python3.4/imp.py", line 171, in load_source
56 module = methods.load()
57 File "<frozen importlib._bootstrap>", line 1220, in load
58 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
59 File "<frozen importlib._bootstrap>", line 1129, in _exec
60 File "<frozen importlib._bootstrap>", line 1471, in exec_module
61 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
62 File "/home/temp-drydock/drydock/workingcopy-171/repo/swh-storage/swh/storage/tests/test_api_client.py", line 10, in <module>
63 from swh.storage.tests.server_testing import ServerTestFixture
64 File "/home/temp-drydock/drydock/workingcopy-171/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
65 import aiohttp
66ImportError: No module named 'aiohttp'
67
68======================================================================
69ERROR: Failure: ImportError (No module named 'aiohttp')
70----------------------------------------------------------------------
71Traceback (most recent call last):
72 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
73 raise self.exc_val.with_traceback(self.tb)
74 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
75 addr.filename, addr.module)
76 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
77 return self.importFromDir(dir_path, fqname)
78 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
79 mod = load_module(part_fqname, fh, filename, desc)
80 File "/usr/lib/python3.4/imp.py", line 235, in load_module
81 return load_source(name, filename, file)
82 File "/usr/lib/python3.4/imp.py", line 171, in load_source
83 module = methods.load()
84 File "<frozen importlib._bootstrap>", line 1220, in load
85 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
86 File "<frozen importlib._bootstrap>", line 1129, in _exec
87 File "<frozen importlib._bootstrap>", line 1471, in exec_module
88 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
89 File "/home/temp-drydock/drydock/workingcopy-171/repo/swh-storage/swh/storage/tests/test_archiver.py", line 19, in <module>
90 from server_testing import ServerTestFixtureAsync
91 File "/home/temp-drydock/drydock/workingcopy-171/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
92 import aiohttp
93ImportError: No module named 'aiohttp'
94
95----------------------------------------------------------------------
96Ran 11 tests in 3.343s
97
98FAILED (errors=3)
99

Update environment from working copy

When
Completed at Jun 1 2017, 4:57 PM · Built for 58 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 3892 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-fetcher-googlecode
2mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-fetcher-googlecode
3Already up-to-date.
4
5mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-cloner-git
6mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-cloner-git
7Already up-to-date.
8
9mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/snippets
10mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/snippets
11From ssh://forge.softwareheritage.org/diffusion/59/code-snippets
12 2a47cb7..49ffa63 master -> origin/master
13Updating 2a47cb7..49ffa63
14Fast-forward
15 ardumont/dispatch.py | 34 ++++++++++++
16 ardumont/graph_bar.py | 47 ++++++++++++++++
17 ardumont/read_from_archive.py | 34 ++++++++++++
18 ardumont/send-batch-sha1s.sh | 30 +++++++++++
19 olasd/azure/create-vm.sh | 14 +++--
20 olasd/azure/provision-vm.sh | 57 +++++++++++++-------
21 sql/swh-graph/dump-swh-graph.sql | 7 +++
22 sql/swh-graph/swh-graph.out | 114 +++++++++------------------------------
23 8 files changed, 222 insertions(+), 115 deletions(-)
24 create mode 100755 ardumont/dispatch.py
25 create mode 100755 ardumont/graph_bar.py
26 create mode 100755 ardumont/read_from_archive.py
27 create mode 100755 ardumont/send-batch-sha1s.sh
28 mode change 100644 => 100755 olasd/azure/create-vm.sh
29 mode change 100644 => 100755 olasd/azure/provision-vm.sh
30 create mode 100644 sql/swh-graph/dump-swh-graph.sql
31
32mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-indexer
33mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-indexer
34From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
35 b560a31..6371109 master -> origin/master
36 * [new tag] v0.0.18 -> v0.0.18
37 * [new tag] v0.0.19 -> v0.0.19
38 * [new tag] v0.0.20 -> v0.0.20
39 * [new tag] v0.0.21 -> v0.0.21
40 * [new tag] v0.0.22 -> v0.0.22
41 * [new tag] v0.0.23 -> v0.0.23
42 * [new tag] v0.0.24 -> v0.0.24
43 * [new tag] v0.0.25 -> v0.0.25
44 * [new tag] v0.0.26 -> v0.0.26
45 * [new tag] v0.0.27 -> v0.0.27
46 * [new tag] v0.0.28 -> v0.0.28
47Updating b560a31..6371109
48Fast-forward
49 swh/indexer/__init__.py | 4 +-
50 swh/indexer/ctags.py | 20 +++---
51 swh/indexer/fossology_license.py | 59 ++++++++++-------
52 swh/indexer/indexer.py | 85 +++++++++++++++++-------
53 swh/indexer/language.py | 61 ++++++++++++++----
54 swh/indexer/mimetype.py | 86 ++++++++++++-------------
55 swh/indexer/orchestrator.py | 136 ++++++++++++++++++++++++---------------
56 swh/indexer/producer.py | 34 +++++++---
57 swh/indexer/rehash.py | 82 +++++++++++++++++------
58 swh/indexer/tasks.py | 8 ++-
59 10 files changed, 374 insertions(+), 201 deletions(-)
60
61mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-core
62mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-core
63From ssh://forge.softwareheritage.org/diffusion/DCORE/swh-core
64 d5543ef..806f583 master -> origin/master
65 * [new tag] v0.0.32 -> v0.0.32
66 * [new tag] v0.0.30 -> v0.0.30
67 * [new tag] v0.0.31 -> v0.0.31
68Updating d5543ef..806f583
69Fast-forward
70 debian/control | 3 +-
71 requirements.txt | 1 +
72 swh/core/api.py | 56 ++++++++++++++++++-------
73 swh/core/api_async.py | 56 +++++++++++++++++++++++++
74 swh/core/logger.py | 110 +++++++++++++++++++++++++++++++++++++++++---------
75 5 files changed, 190 insertions(+), 36 deletions(-)
76 create mode 100644 swh/core/api_async.py
77
78mr checkout: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-lister
79mr checkout: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-lister
80Cloning into 'swh-lister'...
81
82mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-journal
83mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-journal
84Already up-to-date.
85
86mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-antelink
87mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-antelink
88Already up-to-date.
89
90mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-debian
91mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-debian
92Already up-to-date.
93
94mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-core
95mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-core
96From ssh://forge.softwareheritage.org/diffusion/60/swh-loader-core
97 e2c8bd8..f0fb67e master -> origin/master
98 * [new tag] v0.0.14 -> v0.0.14
99Updating e2c8bd8..f0fb67e
100Fast-forward
101 debian/control | 6 +++---
102 requirements-swh.txt | 4 ++--
103 swh/loader/core/converters.py | 4 +++-
104 swh/loader/core/tests/test_converters.py | 12 +++++++++++-
105 4 files changed, 19 insertions(+), 7 deletions(-)
106
107mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-git
108mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-git
109Already up-to-date.
110
111mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-dir
112mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-dir
113From ssh://forge.softwareheritage.org/diffusion/DLDDIR/swh-loader-dir
114 56b0a86..5b6b262 master -> origin/master
115 * [new tag] v0.0.25 -> v0.0.25
116Updating 56b0a86..5b6b262
117Fast-forward
118 debian/control | 10 +++++-----
119 requirements-swh.txt | 6 +++---
120 2 files changed, 8 insertions(+), 8 deletions(-)
121
122mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-mercurial
123mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-mercurial
124From ssh://forge.softwareheritage.org/source/swh-loader-mercurial
125 09caf66..dbd3c73 master -> origin/master
126Updating 09caf66..dbd3c73
127Fast-forward
128 swh/foo/bar.py | 4 -
129 swh/loader/mercurial/archive_extract.py | 45 ++++
130 swh/loader/mercurial/base.py | 457 ++++++++++++++++++++++++++++++++
131 swh/loader/mercurial/bundle_loader.py | 322 ++++++++++++++++++++++
132 swh/loader/mercurial/converters.py | 90 +++++++
133 swh/loader/mercurial/slow_loader.py | 416 +++++++++++++++++++++++++++++
134 6 files changed, 1330 insertions(+), 4 deletions(-)
135 delete mode 100644 swh/foo/bar.py
136 create mode 100644 swh/loader/mercurial/archive_extract.py
137 create mode 100644 swh/loader/mercurial/base.py
138 create mode 100644 swh/loader/mercurial/bundle_loader.py
139 create mode 100644 swh/loader/mercurial/converters.py
140 create mode 100644 swh/loader/mercurial/slow_loader.py
141
142mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-svn
143mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-svn
144From ssh://forge.softwareheritage.org/diffusion/DLDSVN/swh-loader-svn
145 04d7f15..6db09cb master -> origin/master
146Updating 04d7f15..6db09cb
147Fast-forward
148 debian/control | 12 ++++++------
149 requirements-swh.txt | 6 +++---
150 2 files changed, 9 insertions(+), 9 deletions(-)
151
152mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-tar
153mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-loader-tar
154From ssh://forge.softwareheritage.org/diffusion/DLDTAR/swh-loader-tar
155 a1a4ea2..86e4e26 master -> origin/master
156 * [new tag] v0.0.24 -> v0.0.24
157Updating a1a4ea2..86e4e26
158Fast-forward
159 debian/control | 10 +++++-----
160 requirements-swh.txt | 6 +++---
161 2 files changed, 8 insertions(+), 8 deletions(-)
162
163mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-mirror-forge
164mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-mirror-forge
165Already up-to-date.
166
167mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-model
168mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-model
169From ssh://forge.softwareheritage.org/diffusion/DMOD/swh-model
170 4d6d748..6f89adf master -> origin/master
171 * [new tag] v0.0.16 -> v0.0.16
172Updating 4d6d748..6f89adf
173Fast-forward
174 swh/model/git.py | 14 +++++++-------
175 1 file changed, 7 insertions(+), 7 deletions(-)
176
177mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-py-template
178mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-py-template
179Already up-to-date.
180
181mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-objstorage
182mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-objstorage
183From ssh://forge.softwareheritage.org/diffusion/DOBJS/swh-objstorage
184 d316d17..051a468 master -> origin/master
185 * [new tag] v0.0.18 -> v0.0.18
186Updating d316d17..051a468
187Fast-forward
188 requirements.txt | 3 +-
189 swh/objstorage/api/client.py | 20 +++-
190 swh/objstorage/api/server.py | 133 ++++++++++++---------
191 swh/objstorage/objstorage.py | 64 +++++++++-
192 swh/objstorage/objstorage_pathslicing.py | 33 ++++-
193 swh/objstorage/tests/objstorage_testing.py | 37 ++++++
194 swh/objstorage/tests/server_testing.py | 5 +-
195 swh/objstorage/tests/test_multiplexer_filter.py | 1 -
196 swh/objstorage/tests/test_objstorage_api.py | 4 +-
197 .../tests/test_objstorage_instantiation.py | 7 +-
198 10 files changed, 237 insertions(+), 70 deletions(-)
199
200mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-scheduler
201mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-scheduler
202From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
203 aaa5dfd..07ea766 master -> origin/master
204 * [new tag] v0.0.13 -> v0.0.13
205Updating aaa5dfd..07ea766
206Fast-forward
207 bin/swh-worker-control | 269 +++++++++++++++++++++++++++++++++
208 debian/control | 4 +-
209 debian/copyright | 1 -
210 requirements-swh.txt | 2 +-
211 setup.py | 2 +-
212 swh/scheduler/celery_backend/config.py | 31 ++--
213 6 files changed, 287 insertions(+), 22 deletions(-)
214 create mode 100755 bin/swh-worker-control
215
216mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-storage-testdata
217mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-storage-testdata
218From ssh://forge.softwareheritage.org/diffusion/DSTOT/swh-storage-testdata
219 36ae27d..10e1a68 master -> origin/master
220Updating 36ae27d..10e1a68
221Fast-forward
222 dumps/swh.dump | Bin 186008 -> 186026 bytes
223 dumps/swh.sql | 150 ++++++++++++++++++++++++++++++++++++---------------------
224 2 files changed, 95 insertions(+), 55 deletions(-)
225
226mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-web-ui
227mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-web-ui
228From ssh://forge.softwareheritage.org/diffusion/DWUI/swh-web-ui
229 67b1cf5..3471862 master -> origin/master
230 * [new tag] v0.0.82 -> v0.0.82
231Updating 67b1cf5..3471862
232Fast-forward
233 debian/control | 7 ++++---
234 requirements-swh.txt | 4 ++--
235 swh/web/ui/converters.py | 2 +-
236 swh/web/ui/main.py | 35 ++++++++++++++++++++++++++---------
237 swh/web/ui/tests/test_app.py | 10 ++++++++--
238 swh/web/ui/tests/test_converters.py | 7 ++++++-
239 6 files changed, 47 insertions(+), 18 deletions(-)
240
241mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-storage
242mr update: /home/temp-drydock/drydock/workingcopy-171/repo/swh-environment/swh-storage
243From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
244 76ed458..5ff3979 master -> origin/master
245 * [new tag] v0.0.83 -> v0.0.83
246Updating 76ed458..5ff3979
247Fast-forward
248 docs/vault-blueprint.md | 139 -------------
249 sql/swh-data.sql | 3 +
250 sql/swh-func.sql | 134 +++++-------
251 sql/swh-indexes.sql | 2 +-
252 sql/swh-schema.sql | 2 +-
253 sql/upgrades/105.sql | 31 +++
254 swh/storage/api/client.py | 3 +
255 swh/storage/api/server.py | 6 +
256 swh/storage/converters.py | 38 ++--
257 swh/storage/db.py | 48 +++--
258 swh/storage/storage.py | 61 +++---
259 swh/storage/tests/server_testing.py | 107 ++++++++--
260 swh/storage/tests/test_archiver.py | 8 +-
261 swh/storage/tests/test_converters.py | 55 ++++-
262 swh/storage/tests/test_storage.py | 321 ++++++++++++++++-------------
263 swh/storage/vault/api/client.py | 27 ---
264 swh/storage/vault/api/cooking_tasks.py | 27 ---
265 swh/storage/vault/api/server.py | 98 ---------
266 swh/storage/vault/cache.py | 53 -----
267 swh/storage/vault/conf.yaml | 0
268 swh/storage/vault/cookers/__init__.py | 14 --
269 swh/storage/vault/cookers/base.py | 221 --------------------
270 swh/storage/vault/cookers/directory.py | 24 ---
271 swh/storage/vault/cookers/revision_flat.py | 33 ---
272 swh/storage/vault/cookers/revision_git.py | 204 ------------------
273 25 files changed, 508 insertions(+), 1151 deletions(-)
274 delete mode 100644 docs/vault-blueprint.md
275 create mode 100644 sql/upgrades/105.sql
276 delete mode 100644 swh/storage/vault/api/client.py
277 delete mode 100644 swh/storage/vault/api/cooking_tasks.py
278 delete mode 100644 swh/storage/vault/api/server.py
279 delete mode 100644 swh/storage/vault/cache.py
280 delete mode 100644 swh/storage/vault/conf.yaml
281 delete mode 100644 swh/storage/vault/cookers/__init__.py
282 delete mode 100644 swh/storage/vault/cookers/base.py
283 delete mode 100644 swh/storage/vault/cookers/directory.py
284 delete mode 100644 swh/storage/vault/cookers/revision_flat.py
285 delete mode 100644 swh/storage/vault/cookers/revision_git.py
286
287mr update: finished (23 ok)
288

Clone on Software Heritage Worker

When
Completed at Jun 1 2017, 4:56 PM · Built instantly
Status
Passed

Event Timeline

About · Developer information · Legal