Page MenuHomeSoftware Heritage
Harbormaster B868 Build 1163

Build 1163
Public
Actions

Properties

Buildable
B868: rDSTOb4dfe06f9f06: swh.storage.archiver: Fix tests
Build Plan
Plan 2 Software Heritage Python tests
Status
Failed

Lint

When
Completed at Jun 1 2017, 10:57 AM · Built for 1 s
Status
Failed

Build Log 3891 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1/usr/bin/python3: No module named flake8
2make: *** [check] Error 1
3

Build Log 3890 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1python3 -m flake8 swh bin/swh-storage-add-dir
2../Makefile.python:25: recipe for target 'check' failed
3

Python tests

When
Completed at Jun 1 2017, 10:57 AM · Built for 10 s
Status
Failed
1 empty logs are hidden. Show all logs.

Build Log 3889 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1W: unknown repository 'swh-environment', you might want to remove it
2W: unknown repository 'swh-lister-github', you might want to remove it
3W: unknown repository 'swh-lister-bitbucket', you might want to remove it
4Failure: ImportError (No module named 'aiohttp') ... ERROR
5Failure: ImportError (No module named 'aiohttp') ... ERROR
6Failure: ImportError (No module named 'aiohttp') ... ERROR
7ctags_to_db (test_converters.TestConverters) ... ok
8db_to_author (test_converters.TestConverters) ... ok
9db_to_ctags (test_converters.TestConverters) ... ok
10db_to_git_headers (test_converters.TestConverters) ... ok
11db_to_language (test_converters.TestConverters) ... ok
12db_to_mimetype (test_converters.TestConverters) ... ok
13db_to_release (test_converters.TestConverters) ... ok
14db_to_revision (test_converters.TestConverters) ... ok
15
16======================================================================
17ERROR: Failure: ImportError (No module named 'aiohttp')
18----------------------------------------------------------------------
19Traceback (most recent call last):
20 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
21 raise self.exc_val.with_traceback(self.tb)
22 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
23 addr.filename, addr.module)
24 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
25 return self.importFromDir(dir_path, fqname)
26 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
27 mod = load_module(part_fqname, fh, filename, desc)
28 File "/usr/lib/python3.4/imp.py", line 235, in load_module
29 return load_source(name, filename, file)
30 File "/usr/lib/python3.4/imp.py", line 171, in load_source
31 module = methods.load()
32 File "<frozen importlib._bootstrap>", line 1220, in load
33 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
34 File "<frozen importlib._bootstrap>", line 1129, in _exec
35 File "<frozen importlib._bootstrap>", line 1471, in exec_module
36 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
37 File "/home/temp-drydock/drydock/workingcopy-177/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
38 import aiohttp
39ImportError: No module named 'aiohttp'
40
41======================================================================
42ERROR: Failure: ImportError (No module named 'aiohttp')
43----------------------------------------------------------------------
44Traceback (most recent call last):
45 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
46 raise self.exc_val.with_traceback(self.tb)
47 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
48 addr.filename, addr.module)
49 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
50 return self.importFromDir(dir_path, fqname)
51 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
52 mod = load_module(part_fqname, fh, filename, desc)
53 File "/usr/lib/python3.4/imp.py", line 235, in load_module
54 return load_source(name, filename, file)
55 File "/usr/lib/python3.4/imp.py", line 171, in load_source
56 module = methods.load()
57 File "<frozen importlib._bootstrap>", line 1220, in load
58 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
59 File "<frozen importlib._bootstrap>", line 1129, in _exec
60 File "<frozen importlib._bootstrap>", line 1471, in exec_module
61 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
62 File "/home/temp-drydock/drydock/workingcopy-177/repo/swh-storage/swh/storage/tests/test_api_client.py", line 10, in <module>
63 from swh.storage.tests.server_testing import ServerTestFixture
64 File "/home/temp-drydock/drydock/workingcopy-177/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
65 import aiohttp
66ImportError: No module named 'aiohttp'
67
68======================================================================
69ERROR: Failure: ImportError (No module named 'aiohttp')
70----------------------------------------------------------------------
71Traceback (most recent call last):
72 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
73 raise self.exc_val.with_traceback(self.tb)
74 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
75 addr.filename, addr.module)
76 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
77 return self.importFromDir(dir_path, fqname)
78 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
79 mod = load_module(part_fqname, fh, filename, desc)
80 File "/usr/lib/python3.4/imp.py", line 235, in load_module
81 return load_source(name, filename, file)
82 File "/usr/lib/python3.4/imp.py", line 171, in load_source
83 module = methods.load()
84 File "<frozen importlib._bootstrap>", line 1220, in load
85 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
86 File "<frozen importlib._bootstrap>", line 1129, in _exec
87 File "<frozen importlib._bootstrap>", line 1471, in exec_module
88 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
89 File "/home/temp-drydock/drydock/workingcopy-177/repo/swh-storage/swh/storage/tests/test_archiver.py", line 19, in <module>
90 from server_testing import ServerTestFixtureAsync
91 File "/home/temp-drydock/drydock/workingcopy-177/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
92 import aiohttp
93ImportError: No module named 'aiohttp'
94
95----------------------------------------------------------------------
96Ran 11 tests in 3.959s
97
98FAILED (errors=3)
99

Update environment from working copy

When
Completed at Jun 1 2017, 10:57 AM · Built for 22 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 3886 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-cloner-git
2mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-cloner-git
3Already up-to-date.
4
5mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-fetcher-googlecode
6mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-fetcher-googlecode
7Already up-to-date.
8
9mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-core
10mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-core
11From ssh://forge.softwareheritage.org/diffusion/DCORE/swh-core
12 d5543ef..806f583 master -> origin/master
13 * [new tag] v0.0.32 -> v0.0.32
14 * [new tag] v0.0.30 -> v0.0.30
15 * [new tag] v0.0.31 -> v0.0.31
16Updating d5543ef..806f583
17Fast-forward
18 debian/control | 3 +-
19 requirements.txt | 1 +
20 swh/core/api.py | 56 ++++++++++++++++++-------
21 swh/core/api_async.py | 56 +++++++++++++++++++++++++
22 swh/core/logger.py | 110 +++++++++++++++++++++++++++++++++++++++++---------
23 5 files changed, 190 insertions(+), 36 deletions(-)
24 create mode 100644 swh/core/api_async.py
25
26mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/snippets
27mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/snippets
28From ssh://forge.softwareheritage.org/diffusion/59/code-snippets
29 2a47cb7..49ffa63 master -> origin/master
30Updating 2a47cb7..49ffa63
31Fast-forward
32 ardumont/dispatch.py | 34 ++++++++++++
33 ardumont/graph_bar.py | 47 ++++++++++++++++
34 ardumont/read_from_archive.py | 34 ++++++++++++
35 ardumont/send-batch-sha1s.sh | 30 +++++++++++
36 olasd/azure/create-vm.sh | 14 +++--
37 olasd/azure/provision-vm.sh | 57 +++++++++++++-------
38 sql/swh-graph/dump-swh-graph.sql | 7 +++
39 sql/swh-graph/swh-graph.out | 114 +++++++++------------------------------
40 8 files changed, 222 insertions(+), 115 deletions(-)
41 create mode 100755 ardumont/dispatch.py
42 create mode 100755 ardumont/graph_bar.py
43 create mode 100755 ardumont/read_from_archive.py
44 create mode 100755 ardumont/send-batch-sha1s.sh
45 mode change 100644 => 100755 olasd/azure/create-vm.sh
46 mode change 100644 => 100755 olasd/azure/provision-vm.sh
47 create mode 100644 sql/swh-graph/dump-swh-graph.sql
48
49mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-indexer
50mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-indexer
51From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
52 b560a31..12561fa master -> origin/master
53 * [new tag] v0.0.28 -> v0.0.28
54 * [new tag] v0.0.18 -> v0.0.18
55 * [new tag] v0.0.19 -> v0.0.19
56 * [new tag] v0.0.20 -> v0.0.20
57 * [new tag] v0.0.21 -> v0.0.21
58 * [new tag] v0.0.22 -> v0.0.22
59 * [new tag] v0.0.23 -> v0.0.23
60 * [new tag] v0.0.24 -> v0.0.24
61 * [new tag] v0.0.25 -> v0.0.25
62 * [new tag] v0.0.26 -> v0.0.26
63 * [new tag] v0.0.27 -> v0.0.27
64Updating b560a31..12561fa
65Fast-forward
66 swh/indexer/__init__.py | 4 +-
67 swh/indexer/fossology_license.py | 43 ++++++++-----
68 swh/indexer/indexer.py | 66 ++++++++++++-------
69 swh/indexer/language.py | 34 ++++++++--
70 swh/indexer/mimetype.py | 73 ++++++++++-----------
71 swh/indexer/orchestrator.py | 136 ++++++++++++++++++++++++---------------
72 swh/indexer/producer.py | 34 +++++++---
73 swh/indexer/rehash.py | 82 +++++++++++++++++------
74 swh/indexer/tasks.py | 8 ++-
75 9 files changed, 318 insertions(+), 162 deletions(-)
76
77mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-lister
78mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-lister
79Cloning into 'swh-lister'...
80
81mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-journal
82mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-journal
83Already up-to-date.
84
85mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-antelink
86mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-antelink
87Already up-to-date.
88
89mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-debian
90mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-debian
91Already up-to-date.
92
93mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-core
94mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-core
95From ssh://forge.softwareheritage.org/diffusion/60/swh-loader-core
96 e2c8bd8..f0fb67e master -> origin/master
97 * [new tag] v0.0.14 -> v0.0.14
98Updating e2c8bd8..f0fb67e
99Fast-forward
100 debian/control | 6 +++---
101 requirements-swh.txt | 4 ++--
102 swh/loader/core/converters.py | 4 +++-
103 swh/loader/core/tests/test_converters.py | 12 +++++++++++-
104 4 files changed, 19 insertions(+), 7 deletions(-)
105
106mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-dir
107mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-dir
108From ssh://forge.softwareheritage.org/diffusion/DLDDIR/swh-loader-dir
109 * [new tag] v0.0.25 -> v0.0.25
110Already up-to-date.
111
112mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-git
113mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-git
114Already up-to-date.
115
116mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-mercurial
117mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-mercurial
118From ssh://forge.softwareheritage.org/source/swh-loader-mercurial
119 09caf66..dbd3c73 master -> origin/master
120Updating 09caf66..dbd3c73
121Fast-forward
122 swh/foo/bar.py | 4 -
123 swh/loader/mercurial/archive_extract.py | 45 ++++
124 swh/loader/mercurial/base.py | 457 ++++++++++++++++++++++++++++++++
125 swh/loader/mercurial/bundle_loader.py | 322 ++++++++++++++++++++++
126 swh/loader/mercurial/converters.py | 90 +++++++
127 swh/loader/mercurial/slow_loader.py | 416 +++++++++++++++++++++++++++++
128 6 files changed, 1330 insertions(+), 4 deletions(-)
129 delete mode 100644 swh/foo/bar.py
130 create mode 100644 swh/loader/mercurial/archive_extract.py
131 create mode 100644 swh/loader/mercurial/base.py
132 create mode 100644 swh/loader/mercurial/bundle_loader.py
133 create mode 100644 swh/loader/mercurial/converters.py
134 create mode 100644 swh/loader/mercurial/slow_loader.py
135
136mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-tar
137mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-tar
138From ssh://forge.softwareheritage.org/diffusion/DLDTAR/swh-loader-tar
139 * [new tag] v0.0.24 -> v0.0.24
140Already up-to-date.
141
142mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-svn
143mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-svn
144From ssh://forge.softwareheritage.org/diffusion/DLDSVN/swh-loader-svn
145 04d7f15..6db09cb master -> origin/master
146Updating 04d7f15..6db09cb
147Fast-forward
148 debian/control | 12 ++++++------
149 requirements-swh.txt | 6 +++---
150 2 files changed, 9 insertions(+), 9 deletions(-)
151
152mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-mirror-forge
153mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-mirror-forge
154Already up-to-date.
155
156mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-model
157mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-model
158From ssh://forge.softwareheritage.org/diffusion/DMOD/swh-model
159 4d6d748..6f89adf master -> origin/master
160 * [new tag] v0.0.16 -> v0.0.16
161Updating 4d6d748..6f89adf
162Fast-forward
163 swh/model/git.py | 14 +++++++-------
164 1 file changed, 7 insertions(+), 7 deletions(-)
165
166mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-objstorage
167mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-objstorage
168From ssh://forge.softwareheritage.org/diffusion/DOBJS/swh-objstorage
169 d316d17..051a468 master -> origin/master
170 * [new tag] v0.0.18 -> v0.0.18
171Updating d316d17..051a468
172Fast-forward
173 requirements.txt | 3 +-
174 swh/objstorage/api/client.py | 20 +++-
175 swh/objstorage/api/server.py | 133 ++++++++++++---------
176 swh/objstorage/objstorage.py | 64 +++++++++-
177 swh/objstorage/objstorage_pathslicing.py | 33 ++++-
178 swh/objstorage/tests/objstorage_testing.py | 37 ++++++
179 swh/objstorage/tests/server_testing.py | 5 +-
180 swh/objstorage/tests/test_multiplexer_filter.py | 1 -
181 swh/objstorage/tests/test_objstorage_api.py | 4 +-
182 .../tests/test_objstorage_instantiation.py | 7 +-
183 10 files changed, 237 insertions(+), 70 deletions(-)
184
185mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-py-template
186mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-py-template
187Already up-to-date.
188
189mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-scheduler
190mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-scheduler
191From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
192 aaa5dfd..07ea766 master -> origin/master
193 * [new tag] v0.0.13 -> v0.0.13
194Updating aaa5dfd..07ea766
195Fast-forward
196 bin/swh-worker-control | 269 +++++++++++++++++++++++++++++++++
197 debian/control | 4 +-
198 debian/copyright | 1 -
199 requirements-swh.txt | 2 +-
200 setup.py | 2 +-
201 swh/scheduler/celery_backend/config.py | 31 ++--
202 6 files changed, 287 insertions(+), 22 deletions(-)
203 create mode 100755 bin/swh-worker-control
204
205mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage-testdata
206mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage-testdata
207From ssh://forge.softwareheritage.org/diffusion/DSTOT/swh-storage-testdata
208 36ae27d..10e1a68 master -> origin/master
209Updating 36ae27d..10e1a68
210Fast-forward
211 dumps/swh.dump | Bin 186008 -> 186026 bytes
212 dumps/swh.sql | 150 ++++++++++++++++++++++++++++++++++++---------------------
213 2 files changed, 95 insertions(+), 55 deletions(-)
214
215mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage
216mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage
217From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
218 76ed458..b4dfe06 master -> origin/master
219 * [new tag] v0.0.83 -> v0.0.83
220Updating 76ed458..b4dfe06
221Fast-forward
222 docs/vault-blueprint.md | 139 ------------------
223 sql/swh-func.sql | 6 +-
224 sql/swh-schema.sql | 2 +-
225 sql/upgrades/105.sql | 31 ++++
226 swh/storage/api/client.py | 3 +
227 swh/storage/api/server.py | 6 +
228 swh/storage/db.py | 19 +++
229 swh/storage/storage.py | 14 ++
230 swh/storage/tests/server_testing.py | 107 +++++++++++---
231 swh/storage/tests/test_archiver.py | 8 +-
232 swh/storage/tests/test_storage.py | 27 ++++
233 swh/storage/vault/api/client.py | 27 ----
234 swh/storage/vault/api/cooking_tasks.py | 27 ----
235 swh/storage/vault/api/server.py | 98 -------------
236 swh/storage/vault/cache.py | 53 -------
237 swh/storage/vault/conf.yaml | 0
238 swh/storage/vault/cookers/__init__.py | 14 --
239 swh/storage/vault/cookers/base.py | 221 -----------------------------
240 swh/storage/vault/cookers/directory.py | 24 ----
241 swh/storage/vault/cookers/revision_flat.py | 33 -----
242 swh/storage/vault/cookers/revision_git.py | 204 --------------------------
243 21 files changed, 194 insertions(+), 869 deletions(-)
244 delete mode 100644 docs/vault-blueprint.md
245 create mode 100644 sql/upgrades/105.sql
246 delete mode 100644 swh/storage/vault/api/client.py
247 delete mode 100644 swh/storage/vault/api/cooking_tasks.py
248 delete mode 100644 swh/storage/vault/api/server.py
249 delete mode 100644 swh/storage/vault/cache.py
250 delete mode 100644 swh/storage/vault/conf.yaml
251 delete mode 100644 swh/storage/vault/cookers/__init__.py
252 delete mode 100644 swh/storage/vault/cookers/base.py
253 delete mode 100644 swh/storage/vault/cookers/directory.py
254 delete mode 100644 swh/storage/vault/cookers/revision_flat.py
255 delete mode 100644 swh/storage/vault/cookers/revision_git.py
256
257mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-web-ui
258mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-web-ui
259From ssh://forge.softwareheritage.org/diffusion/DWUI/swh-web-ui
260 67b1cf5..3471862 master -> origin/master
261 * [new tag] v0.0.82 -> v0.0.82
262Updating 67b1cf5..3471862
263Fast-forward
264 debian/control | 7 ++++---
265 requirements-swh.txt | 4 ++--
266 swh/web/ui/converters.py | 2 +-
267 swh/web/ui/main.py | 35 ++++++++++++++++++++++++++---------
268 swh/web/ui/tests/test_app.py | 10 ++++++++--
269 swh/web/ui/tests/test_converters.py | 7 ++++++-
270 6 files changed, 47 insertions(+), 18 deletions(-)
271
272mr update: finished (23 ok)
273

Clone on Software Heritage Worker

When
Completed at Jun 1 2017, 10:56 AM · Built instantly
Status
Passed

Event Timeline

About · Developer information · Legal