Page MenuHomeSoftware Heritage

Build 1167

Lint

When
Completed at Jun 1 2017, 4:57 PM · Built for 1 s
Status
Failed

Build Log 3907 (remote - stderr)
25 - 50 - 100 - Unlimited Lines

1/usr/bin/python3: No module named flake8
2make: *** [check] Error 1
3

Build Log 3906 (remote - stdout)
25 - 50 - 100 - Unlimited Lines

1python3 -m flake8 swh bin/swh-storage-add-dir
2../Makefile.python:25: recipe for target 'check' failed
3

Python tests

When
Completed at Jun 1 2017, 4:58 PM · Built for 14 s
Status
Failed
1 empty logs are hidden. Show all logs.

Build Log 3905 (remote - stderr)
25 - 50 - 100 - Unlimited Lines

1W: unknown repository 'swh-environment', you might want to remove it
2W: unknown repository 'swh-lister-github', you might want to remove it
3W: unknown repository 'swh-lister-bitbucket', you might want to remove it
4Failure: ImportError (No module named 'aiohttp') ... ERROR
5Failure: ImportError (No module named 'aiohttp') ... ERROR
6Failure: ImportError (No module named 'aiohttp') ... ERROR
7ctags_to_db (test_converters.TestConverters) ... ok
8db_to_author (test_converters.TestConverters) ... ok
9db_to_ctags (test_converters.TestConverters) ... ok
10db_to_git_headers (test_converters.TestConverters) ... ok
11db_to_language (test_converters.TestConverters) ... ok
12db_to_mimetype (test_converters.TestConverters) ... ok
13db_to_release (test_converters.TestConverters) ... ok
14db_to_revision (test_converters.TestConverters) ... ok
15
16======================================================================
17ERROR: Failure: ImportError (No module named 'aiohttp')
18----------------------------------------------------------------------
19Traceback (most recent call last):
20 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
21 raise self.exc_val.with_traceback(self.tb)
22 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
23 addr.filename, addr.module)
24 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
25 return self.importFromDir(dir_path, fqname)
26 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
27 mod = load_module(part_fqname, fh, filename, desc)
28 File "/usr/lib/python3.4/imp.py", line 235, in load_module
29 return load_source(name, filename, file)
30 File "/usr/lib/python3.4/imp.py", line 171, in load_source
31 module = methods.load()
32 File "<frozen importlib._bootstrap>", line 1220, in load
33 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
34 File "<frozen importlib._bootstrap>", line 1129, in _exec
35 File "<frozen importlib._bootstrap>", line 1471, in exec_module
36 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
37 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
38 import aiohttp
39ImportError: No module named 'aiohttp'
40
41======================================================================
42ERROR: Failure: ImportError (No module named 'aiohttp')
43----------------------------------------------------------------------
44Traceback (most recent call last):
45 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
46 raise self.exc_val.with_traceback(self.tb)
47 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
48 addr.filename, addr.module)
49 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
50 return self.importFromDir(dir_path, fqname)
51 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
52 mod = load_module(part_fqname, fh, filename, desc)
53 File "/usr/lib/python3.4/imp.py", line 235, in load_module
54 return load_source(name, filename, file)
55 File "/usr/lib/python3.4/imp.py", line 171, in load_source
56 module = methods.load()
57 File "<frozen importlib._bootstrap>", line 1220, in load
58 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
59 File "<frozen importlib._bootstrap>", line 1129, in _exec
60 File "<frozen importlib._bootstrap>", line 1471, in exec_module
61 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
62 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/tests/test_api_client.py", line 10, in <module>
63 from swh.storage.tests.server_testing import ServerTestFixture
64 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
65 import aiohttp
66ImportError: No module named 'aiohttp'
67
68======================================================================
69ERROR: Failure: ImportError (No module named 'aiohttp')
70----------------------------------------------------------------------
71Traceback (most recent call last):
72 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
73 raise self.exc_val.with_traceback(self.tb)
74 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
75 addr.filename, addr.module)
76 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
77 return self.importFromDir(dir_path, fqname)
78 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
79 mod = load_module(part_fqname, fh, filename, desc)
80 File "/usr/lib/python3.4/imp.py", line 235, in load_module
81 return load_source(name, filename, file)
82 File "/usr/lib/python3.4/imp.py", line 171, in load_source
83 module = methods.load()
84 File "<frozen importlib._bootstrap>", line 1220, in load
85 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
86 File "<frozen importlib._bootstrap>", line 1129, in _exec
87 File "<frozen importlib._bootstrap>", line 1471, in exec_module
88 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
89 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/tests/test_archiver.py", line 19, in <module>
90 from server_testing import ServerTestFixtureAsync
91 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
92 import aiohttp
93ImportError: No module named 'aiohttp'
94
95----------------------------------------------------------------------
96Ran 11 tests in 5.415s
97
98FAILED (errors=3)
99

Update environment from working copy

When
Completed at Jun 1 2017, 4:57 PM · Built for 54 s
Status
Passed

Build Log 3899 (remote - stderr)
25 - 50 - 100 - Unlimited Lines

1mr update: command failed
2

Build Log 3898 (remote - stdout)
25 - 50 - 100 - Unlimited Lines

1mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-cloner-git
2mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-cloner-git
3ssh_exchange_identification: Connection closed by remote host
4fatal: Could not read from remote repository.
5
6Please make sure you have the correct access rights
7and the repository exists.
8
9mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-fetcher-googlecode
10mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-fetcher-googlecode
11Already up-to-date.
12
13mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-journal
14mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-journal
15Already up-to-date.
16
17mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/snippets
18mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/snippets
19From ssh://forge.softwareheritage.org/diffusion/59/code-snippets
20 2a47cb7..49ffa63 master -> origin/master
21Updating 2a47cb7..49ffa63
22Fast-forward
23 ardumont/dispatch.py | 34 ++++++++++++
24 ardumont/graph_bar.py | 47 ++++++++++++++++
25 ardumont/read_from_archive.py | 34 ++++++++++++
26 ardumont/send-batch-sha1s.sh | 30 +++++++++++
27 olasd/azure/create-vm.sh | 14 +++--
28 olasd/azure/provision-vm.sh | 57 +++++++++++++-------
29 sql/swh-graph/dump-swh-graph.sql | 7 +++
30 sql/swh-graph/swh-graph.out | 114 +++++++++------------------------------
31 8 files changed, 222 insertions(+), 115 deletions(-)
32 create mode 100755 ardumont/dispatch.py
33 create mode 100755 ardumont/graph_bar.py
34 create mode 100755 ardumont/read_from_archive.py
35 create mode 100755 ardumont/send-batch-sha1s.sh
36 mode change 100644 => 100755 olasd/azure/create-vm.sh
37 mode change 100644 => 100755 olasd/azure/provision-vm.sh
38 create mode 100644 sql/swh-graph/dump-swh-graph.sql
39
40mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-indexer
41mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-indexer
42From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
43 b560a31..6371109 master -> origin/master
44 * [new tag] v0.0.18 -> v0.0.18
45 * [new tag] v0.0.19 -> v0.0.19
46 * [new tag] v0.0.20 -> v0.0.20
47 * [new tag] v0.0.21 -> v0.0.21
48 * [new tag] v0.0.22 -> v0.0.22
49 * [new tag] v0.0.23 -> v0.0.23
50 * [new tag] v0.0.24 -> v0.0.24
51 * [new tag] v0.0.25 -> v0.0.25
52 * [new tag] v0.0.26 -> v0.0.26
53 * [new tag] v0.0.27 -> v0.0.27
54 * [new tag] v0.0.28 -> v0.0.28
55Updating b560a31..6371109
56Fast-forward
57 swh/indexer/__init__.py | 4 +-
58 swh/indexer/ctags.py | 20 +++---
59 swh/indexer/fossology_license.py | 59 ++++++++++-------
60 swh/indexer/indexer.py | 85 +++++++++++++++++-------
61 swh/indexer/language.py | 61 ++++++++++++++----
62 swh/indexer/mimetype.py | 86 ++++++++++++-------------
63 swh/indexer/orchestrator.py | 136 ++++++++++++++++++++++++---------------
64 swh/indexer/producer.py | 34 +++++++---
65 swh/indexer/rehash.py | 82 +++++++++++++++++------
66 swh/indexer/tasks.py | 8 ++-
67 10 files changed, 374 insertions(+), 201 deletions(-)
68
69mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-core
70mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-core
71From ssh://forge.softwareheritage.org/diffusion/DCORE/swh-core
72 d5543ef..806f583 master -> origin/master
73 * [new tag] v0.0.32 -> v0.0.32
74 * [new tag] v0.0.30 -> v0.0.30
75 * [new tag] v0.0.31 -> v0.0.31
76Updating d5543ef..806f583
77Fast-forward
78 debian/control | 3 +-
79 requirements.txt | 1 +
80 swh/core/api.py | 56 ++++++++++++++++++-------
81 swh/core/api_async.py | 56 +++++++++++++++++++++++++
82 swh/core/logger.py | 110 +++++++++++++++++++++++++++++++++++++++++---------
83 5 files changed, 190 insertions(+), 36 deletions(-)
84 create mode 100644 swh/core/api_async.py
85
86mr checkout: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-lister
87mr checkout: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-lister
88Cloning into 'swh-lister'...
89
90mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-antelink
91mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-antelink
92Already up-to-date.
93
94mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-debian
95mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-debian
96Already up-to-date.
97
98mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-dir
99mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-dir
100From ssh://forge.softwareheritage.org/diffusion/DLDDIR/swh-loader-dir
101 56b0a86..5b6b262 master -> origin/master
102 * [new tag] v0.0.25 -> v0.0.25
103Updating 56b0a86..5b6b262
104Fast-forward
105 debian/control | 10 +++++-----
106 requirements-swh.txt | 6 +++---
107 2 files changed, 8 insertions(+), 8 deletions(-)
108
109mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-core
110mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-core
111From ssh://forge.softwareheritage.org/diffusion/60/swh-loader-core
112 * [new tag] v0.0.14 -> v0.0.14
113Already up-to-date.
114
115mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-mercurial
116mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-mercurial
117From ssh://forge.softwareheritage.org/source/swh-loader-mercurial
118 09caf66..dbd3c73 master -> origin/master
119Updating 09caf66..dbd3c73
120Fast-forward
121 swh/foo/bar.py | 4 -
122 swh/loader/mercurial/archive_extract.py | 45 ++++
123 swh/loader/mercurial/base.py | 457 ++++++++++++++++++++++++++++++++
124 swh/loader/mercurial/bundle_loader.py | 322 ++++++++++++++++++++++
125 swh/loader/mercurial/converters.py | 90 +++++++
126 swh/loader/mercurial/slow_loader.py | 416 +++++++++++++++++++++++++++++
127 6 files changed, 1330 insertions(+), 4 deletions(-)
128 delete mode 100644 swh/foo/bar.py
129 create mode 100644 swh/loader/mercurial/archive_extract.py
130 create mode 100644 swh/loader/mercurial/base.py
131 create mode 100644 swh/loader/mercurial/bundle_loader.py
132 create mode 100644 swh/loader/mercurial/converters.py
133 create mode 100644 swh/loader/mercurial/slow_loader.py
134
135mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-git
136mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-git
137From ssh://forge.softwareheritage.org/diffusion/DLDG/swh-loader-git
138 a582b76..4d98e01 master -> origin/master
139Updating a582b76..4d98e01
140Fast-forward
141 debian/control | 8 ++++----
142 requirements-swh.txt | 4 ++--
143 swh/loader/git/converters.py | 2 +-
144 swh/loader/git/tests/test_converters.py | 9 ++++++---
145 4 files changed, 13 insertions(+), 10 deletions(-)
146
147mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-tar
148mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-tar
149From ssh://forge.softwareheritage.org/diffusion/DLDTAR/swh-loader-tar
150 a1a4ea2..86e4e26 master -> origin/master
151 * [new tag] v0.0.24 -> v0.0.24
152Updating a1a4ea2..86e4e26
153Fast-forward
154 debian/control | 10 +++++-----
155 requirements-swh.txt | 6 +++---
156 2 files changed, 8 insertions(+), 8 deletions(-)
157
158mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-mirror-forge
159mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-mirror-forge
160Already up-to-date.
161
162mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-svn
163mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-svn
164From ssh://forge.softwareheritage.org/diffusion/DLDSVN/swh-loader-svn
165 04d7f15..6db09cb master -> origin/master
166Updating 04d7f15..6db09cb
167Fast-forward
168 debian/control | 12 ++++++------
169 requirements-swh.txt | 6 +++---
170 2 files changed, 9 insertions(+), 9 deletions(-)
171
172mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-model
173mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-model
174From ssh://forge.softwareheritage.org/diffusion/DMOD/swh-model
175 4d6d748..6f89adf master -> origin/master
176 * [new tag] v0.0.16 -> v0.0.16
177Updating 4d6d748..6f89adf
178Fast-forward
179 swh/model/git.py | 14 +++++++-------
180 1 file changed, 7 insertions(+), 7 deletions(-)
181
182mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-py-template
183mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-py-template
184Already up-to-date.
185
186mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-scheduler
187mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-scheduler
188From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
189 aaa5dfd..07ea766 master -> origin/master
190 * [new tag] v0.0.13 -> v0.0.13
191Updating aaa5dfd..07ea766
192Fast-forward
193 bin/swh-worker-control | 269 +++++++++++++++++++++++++++++++++
194 debian/control | 4 +-
195 debian/copyright | 1 -
196 requirements-swh.txt | 2 +-
197 setup.py | 2 +-
198 swh/scheduler/celery_backend/config.py | 31 ++--
199 6 files changed, 287 insertions(+), 22 deletions(-)
200 create mode 100755 bin/swh-worker-control
201
202mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-objstorage
203mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-objstorage
204From ssh://forge.softwareheritage.org/diffusion/DOBJS/swh-objstorage
205 d316d17..051a468 master -> origin/master
206 * [new tag] v0.0.18 -> v0.0.18
207Updating d316d17..051a468
208Fast-forward
209 requirements.txt | 3 +-
210 swh/objstorage/api/client.py | 20 +++-
211 swh/objstorage/api/server.py | 133 ++++++++++++---------
212 swh/objstorage/objstorage.py | 64 +++++++++-
213 swh/objstorage/objstorage_pathslicing.py | 33 ++++-
214 swh/objstorage/tests/objstorage_testing.py | 37 ++++++
215 swh/objstorage/tests/server_testing.py | 5 +-
216 swh/objstorage/tests/test_multiplexer_filter.py | 1 -
217 swh/objstorage/tests/test_objstorage_api.py | 4 +-
218 .../tests/test_objstorage_instantiation.py | 7 +-
219 10 files changed, 237 insertions(+), 70 deletions(-)
220
221mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage-testdata
222mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage-testdata
223From ssh://forge.softwareheritage.org/diffusion/DSTOT/swh-storage-testdata
224 36ae27d..10e1a68 master -> origin/master
225Updating 36ae27d..10e1a68
226Fast-forward
227 dumps/swh.dump | Bin 186008 -> 186026 bytes
228 dumps/swh.sql | 150 ++++++++++++++++++++++++++++++++++++---------------------
229 2 files changed, 95 insertions(+), 55 deletions(-)
230
231mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage
232mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage
233From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
234 76ed458..5ff3979 master -> origin/master
235 * [new tag] v0.0.83 -> v0.0.83
236Updating 76ed458..5ff3979
237Fast-forward
238 docs/vault-blueprint.md | 139 -------------
239 sql/swh-data.sql | 3 +
240 sql/swh-func.sql | 134 +++++-------
241 sql/swh-indexes.sql | 2 +-
242 sql/swh-schema.sql | 2 +-
243 sql/upgrades/105.sql | 31 +++
244 swh/storage/api/client.py | 3 +
245 swh/storage/api/server.py | 6 +
246 swh/storage/converters.py | 38 ++--
247 swh/storage/db.py | 48 +++--
248 swh/storage/storage.py | 61 +++---
249 swh/storage/tests/server_testing.py | 107 ++++++++--
250 swh/storage/tests/test_archiver.py | 8 +-
251 swh/storage/tests/test_converters.py | 55 ++++-
252 swh/storage/tests/test_storage.py | 321 ++++++++++++++++-------------
253 swh/storage/vault/api/client.py | 27 ---
254 swh/storage/vault/api/cooking_tasks.py | 27 ---
255 swh/storage/vault/api/server.py | 98 ---------
256 swh/storage/vault/cache.py | 53 -----
257 swh/storage/vault/conf.yaml | 0
258 swh/storage/vault/cookers/__init__.py | 14 --
259 swh/storage/vault/cookers/base.py | 221 --------------------
260 swh/storage/vault/cookers/directory.py | 24 ---
261 swh/storage/vault/cookers/revision_flat.py | 33 ---
262 swh/storage/vault/cookers/revision_git.py | 204 ------------------
263 25 files changed, 508 insertions(+), 1151 deletions(-)
264 delete mode 100644 docs/vault-blueprint.md
265 create mode 100644 sql/upgrades/105.sql
266 delete mode 100644 swh/storage/vault/api/client.py
267 delete mode 100644 swh/storage/vault/api/cooking_tasks.py
268 delete mode 100644 swh/storage/vault/api/server.py
269 delete mode 100644 swh/storage/vault/cache.py
270 delete mode 100644 swh/storage/vault/conf.yaml
271 delete mode 100644 swh/storage/vault/cookers/__init__.py
272 delete mode 100644 swh/storage/vault/cookers/base.py
273 delete mode 100644 swh/storage/vault/cookers/directory.py
274 delete mode 100644 swh/storage/vault/cookers/revision_flat.py
275 delete mode 100644 swh/storage/vault/cookers/revision_git.py
276
277mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-web-ui
278mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-web-ui
279From ssh://forge.softwareheritage.org/diffusion/DWUI/swh-web-ui
280 67b1cf5..3471862 master -> origin/master
281 * [new tag] v0.0.82 -> v0.0.82
282Updating 67b1cf5..3471862
283Fast-forward
284 debian/control | 7 ++++---
285 requirements-swh.txt | 4 ++--
286 swh/web/ui/converters.py | 2 +-
287 swh/web/ui/main.py | 35 ++++++++++++++++++++++++++---------
288 swh/web/ui/tests/test_app.py | 10 ++++++++--
289 swh/web/ui/tests/test_converters.py | 7 ++++++-
290 6 files changed, 47 insertions(+), 18 deletions(-)
291
292mr update: finished (22 ok; 1 failed)
293

Clone on Software Heritage Worker

When
Completed at Jun 1 2017, 4:56 PM · Built instantly
Status
Passed

Event Timeline