Page MenuHomeSoftware Heritage
Harbormaster B873 Build 1168

Build 1168
Public
Actions

Properties

Buildable
B873: rDSTO7738a768f63c: swh.storage: indexer endpoints: Fix filtering missing data issue
Build Plan
Plan 2 Software Heritage Python tests
Status
Failed

Lint

When
Completed at Jun 1 2017, 4:58 PM · Built for 1 s
Status
Failed

Build Log 3927 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1/usr/bin/python3: No module named flake8
2make: *** [check] Error 1
3

Build Log 3926 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1python3 -m flake8 swh bin/swh-storage-add-dir
2../Makefile.python:25: recipe for target 'check' failed
3

Python tests

When
Completed at Jun 1 2017, 4:58 PM · Built for 11 s
Status
Failed
1 empty logs are hidden. Show all logs.

Build Log 3925 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1W: unknown repository 'swh-environment', you might want to remove it
2W: unknown repository 'swh-lister-github', you might want to remove it
3W: unknown repository 'swh-lister-bitbucket', you might want to remove it
4Failure: ImportError (No module named 'aiohttp') ... ERROR
5Failure: ImportError (No module named 'aiohttp') ... ERROR
6Failure: ImportError (No module named 'aiohttp') ... ERROR
7ctags_to_db (test_converters.TestConverters) ... ok
8db_to_author (test_converters.TestConverters) ... ok
9db_to_ctags (test_converters.TestConverters) ... ok
10db_to_git_headers (test_converters.TestConverters) ... ok
11db_to_language (test_converters.TestConverters) ... ok
12db_to_mimetype (test_converters.TestConverters) ... ok
13db_to_release (test_converters.TestConverters) ... ok
14db_to_revision (test_converters.TestConverters) ... ok
15
16======================================================================
17ERROR: Failure: ImportError (No module named 'aiohttp')
18----------------------------------------------------------------------
19Traceback (most recent call last):
20 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
21 raise self.exc_val.with_traceback(self.tb)
22 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
23 addr.filename, addr.module)
24 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
25 return self.importFromDir(dir_path, fqname)
26 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
27 mod = load_module(part_fqname, fh, filename, desc)
28 File "/usr/lib/python3.4/imp.py", line 235, in load_module
29 return load_source(name, filename, file)
30 File "/usr/lib/python3.4/imp.py", line 171, in load_source
31 module = methods.load()
32 File "<frozen importlib._bootstrap>", line 1220, in load
33 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
34 File "<frozen importlib._bootstrap>", line 1129, in _exec
35 File "<frozen importlib._bootstrap>", line 1471, in exec_module
36 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
37 File "/home/temp-drydock/drydock/workingcopy-175/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
38 import aiohttp
39ImportError: No module named 'aiohttp'
40
41======================================================================
42ERROR: Failure: ImportError (No module named 'aiohttp')
43----------------------------------------------------------------------
44Traceback (most recent call last):
45 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
46 raise self.exc_val.with_traceback(self.tb)
47 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
48 addr.filename, addr.module)
49 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
50 return self.importFromDir(dir_path, fqname)
51 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
52 mod = load_module(part_fqname, fh, filename, desc)
53 File "/usr/lib/python3.4/imp.py", line 235, in load_module
54 return load_source(name, filename, file)
55 File "/usr/lib/python3.4/imp.py", line 171, in load_source
56 module = methods.load()
57 File "<frozen importlib._bootstrap>", line 1220, in load
58 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
59 File "<frozen importlib._bootstrap>", line 1129, in _exec
60 File "<frozen importlib._bootstrap>", line 1471, in exec_module
61 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
62 File "/home/temp-drydock/drydock/workingcopy-175/repo/swh-storage/swh/storage/tests/test_api_client.py", line 10, in <module>
63 from swh.storage.tests.server_testing import ServerTestFixture
64 File "/home/temp-drydock/drydock/workingcopy-175/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
65 import aiohttp
66ImportError: No module named 'aiohttp'
67
68======================================================================
69ERROR: Failure: ImportError (No module named 'aiohttp')
70----------------------------------------------------------------------
71Traceback (most recent call last):
72 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
73 raise self.exc_val.with_traceback(self.tb)
74 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
75 addr.filename, addr.module)
76 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
77 return self.importFromDir(dir_path, fqname)
78 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
79 mod = load_module(part_fqname, fh, filename, desc)
80 File "/usr/lib/python3.4/imp.py", line 235, in load_module
81 return load_source(name, filename, file)
82 File "/usr/lib/python3.4/imp.py", line 171, in load_source
83 module = methods.load()
84 File "<frozen importlib._bootstrap>", line 1220, in load
85 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
86 File "<frozen importlib._bootstrap>", line 1129, in _exec
87 File "<frozen importlib._bootstrap>", line 1471, in exec_module
88 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
89 File "/home/temp-drydock/drydock/workingcopy-175/repo/swh-storage/swh/storage/tests/test_archiver.py", line 19, in <module>
90 from server_testing import ServerTestFixtureAsync
91 File "/home/temp-drydock/drydock/workingcopy-175/repo/swh-storage/swh/storage/tests/server_testing.py", line 7, in <module>
92 import aiohttp
93ImportError: No module named 'aiohttp'
94
95----------------------------------------------------------------------
96Ran 11 tests in 3.295s
97
98FAILED (errors=3)
99

Update environment from working copy

When
Completed at Jun 1 2017, 4:58 PM · Built for 39 s
Status
Passed

Build Log 3917 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: command failed
2mr update: command failed
3mr update: command failed
4mr update: command failed
5

Build Log 3916 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/snippets
2mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/snippets
3From ssh://forge.softwareheritage.org/diffusion/59/code-snippets
4 10ee1e1..49ffa63 master -> origin/master
5Updating 10ee1e1..49ffa63
6Fast-forward
7 ardumont/graph_bar.py | 47 +++++++++++++++++++++++++++++++++++++++++++
8 ardumont/read_from_archive.py | 34 +++++++++++++++++++++++++++++++
9 ardumont/send-batch-sha1s.sh | 30 +++++++++++++++++++++++++++
10 olasd/azure/provision-vm.sh | 18 +++++------------
11 4 files changed, 116 insertions(+), 13 deletions(-)
12 create mode 100755 ardumont/graph_bar.py
13 create mode 100755 ardumont/read_from_archive.py
14 create mode 100755 ardumont/send-batch-sha1s.sh
15
16mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-cloner-git
17mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-cloner-git
18Already up-to-date.
19
20mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-core
21mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-core
22Already up-to-date.
23
24mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-fetcher-googlecode
25mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-fetcher-googlecode
26Already up-to-date.
27
28mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-indexer
29mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-indexer
30From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
31 71dac8f..6371109 master -> origin/master
32 * [new tag] v0.0.25 -> v0.0.25
33 * [new tag] v0.0.26 -> v0.0.26
34 * [new tag] v0.0.27 -> v0.0.27
35 * [new tag] v0.0.28 -> v0.0.28
36Updating 71dac8f..6371109
37Fast-forward
38 swh/indexer/__init__.py | 4 +-
39 swh/indexer/ctags.py | 20 +++---
40 swh/indexer/fossology_license.py | 59 ++++++++++-------
41 swh/indexer/indexer.py | 85 +++++++++++++++++-------
42 swh/indexer/language.py | 61 ++++++++++++++----
43 swh/indexer/mimetype.py | 13 ++--
44 swh/indexer/orchestrator.py | 136 ++++++++++++++++++++++++---------------
45 swh/indexer/rehash.py | 44 +++++++------
46 swh/indexer/tasks.py | 2 +-
47 9 files changed, 268 insertions(+), 156 deletions(-)
48
49mr checkout: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-lister
50mr checkout: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-lister
51Cloning into 'swh-lister'...
52
53mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-antelink
54mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-antelink
55Already up-to-date.
56
57mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-journal
58mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-journal
59Already up-to-date.
60
61mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-core
62mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-core
63Already up-to-date.
64
65mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-debian
66mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-debian
67Already up-to-date.
68
69mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-dir
70mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-dir
71ssh_exchange_identification: Connection closed by remote host
72fatal: Could not read from remote repository.
73
74Please make sure you have the correct access rights
75and the repository exists.
76
77mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-svn
78mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-svn
79ssh_exchange_identification: Connection closed by remote host
80fatal: Could not read from remote repository.
81
82Please make sure you have the correct access rights
83and the repository exists.
84
85mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-mercurial
86mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-mercurial
87ssh_exchange_identification: Connection closed by remote host
88fatal: Could not read from remote repository.
89
90Please make sure you have the correct access rights
91and the repository exists.
92
93mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-objstorage
94mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-objstorage
95Already up-to-date.
96
97mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-git
98mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-git
99Already up-to-date.
100
101mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-tar
102mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-tar
103Already up-to-date.
104
105mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-model
106mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-model
107Already up-to-date.
108
109mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-mirror-forge
110mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-mirror-forge
111Already up-to-date.
112
113mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage-testdata
114mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage-testdata
115ssh_exchange_identification: Connection closed by remote host
116fatal: Could not read from remote repository.
117
118Please make sure you have the correct access rights
119and the repository exists.
120
121mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-py-template
122mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-py-template
123Already up-to-date.
124
125mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-scheduler
126mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-scheduler
127From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
128 f758291..07ea766 master -> origin/master
129Updating f758291..07ea766
130Fast-forward
131 bin/swh-worker-control | 269 +++++++++++++++++++++++++++++++++
132 setup.py | 2 +-
133 swh/scheduler/celery_backend/config.py | 9 ++
134 3 files changed, 279 insertions(+), 1 deletion(-)
135 create mode 100755 bin/swh-worker-control
136
137mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-web-ui
138mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-web-ui
139From ssh://forge.softwareheritage.org/diffusion/DWUI/swh-web-ui
140 06d1446..3471862 master -> origin/master
141Updating 06d1446..3471862
142Fast-forward
143 swh/web/ui/main.py | 35 ++++++++++++++++++++++++++---------
144 swh/web/ui/tests/test_app.py | 10 ++++++++--
145 2 files changed, 34 insertions(+), 11 deletions(-)
146
147mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage
148mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage
149From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
150 55495ec..5ff3979 master -> origin/master
151Updating 55495ec..5ff3979
152Fast-forward
153 sql/swh-data.sql | 3 +
154 sql/swh-func.sql | 134 ++++++---------
155 sql/swh-indexes.sql | 2 +-
156 sql/swh-schema.sql | 2 +-
157 sql/upgrades/105.sql | 31 ++++
158 swh/storage/api/client.py | 3 +
159 swh/storage/api/server.py | 6 +
160 swh/storage/converters.py | 38 +++--
161 swh/storage/db.py | 48 ++++--
162 swh/storage/storage.py | 61 ++++---
163 swh/storage/tests/server_testing.py | 107 +++++++++---
164 swh/storage/tests/test_archiver.py | 8 +-
165 swh/storage/tests/test_converters.py | 55 ++++--
166 swh/storage/tests/test_storage.py | 321 +++++++++++++++++++----------------
167 14 files changed, 508 insertions(+), 311 deletions(-)
168 create mode 100644 sql/upgrades/105.sql
169
170mr update: finished (19 ok; 4 failed)
171

Clone on Software Heritage Worker

When
Completed at Jun 1 2017, 4:58 PM · Built instantly
Status
Passed

Event Timeline

About · Developer information · Legal