Page MenuHomeSoftware Heritage
Harbormaster B988 Build 1307

Build 1307
Public
Actions

Properties

Buildable
B988: rDSTOe14e72d6e4bb: sql: add origin_visit to swh_stat_counters()
Build Plan
Plan 2 Software Heritage Python tests
Status
Passed

Lint

When
Completed at Sep 4 2017, 8:17 PM · Built for 4 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 4323 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1python3 -m flake8 swh bin/swh-storage-add-dir
2

Python tests

When
Completed at Sep 4 2017, 8:17 PM · Built for 3 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 4322 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1./pythonpath.sh: line 7: local: can only be used in a function
2./pythonpath.sh: line 11: local: can only be used in a function
3W: unknown repository 'swh-loader-antelink', you might want to remove it
4W: unknown repository 'swh-cloner-git', you might want to remove it
5W: unknown repository 'swh-environment', you might want to remove it
6W: unknown repository 'swh-lister-github', you might want to remove it
7W: unknown repository 'swh-web-ui', you might want to remove it
8W: unknown repository 'swh-lister-bitbucket', you might want to remove it
9W: unknown repository 'swh-fetcher-googlecode', you might want to remove it
10ctags_to_db (test_converters.TestConverters) ... ok
11db_to_author (test_converters.TestConverters) ... ok
12db_to_ctags (test_converters.TestConverters) ... ok
13db_to_fossology_license (test_converters.TestConverters) ... ok
14db_to_git_headers (test_converters.TestConverters) ... ok
15db_to_language (test_converters.TestConverters) ... ok
16db_to_metadata (test_converters.TestConverters) ... ok
17db_to_mimetype (test_converters.TestConverters) ... ok
18db_to_release (test_converters.TestConverters) ... ok
19db_to_revision (test_converters.TestConverters) ... ok
20
21----------------------------------------------------------------------
22Ran 10 tests in 1.386s
23
24OK
25

Update environment from working copy

When
Completed at Sep 4 2017, 8:17 PM · Built for 21 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 4319 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/snippets
2mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/snippets
3Already up-to-date.
4
5mr checkout: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-docs
6mr checkout: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-docs
7Cloning into 'swh-docs'...
8
9mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-archiver
10mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-archiver
11From ssh://forge.softwareheritage.org/source/swh-archiver
12 2432048..a5a2212 master -> origin/master
13Updating 2432048..a5a2212
14Fast-forward
15 docs/.gitignore | 3 +++
16 docs/Makefile | 1 +
17 docs/_static/.placeholder | 0
18 docs/_templates/.placeholder | 0
19 docs/conf.py | 1 +
20 docs/index.rst | 15 +++++++++++++++
21 6 files changed, 20 insertions(+)
22 create mode 100644 docs/.gitignore
23 create mode 100644 docs/Makefile
24 create mode 100644 docs/_static/.placeholder
25 create mode 100644 docs/_templates/.placeholder
26 create mode 100644 docs/conf.py
27 create mode 100644 docs/index.rst
28
29mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-core
30mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-core
31From ssh://forge.softwareheritage.org/diffusion/DCORE/swh-core
32 9a69edb..4752c7c master -> origin/master
33 * [new tag] v0.0.34 -> v0.0.34
34Updating 9a69edb..4752c7c
35Fast-forward
36 docs/.gitignore | 3 +++
37 docs/Makefile | 1 +
38 docs/_static/.placeholder | 0
39 docs/_templates/.placeholder | 0
40 docs/conf.py | 1 +
41 docs/index.rst | 15 +++++++++++++++
42 swh/core/tests/db_testing.py | 18 ++++++++++++++++++
43 7 files changed, 38 insertions(+)
44 create mode 100644 docs/.gitignore
45 create mode 100644 docs/Makefile
46 create mode 100644 docs/_static/.placeholder
47 create mode 100644 docs/_templates/.placeholder
48 create mode 100644 docs/conf.py
49 create mode 100644 docs/index.rst
50
51mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-indexer
52mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-indexer
53From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
54 6880d8e..7175b3c master -> origin/master
55Updating 6880d8e..7175b3c
56Fast-forward
57 README | 29 +++--
58 docs/.gitignore | 3 +
59 docs/Makefile | 1 +
60 docs/_static/.placeholder | 0
61 docs/_templates/.placeholder | 0
62 docs/conf.py | 1 +
63 docs/index.rst | 15 +++
64 swh/indexer/ctags.py | 8 +-
65 swh/indexer/fossology_license.py | 8 +-
66 swh/indexer/indexer.py | 119 ++++++++++++++----
67 swh/indexer/language.py | 8 +-
68 swh/indexer/metadata.py | 239 +++++++++++++++++++++++++++++++++----
69 swh/indexer/metadata_detector.py | 73 +++++++++++
70 swh/indexer/mimetype.py | 8 +-
71 swh/indexer/orchestrator.py | 12 +-
72 swh/indexer/tests/test_metadata.py | 136 +++++++++++++++++----
73 swh/indexer/tests/test_utils.py | 139 ++++++++++++++++++++-
74 17 files changed, 706 insertions(+), 93 deletions(-)
75 create mode 100644 docs/.gitignore
76 create mode 100644 docs/Makefile
77 create mode 100644 docs/_static/.placeholder
78 create mode 100644 docs/_templates/.placeholder
79 create mode 100644 docs/conf.py
80 create mode 100644 docs/index.rst
81 create mode 100644 swh/indexer/metadata_detector.py
82
83mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-journal
84mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-journal
85From ssh://forge.softwareheritage.org/diffusion/DJNL/swh-journal
86 1358fa4..2a215cc master -> origin/master
87Updating 1358fa4..2a215cc
88Fast-forward
89 docs/.gitignore | 3 +++
90 docs/Makefile | 1 +
91 docs/_static/.placeholder | 0
92 docs/_templates/.placeholder | 0
93 docs/conf.py | 1 +
94 docs/index.rst | 15 +++++++++++++++
95 6 files changed, 20 insertions(+)
96 create mode 100644 docs/.gitignore
97 create mode 100644 docs/Makefile
98 create mode 100644 docs/_static/.placeholder
99 create mode 100644 docs/_templates/.placeholder
100 create mode 100644 docs/conf.py
101 create mode 100644 docs/index.rst
102
103mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-lister
104mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-lister
105From ssh://forge.softwareheritage.org/source/swh-lister
106 b6bdab7..4b56b60 master -> origin/master
107Updating b6bdab7..4b56b60
108Fast-forward
109 docs/.gitignore | 3 +++
110 docs/Makefile | 1 +
111 docs/_static/.placeholder | 0
112 docs/_templates/.placeholder | 0
113 docs/conf.py | 1 +
114 docs/index.rst | 15 +++++++++++++++
115 swh/lister/core/lister_base.py | 30 +++++++++++++++++-------------
116 swh/lister/core/lister_transports.py | 3 ++-
117 swh/lister/github/lister.py | 3 ++-
118 swh/lister/github/models.py | 3 ++-
119 swh/lister/github/tasks.py | 2 +-
120 11 files changed, 44 insertions(+), 17 deletions(-)
121 create mode 100644 docs/.gitignore
122 create mode 100644 docs/Makefile
123 create mode 100644 docs/_static/.placeholder
124 create mode 100644 docs/_templates/.placeholder
125 create mode 100644 docs/conf.py
126 create mode 100644 docs/index.rst
127
128mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-core
129mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-core
130From ssh://forge.softwareheritage.org/diffusion/60/swh-loader-core
131 f0fb67e..a32347d master -> origin/master
132Updating f0fb67e..a32347d
133Fast-forward
134 docs/.gitignore | 3 +++
135 docs/Makefile | 1 +
136 docs/_static/.placeholder | 0
137 docs/_templates/.placeholder | 0
138 docs/conf.py | 1 +
139 docs/index.rst | 15 +++++++++++++++
140 6 files changed, 20 insertions(+)
141 create mode 100644 docs/.gitignore
142 create mode 100644 docs/Makefile
143 create mode 100644 docs/_static/.placeholder
144 create mode 100644 docs/_templates/.placeholder
145 create mode 100644 docs/conf.py
146 create mode 100644 docs/index.rst
147
148mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-debian
149mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-debian
150From ssh://forge.softwareheritage.org/diffusion/DLDDEB/swh-loader-debian
151 2bc0a6e..c251199 master -> origin/master
152Updating 2bc0a6e..c251199
153Fast-forward
154 docs/.gitignore | 3 +++
155 docs/Makefile | 1 +
156 docs/_static/.placeholder | 0
157 docs/_templates/.placeholder | 0
158 docs/conf.py | 1 +
159 docs/index.rst | 15 +++++++++++++++
160 6 files changed, 20 insertions(+)
161 create mode 100644 docs/.gitignore
162 create mode 100644 docs/Makefile
163 create mode 100644 docs/_static/.placeholder
164 create mode 100644 docs/_templates/.placeholder
165 create mode 100644 docs/conf.py
166 create mode 100644 docs/index.rst
167
168mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-dir
169mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-dir
170From ssh://forge.softwareheritage.org/diffusion/DLDDIR/swh-loader-dir
171 badc8d3..7cf31af master -> origin/master
172Updating badc8d3..7cf31af
173Fast-forward
174 docs/.gitignore | 3 +++
175 docs/Makefile | 1 +
176 docs/_static/.placeholder | 0
177 docs/_templates/.placeholder | 0
178 docs/conf.py | 1 +
179 docs/index.rst | 15 +++++++++++++++
180 6 files changed, 20 insertions(+)
181 create mode 100644 docs/.gitignore
182 create mode 100644 docs/Makefile
183 create mode 100644 docs/_static/.placeholder
184 create mode 100644 docs/_templates/.placeholder
185 create mode 100644 docs/conf.py
186 create mode 100644 docs/index.rst
187
188mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-mercurial
189mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-mercurial
190From ssh://forge.softwareheritage.org/source/swh-loader-mercurial
191 6cc321b..4541a7b master -> origin/master
192Updating 6cc321b..4541a7b
193Fast-forward
194 docs/.gitignore | 3 +++
195 docs/Makefile | 1 +
196 docs/_static/.placeholder | 0
197 docs/_templates/.placeholder | 0
198 docs/conf.py | 1 +
199 docs/index.rst | 15 +++++++++++++++
200 6 files changed, 20 insertions(+)
201 create mode 100644 docs/.gitignore
202 create mode 100644 docs/Makefile
203 create mode 100644 docs/_static/.placeholder
204 create mode 100644 docs/_templates/.placeholder
205 create mode 100644 docs/conf.py
206 create mode 100644 docs/index.rst
207
208mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-git
209mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-git
210From ssh://forge.softwareheritage.org/diffusion/DLDG/swh-loader-git
211 af7b3c4..fe6dd9c master -> origin/master
212 * [new branch] bulk-git-loader -> origin/bulk-git-loader
213Updating af7b3c4..fe6dd9c
214Fast-forward
215 docs/.gitignore | 3 +++
216 docs/Makefile | 1 +
217 docs/_static/.placeholder | 0
218 docs/_templates/.placeholder | 0
219 docs/conf.py | 1 +
220 docs/index.rst | 15 +++++++++++++++
221 6 files changed, 20 insertions(+)
222 create mode 100644 docs/.gitignore
223 create mode 100644 docs/Makefile
224 create mode 100644 docs/_static/.placeholder
225 create mode 100644 docs/_templates/.placeholder
226 create mode 100644 docs/conf.py
227 create mode 100644 docs/index.rst
228
229mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-svn
230mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-svn
231From ssh://forge.softwareheritage.org/diffusion/DLDSVN/swh-loader-svn
232 54045a6..f368c0c master -> origin/master
233Updating 54045a6..f368c0c
234Fast-forward
235 docs/.gitignore | 3 +++
236 docs/Makefile | 1 +
237 docs/_static/.placeholder | 0
238 docs/_templates/.placeholder | 0
239 docs/conf.py | 1 +
240 docs/index.rst | 15 +++++++++++++++
241 6 files changed, 20 insertions(+)
242 create mode 100644 docs/.gitignore
243 create mode 100644 docs/Makefile
244 create mode 100644 docs/_static/.placeholder
245 create mode 100644 docs/_templates/.placeholder
246 create mode 100644 docs/conf.py
247 create mode 100644 docs/index.rst
248
249mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-tar
250mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-loader-tar
251From ssh://forge.softwareheritage.org/diffusion/DLDTAR/swh-loader-tar
252 beaccc8..c0936b1 master -> origin/master
253Updating beaccc8..c0936b1
254Fast-forward
255 docs/.gitignore | 3 +++
256 docs/Makefile | 1 +
257 docs/_static/.placeholder | 0
258 docs/_templates/.placeholder | 0
259 docs/conf.py | 1 +
260 docs/index.rst | 15 +++++++++++++++
261 6 files changed, 20 insertions(+)
262 create mode 100644 docs/.gitignore
263 create mode 100644 docs/Makefile
264 create mode 100644 docs/_static/.placeholder
265 create mode 100644 docs/_templates/.placeholder
266 create mode 100644 docs/conf.py
267 create mode 100644 docs/index.rst
268
269mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-mirror-forge
270mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-mirror-forge
271From ssh://forge.softwareheritage.org/source/swh-mirror-forge
272 665fa92..dc8f1de master -> origin/master
273Updating 665fa92..dc8f1de
274Fast-forward
275 docs/.gitignore | 3 +++
276 docs/Makefile | 1 +
277 docs/_static/.placeholder | 0
278 docs/_templates/.placeholder | 0
279 docs/conf.py | 1 +
280 docs/index.rst | 15 +++++++++++++++
281 6 files changed, 20 insertions(+)
282 create mode 100644 docs/.gitignore
283 create mode 100644 docs/Makefile
284 create mode 100644 docs/_static/.placeholder
285 create mode 100644 docs/_templates/.placeholder
286 create mode 100644 docs/conf.py
287 create mode 100644 docs/index.rst
288
289mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-model
290mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-model
291From ssh://forge.softwareheritage.org/diffusion/DMOD/swh-model
292 8aa5c3a..b53f5d8 master -> origin/master
293Updating 8aa5c3a..b53f5d8
294Fast-forward
295 docs/.gitignore | 3 +++
296 docs/Makefile | 1 +
297 docs/_static/.placeholder | 0
298 docs/_templates/.placeholder | 0
299 docs/conf.py | 1 +
300 docs/index.rst | 15 +++++++++++++++
301 6 files changed, 20 insertions(+)
302 create mode 100644 docs/.gitignore
303 create mode 100644 docs/Makefile
304 create mode 100644 docs/_static/.placeholder
305 create mode 100644 docs/_templates/.placeholder
306 create mode 100644 docs/conf.py
307 create mode 100644 docs/index.rst
308
309mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-py-template
310mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-py-template
311From ssh://forge.softwareheritage.org/diffusion/DTPL/swh-py-template
312 f09909b..8089353 master -> origin/master
313Updating f09909b..8089353
314Fast-forward
315 docs/.gitignore | 3 +++
316 docs/Makefile | 1 +
317 docs/_static/.placeholder | 0
318 docs/_templates/.placeholder | 0
319 docs/conf.py | 1 +
320 docs/index.rst | 15 +++++++++++++++
321 6 files changed, 20 insertions(+)
322 create mode 100644 docs/.gitignore
323 create mode 100644 docs/Makefile
324 create mode 100644 docs/_static/.placeholder
325 create mode 100644 docs/_templates/.placeholder
326 create mode 100644 docs/conf.py
327 create mode 100644 docs/index.rst
328
329mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-objstorage
330mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-objstorage
331From ssh://forge.softwareheritage.org/diffusion/DOBJS/swh-objstorage
332 7e0ba66..4d61b35 master -> origin/master
333Updating 7e0ba66..4d61b35
334Fast-forward
335 docs/.gitignore | 3 +++
336 docs/Makefile | 1 +
337 docs/_static/.placeholder | 0
338 docs/_templates/.placeholder | 0
339 docs/conf.py | 1 +
340 docs/index.rst | 15 +++++++++++++++
341 6 files changed, 20 insertions(+)
342 create mode 100644 docs/.gitignore
343 create mode 100644 docs/Makefile
344 create mode 100644 docs/_static/.placeholder
345 create mode 100644 docs/_templates/.placeholder
346 create mode 100644 docs/conf.py
347 create mode 100644 docs/index.rst
348
349mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-scheduler
350mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-scheduler
351From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
352 3194c2b..ca0230d master -> origin/master
353 * [new tag] v0.0.16 -> v0.0.16
354Updating 3194c2b..ca0230d
355Fast-forward
356 debian/control | 4 +-
357 docs/.gitignore | 3 +
358 docs/Makefile | 1 +
359 docs/_static/.placeholder | 0
360 docs/_templates/.placeholder | 0
361 docs/conf.py | 1 +
362 docs/index.rst | 15 ++++
363 requirements-swh.txt | 2 +-
364 sql/swh-scheduler-schema.sql | 13 +--
365 sql/updates/05.sql | 144 ++++++++++++++++++++++++++++++++++
366 swh/scheduler/tests/test_scheduler.py | 2 +
367 11 files changed, 176 insertions(+), 9 deletions(-)
368 create mode 100644 docs/.gitignore
369 create mode 100644 docs/Makefile
370 create mode 100644 docs/_static/.placeholder
371 create mode 100644 docs/_templates/.placeholder
372 create mode 100644 docs/conf.py
373 create mode 100644 docs/index.rst
374 create mode 100644 sql/updates/05.sql
375
376mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage-testdata
377mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage-testdata
378Already up-to-date.
379
380mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-vault
381mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-vault
382From ssh://forge.softwareheritage.org/diffusion/DVAU/swh-vault
383 6f4441b..f190b6a master -> origin/master
384Updating 6f4441b..f190b6a
385Fast-forward
386 docs/.gitignore | 3 +++
387 docs/Makefile | 1 +
388 docs/_static/.placeholder | 0
389 docs/_templates/.placeholder | 0
390 docs/conf.py | 1 +
391 docs/index.rst | 15 +++++++++++++++
392 6 files changed, 20 insertions(+)
393 create mode 100644 docs/.gitignore
394 create mode 100644 docs/Makefile
395 create mode 100644 docs/_static/.placeholder
396 create mode 100644 docs/_templates/.placeholder
397 create mode 100644 docs/conf.py
398 create mode 100644 docs/index.rst
399
400mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage
401mr update: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-storage
402From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
403 806f511..e14e72d master -> origin/master
404Updating 806f511..e14e72d
405Fast-forward
406 docs/.gitignore | 3 +
407 docs/Makefile | 1 +
408 docs/_static/.placeholder | 0
409 docs/_templates/.placeholder | 0
410 docs/conf.py | 1 +
411 docs/index.rst | 15 +
412 .../revision_metadata.translated_metadata.json | 59 ++++
413 sql/swh-data.sql | 3 +
414 sql/swh-func.sql | 176 +++++++++--
415 sql/swh-indexes.sql | 17 +-
416 sql/swh-schema.sql | 23 +-
417 sql/upgrades/108.sql | 58 ++++
418 sql/upgrades/109.sql | 33 ++
419 swh/storage/api/client.py | 12 +
420 swh/storage/api/server.py | 18 ++
421 swh/storage/db.py | 29 ++
422 swh/storage/storage.py | 51 +++
423 swh/storage/tests/storage_testing.py | 17 +-
424 swh/storage/tests/test_storage.py | 347 ++++++++++++++++++---
425 19 files changed, 775 insertions(+), 88 deletions(-)
426 create mode 100644 docs/.gitignore
427 create mode 100644 docs/Makefile
428 create mode 100644 docs/_static/.placeholder
429 create mode 100644 docs/_templates/.placeholder
430 create mode 100644 docs/conf.py
431 create mode 100644 docs/index.rst
432 create mode 100644 sql/json/revision_metadata.translated_metadata.json
433 create mode 100644 sql/upgrades/108.sql
434 create mode 100644 sql/upgrades/109.sql
435
436mr checkout: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-web
437mr checkout: /home/temp-drydock/drydock/workingcopy-175/repo/swh-environment/swh-web
438Cloning into 'swh-web'...
439
440mr update: finished (23 ok)
441

Clone on Software Heritage Worker

When
Completed at Sep 4 2017, 8:17 PM · Built instantly
Status
Passed

Event Timeline

About · Developer information · Legal