Page MenuHomeSoftware Heritage

Build 1382

Lint

When
Completed at Oct 12 2017, 7:52 PM · Built for 7 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 4539 (remote - stdout)
25 - 50 - 100 - Unlimited Lines

1python3 -m flake8 swh bin/swh-storage-add-dir
2

Python tests

When
Completed at Oct 12 2017, 7:52 PM · Built for 5 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 4538 (remote - stderr)
25 - 50 - 100 - Unlimited Lines

1W: unknown repository 'swh-loader-antelink', you might want to remove it
2W: unknown repository 'swh-cloner-git', you might want to remove it
3W: unknown repository 'swh-environment', you might want to remove it
4W: unknown repository 'swh-lister-github', you might want to remove it
5W: unknown repository 'swh-web-ui', you might want to remove it
6W: unknown repository 'swh-lister-bitbucket', you might want to remove it
7W: unknown repository 'swh-fetcher-googlecode', you might want to remove it
8ctags_to_db (test_converters.TestConverters) ... ok
9db_to_author (test_converters.TestConverters) ... ok
10db_to_ctags (test_converters.TestConverters) ... ok
11db_to_fossology_license (test_converters.TestConverters) ... ok
12db_to_git_headers (test_converters.TestConverters) ... ok
13db_to_language (test_converters.TestConverters) ... ok
14db_to_metadata (test_converters.TestConverters) ... ok
15db_to_mimetype (test_converters.TestConverters) ... ok
16db_to_release (test_converters.TestConverters) ... ok
17db_to_revision (test_converters.TestConverters) ... ok
18
19----------------------------------------------------------------------
20Ran 10 tests in 3.048s
21
22OK
23

Update environment from working copy

When
Completed at Oct 12 2017, 7:52 PM · Built for 35 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 4535 (remote - stdout)
25 - 50 - 100 - Unlimited Lines

1mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-docs
2mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-docs
3Cloning into 'swh-docs'...
4
5mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-deposit
6mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-deposit
7Cloning into 'swh-deposit'...
8
9mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-archiver
10mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-archiver
11From ssh://forge.softwareheritage.org/source/swh-archiver
12 b2bc403..39dd7db master -> origin/master
13 * [new tag] v0.0.2 -> v0.0.2
14Updating b2bc403..39dd7db
15Fast-forward
16 debian/control | 2 +-
17 debian/rules | 11 +++++------
18 docs/.gitignore | 3 +++
19 docs/Makefile | 1 +
20 docs/_static/.placeholder | 0
21 docs/_templates/.placeholder | 0
22 docs/conf.py | 1 +
23 docs/index.rst | 15 +++++++++++++++
24 requirements.txt | 1 +
25 setup.py | 7 ++-----
26 swh/__init__.py | 1 +
27 swh/archiver/db.py | 3 ++-
28 swh/archiver/director.py | 2 ++
29 swh/archiver/tests/__init__.py | 0
30 swh/archiver/tests/test_archiver.py | 20 +++++---------------
31 swh/archiver/worker.py | 12 +++++++-----
32 16 files changed, 46 insertions(+), 33 deletions(-)
33 create mode 100644 docs/.gitignore
34 create mode 100644 docs/Makefile
35 create mode 100644 docs/_static/.placeholder
36 create mode 100644 docs/_templates/.placeholder
37 create mode 100644 docs/conf.py
38 create mode 100644 docs/index.rst
39 create mode 100644 swh/__init__.py
40 create mode 100644 swh/archiver/tests/__init__.py
41
42mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/snippets
43mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/snippets
44From ssh://forge.softwareheritage.org/diffusion/59/code-snippets
45 6719bb0..c026ae0 master -> origin/master
46Updating 6719bb0..c026ae0
47Fast-forward
48 ardumont/group_by_exception.py | 95 ++++++++++++++++++++
49 ardumont/kibana_fetch_logs.py | 176 ++++++++++++++++++++++++++++++++++++++
50 ardumont/list-origin-per-error.py | 27 ++++++
51 ardumont/reschedule_errors.py | 90 +++++++++++++++++++
52 4 files changed, 388 insertions(+)
53 create mode 100755 ardumont/group_by_exception.py
54 create mode 100755 ardumont/kibana_fetch_logs.py
55 create mode 100755 ardumont/list-origin-per-error.py
56 create mode 100755 ardumont/reschedule_errors.py
57
58mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-core
59mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-core
60From ssh://forge.softwareheritage.org/diffusion/DCORE/swh-core
61 cb1e915..0dab089 master -> origin/master
62 * [new tag] v0.0.35 -> v0.0.35
63 * [new tag] v0.0.34 -> v0.0.34
64Updating cb1e915..0dab089
65Fast-forward
66 debian/control | 3 +-
67 debian/rules | 11 +--
68 docs/.gitignore | 3 +
69 docs/Makefile | 1 +
70 docs/_static/.placeholder | 0
71 docs/_templates/.placeholder | 0
72 docs/conf.py | 1 +
73 docs/index.rst | 15 +++
74 setup.py | 4 +-
75 swh/__init__.py | 1 +
76 swh/core/config.py | 21 +++--
77 swh/core/logger.py | 4 +-
78 swh/core/serializers.py | 20 ++--
79 swh/core/tests/db_testing.py | 213 ++++++++++++++++++++++--------------------
80 swh/core/tests/test_logger.py | 4 +-
81 15 files changed, 164 insertions(+), 137 deletions(-)
82 create mode 100644 docs/.gitignore
83 create mode 100644 docs/Makefile
84 create mode 100644 docs/_static/.placeholder
85 create mode 100644 docs/_templates/.placeholder
86 create mode 100644 docs/conf.py
87 create mode 100644 docs/index.rst
88 create mode 100644 swh/__init__.py
89
90mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-journal
91mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-journal
92From ssh://forge.softwareheritage.org/diffusion/DJNL/swh-journal
93 1358fa4..46c0890 master -> origin/master
94 * [new tag] v0.0.4 -> v0.0.4
95Updating 1358fa4..46c0890
96Fast-forward
97 debian/control | 6 +++---
98 debian/rules | 11 +++++------
99 docs/.gitignore | 3 +++
100 docs/Makefile | 1 +
101 docs/_static/.placeholder | 0
102 docs/_templates/.placeholder | 0
103 docs/conf.py | 1 +
104 docs/index.rst | 15 +++++++++++++++
105 requirements.txt | 2 +-
106 setup.py | 4 ++--
107 swh/__init__.py | 1 +
108 11 files changed, 32 insertions(+), 12 deletions(-)
109 create mode 100644 docs/.gitignore
110 create mode 100644 docs/Makefile
111 create mode 100644 docs/_static/.placeholder
112 create mode 100644 docs/_templates/.placeholder
113 create mode 100644 docs/conf.py
114 create mode 100644 docs/index.rst
115 create mode 100644 swh/__init__.py
116
117mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-indexer
118mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-indexer
119From ssh://forge.softwareheritage.org/diffusion/78/swh-indexer
120 53eccf5..a36241a master -> origin/master
121Updating 53eccf5..a36241a
122Fast-forward
123 README | 29 +++--
124 debian/control | 2 +-
125 debian/rules | 6 +-
126 docs/.gitignore | 3 +
127 docs/Makefile | 1 +
128 docs/_static/.placeholder | 0
129 docs/_templates/.placeholder | 0
130 docs/conf.py | 1 +
131 docs/index.rst | 15 +++
132 setup.py | 6 +-
133 swh/__init__.py | 1 +
134 swh/indexer/ctags.py | 8 +-
135 swh/indexer/fossology_license.py | 8 +-
136 swh/indexer/indexer.py | 177 ++++++++++++++++++-------
137 swh/indexer/language.py | 9 +-
138 swh/indexer/metadata.py | 256 +++++++++++++++++++++++++++++++++----
139 swh/indexer/metadata_detector.py | 73 +++++++++++
140 swh/indexer/metadata_dictionary.py | 43 ++++---
141 swh/indexer/mimetype.py | 19 ++-
142 swh/indexer/orchestrator.py | 46 +++----
143 swh/indexer/rehash.py | 36 +++---
144 swh/indexer/tests/test_metadata.py | 142 +++++++++++++++++---
145 swh/indexer/tests/test_utils.py | 139 +++++++++++++++++++-
146 23 files changed, 839 insertions(+), 181 deletions(-)
147 create mode 100644 docs/.gitignore
148 create mode 100644 docs/Makefile
149 create mode 100644 docs/_static/.placeholder
150 create mode 100644 docs/_templates/.placeholder
151 create mode 100644 docs/conf.py
152 create mode 100644 docs/index.rst
153 create mode 100644 swh/__init__.py
154 create mode 100644 swh/indexer/metadata_detector.py
155
156mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-lister
157mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-lister
158From ssh://forge.softwareheritage.org/source/swh-lister
159 b6bdab7..2857dcf master -> origin/master
160 * [new tag] v0.0.7 -> v0.0.7
161 * [new tag] v0.0.6 -> v0.0.6
162Updating b6bdab7..2857dcf
163Fast-forward
164 .gitignore | 1 +
165 debian/clean | 1 +
166 debian/control | 5 +-
167 debian/rules | 8 +-
168 docs/.gitignore | 3 +
169 docs/Makefile | 1 +
170 docs/_static/.placeholder | 0
171 docs/_templates/.placeholder | 0
172 docs/conf.py | 1 +
173 docs/index.rst | 15 +++
174 requirements-swh.txt | 2 +-
175 requirements.txt | 1 +
176 setup.py | 6 +-
177 swh/__init__.py | 1 +
178 swh/lister/core/abstractattribute.py | 14 ++-
179 swh/lister/core/indexing_lister.py | 40 +++---
180 swh/lister/core/lister_base.py | 34 ++---
181 swh/lister/core/lister_transports.py | 53 ++++++--
182 swh/lister/core/tasks.py | 12 +-
183 swh/lister/debian/lister.py | 234 +++++++++++++++++++++++++++++++++++
184 swh/lister/debian/utils.py | 81 ++++++++++++
185 swh/lister/github/lister.py | 3 +-
186 swh/lister/github/models.py | 4 +-
187 swh/lister/github/tasks.py | 2 +-
188 24 files changed, 456 insertions(+), 66 deletions(-)
189 create mode 100644 debian/clean
190 create mode 100644 docs/.gitignore
191 create mode 100644 docs/Makefile
192 create mode 100644 docs/_static/.placeholder
193 create mode 100644 docs/_templates/.placeholder
194 create mode 100644 docs/conf.py
195 create mode 100644 docs/index.rst
196 create mode 100644 swh/__init__.py
197 create mode 100644 swh/lister/debian/lister.py
198 create mode 100644 swh/lister/debian/utils.py
199
200mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-debian
201mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-debian
202From ssh://forge.softwareheritage.org/diffusion/DLDDEB/swh-loader-debian
203 2bc0a6e..c04e822 master -> origin/master
204Updating 2bc0a6e..c04e822
205Fast-forward
206 bin/swh-load-deb-snapshot | 14 -
207 debian/control | 9 +-
208 debian/rules | 9 +-
209 docs/.gitignore | 3 +
210 docs/Makefile | 1 +
211 .../__init__.py => docs/_static/.placeholder | 0
212 docs/_templates/.placeholder | 0
213 docs/conf.py | 1 +
214 docs/index.rst | 15 +
215 requirements-swh.txt | 4 +-
216 setup.py | 6 +-
217 swh/__init__.py | 1 +
218 swh/loader/__init__.py | 1 +
219 swh/loader/debian/converters.py | 197 +-----
220 swh/loader/debian/listers/snapshot.py | 273 -------
221 swh/loader/debian/loader.py | 788 ++++++++-------------
222 swh/loader/debian/tasks.py | 146 +---
223 17 files changed, 392 insertions(+), 1076 deletions(-)
224 delete mode 100755 bin/swh-load-deb-snapshot
225 create mode 100644 docs/.gitignore
226 create mode 100644 docs/Makefile
227 rename swh/loader/debian/listers/__init__.py => docs/_static/.placeholder (100%)
228 create mode 100644 docs/_templates/.placeholder
229 create mode 100644 docs/conf.py
230 create mode 100644 docs/index.rst
231 create mode 100644 swh/__init__.py
232 create mode 100644 swh/loader/__init__.py
233 delete mode 100644 swh/loader/debian/listers/snapshot.py
234
235mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-core
236mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-core
237From ssh://forge.softwareheritage.org/diffusion/60/swh-loader-core
238 f0fb67e..5e0123e master -> origin/master
239 * [new tag] v0.0.18 -> v0.0.18
240 * [new tag] v0.0.15 -> v0.0.15
241 * [new tag] v0.0.16 -> v0.0.16
242 * [new tag] v0.0.17 -> v0.0.17
243Updating f0fb67e..5e0123e
244Fast-forward
245 README.md | 13 ++
246 debian/control | 6 +-
247 debian/rules | 11 +-
248 docs/.gitignore | 4 +
249 docs/Makefile | 6 +
250 docs/_static/.placeholder | 0
251 docs/_templates/.placeholder | 0
252 docs/conf.py | 1 +
253 docs/index.rst | 15 ++
254 requirements-swh.txt | 2 +-
255 setup.py | 4 +-
256 swh/__init__.py | 1 +
257 swh/loader/__init__.py | 1 +
258 swh/loader/core/converters.py | 137 ++------------
259 swh/loader/core/loader.py | 316 ++++++++++++++++++++-----------
260 swh/loader/core/tests/__init__.py | 0
261 swh/loader/core/tests/test_converters.py | 303 +++++------------------------
262 17 files changed, 318 insertions(+), 502 deletions(-)
263 create mode 100644 README.md
264 create mode 100644 docs/.gitignore
265 create mode 100644 docs/Makefile
266 create mode 100644 docs/_static/.placeholder
267 create mode 100644 docs/_templates/.placeholder
268 create mode 100644 docs/conf.py
269 create mode 100644 docs/index.rst
270 create mode 100644 swh/__init__.py
271 create mode 100644 swh/loader/__init__.py
272 create mode 100644 swh/loader/core/tests/__init__.py
273
274mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-dir
275mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-dir
276From ssh://forge.softwareheritage.org/diffusion/DLDDIR/swh-loader-dir
277 badc8d3..5536812 master -> origin/master
278 * [new branch] migrate-to-swh-model-from-disk -> origin/migrate-to-swh-model-from-disk
279 * [new tag] v0.0.29 -> v0.0.29
280 * [new tag] v0.0.27 -> v0.0.27
281 * [new tag] v0.0.28 -> v0.0.28
282Updating badc8d3..5536812
283Fast-forward
284 README | 96 -----------------
285 README.md | 96 +++++++++++++++++
286 debian/control | 10 +-
287 debian/rules | 12 +--
288 docs/.gitignore | 4 +
289 docs/Makefile | 6 ++
290 docs/_static/.placeholder | 0
291 docs/_templates/.placeholder | 0
292 docs/conf.py | 1 +
293 docs/index.rst | 15 +++
294 requirements-swh.txt | 4 +-
295 resources/dir.ini | 15 ---
296 resources/dir.yml | 17 +++
297 resources/loader/dir.ini | 35 ------
298 resources/loader/dir.yml | 35 ++++++
299 setup.py | 5 +-
300 swh/__init__.py | 1 +
301 swh/loader/__init__.py | 1 +
302 swh/loader/dir/loader.py | 196 +++++++++++++++++-----------------
303 swh/loader/dir/tasks.py | 7 +-
304 swh/loader/dir/tests/test_loader.py | 206 +++++++++++++++++++++++++++++++++---
305 21 files changed, 485 insertions(+), 277 deletions(-)
306 delete mode 100644 README
307 create mode 100644 README.md
308 create mode 100644 docs/.gitignore
309 create mode 100644 docs/Makefile
310 create mode 100644 docs/_static/.placeholder
311 create mode 100644 docs/_templates/.placeholder
312 create mode 100644 docs/conf.py
313 create mode 100644 docs/index.rst
314 delete mode 100644 resources/dir.ini
315 create mode 100644 resources/dir.yml
316 delete mode 100644 resources/loader/dir.ini
317 create mode 100644 resources/loader/dir.yml
318 create mode 100644 swh/__init__.py
319 create mode 100644 swh/loader/__init__.py
320
321mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-mercurial
322mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-mercurial
323From ssh://forge.softwareheritage.org/source/swh-loader-mercurial
324 6cc321b..bc48736 master -> origin/master
325Updating 6cc321b..bc48736
326Fast-forward
327 debian/control | 2 +-
328 debian/rules | 9 ++++++---
329 docs/.gitignore | 3 +++
330 docs/Makefile | 1 +
331 docs/_static/.placeholder | 0
332 docs/_templates/.placeholder | 0
333 docs/conf.py | 1 +
334 docs/index.rst | 15 +++++++++++++++
335 requirements.txt | 2 ++
336 setup.py | 4 ++--
337 swh/__init__.py | 1 +
338 swh/loader/__init__.py | 1 +
339 swh/loader/mercurial/base.py | 9 +++++----
340 swh/loader/mercurial/slow_loader.py | 2 +-
341 14 files changed, 39 insertions(+), 11 deletions(-)
342 create mode 100644 docs/.gitignore
343 create mode 100644 docs/Makefile
344 create mode 100644 docs/_static/.placeholder
345 create mode 100644 docs/_templates/.placeholder
346 create mode 100644 docs/conf.py
347 create mode 100644 docs/index.rst
348 create mode 100644 swh/__init__.py
349 create mode 100644 swh/loader/__init__.py
350
351mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-git
352mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-git
353From ssh://forge.softwareheritage.org/diffusion/DLDG/swh-loader-git
354 af7b3c4..c49a0f7 master -> origin/master
355 * [new branch] bulk-git-loader -> origin/bulk-git-loader
356 * [new tag] v0.0.33 -> v0.0.33
357Updating af7b3c4..c49a0f7
358Fast-forward
359 debian/control | 2 +-
360 debian/rules | 9 ++++++---
361 docs/.gitignore | 3 +++
362 docs/Makefile | 1 +
363 docs/_static/.placeholder | 0
364 docs/_templates/.placeholder | 0
365 docs/conf.py | 1 +
366 docs/index.rst | 15 +++++++++++++++
367 scratch/analyse-profile.py | 42 ------------------------------------------
368 setup.py | 4 ++--
369 swh/__init__.py | 1 +
370 swh/loader/__init__.py | 1 +
371 swh/loader/git/base.py | 28 +++++++++++++++-------------
372 swh/loader/git/updater.py | 19 +++++++++++++------
373 14 files changed, 59 insertions(+), 67 deletions(-)
374 create mode 100644 docs/.gitignore
375 create mode 100644 docs/Makefile
376 create mode 100644 docs/_static/.placeholder
377 create mode 100644 docs/_templates/.placeholder
378 create mode 100644 docs/conf.py
379 create mode 100644 docs/index.rst
380 delete mode 100755 scratch/analyse-profile.py
381 create mode 100644 swh/__init__.py
382 create mode 100644 swh/loader/__init__.py
383
384mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-svn
385mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-svn
386From ssh://forge.softwareheritage.org/diffusion/DLDSVN/swh-loader-svn
387 54045a6..8cedf74 master -> origin/master
388 * [new tag] v0.0.30 -> v0.0.30
389 * [new tag] v0.0.27 -> v0.0.27
390 * [new tag] v0.0.28 -> v0.0.28
391 * [new tag] v0.0.29 -> v0.0.29
392Updating 54045a6..8cedf74
393Fast-forward
394 bin/swh-hashtree | 34 ++++-
395 debian/control | 10 +-
396 debian/rules | 12 +-
397 docs/.gitignore | 3 +
398 docs/Makefile | 1 +
399 docs/_static/.placeholder | 0
400 docs/_templates/.placeholder | 0
401 docs/conf.py | 1 +
402 docs/index.rst | 15 ++
403 requirements-swh.txt | 4 +-
404 setup.py | 4 +-
405 swh/__init__.py | 1 +
406 swh/loader/__init__.py | 1 +
407 swh/loader/svn/converters.py | 4 +-
408 swh/loader/svn/loader.py | 120 ++++++++-------
409 swh/loader/svn/producer.py | 219 +++++++++++++++++++--------
410 swh/loader/svn/ra.py | 284 +++++++++++-------------------------
411 swh/loader/svn/svn.py | 72 ++++-----
412 swh/loader/svn/tasks.py | 3 +-
413 swh/loader/svn/tests/test_base.py | 3 +
414 swh/loader/svn/tests/test_loader.py | 122 ++++++++++++++--
415 swh/loader/svn/tests/test_utils.py | 162 --------------------
416 swh/loader/svn/utils.py | 102 -------------
417 23 files changed, 531 insertions(+), 646 deletions(-)
418 create mode 100644 docs/.gitignore
419 create mode 100644 docs/Makefile
420 create mode 100644 docs/_static/.placeholder
421 create mode 100644 docs/_templates/.placeholder
422 create mode 100644 docs/conf.py
423 create mode 100644 docs/index.rst
424 create mode 100644 swh/__init__.py
425 create mode 100644 swh/loader/__init__.py
426
427mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-tar
428mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-loader-tar
429From ssh://forge.softwareheritage.org/diffusion/DLDTAR/swh-loader-tar
430 beaccc8..42cea28 master -> origin/master
431 * [new tag] v0.0.28 -> v0.0.28
432 * [new tag] v0.0.26 -> v0.0.26
433 * [new tag] v0.0.27 -> v0.0.27
434Updating beaccc8..42cea28
435Fast-forward
436 README | 224 ++++++++-------------
437 debian/control | 6 +-
438 debian/rules | 12 +-
439 docs/.gitignore | 4 +
440 docs/Makefile | 6 +
441 docs/_static/.placeholder | 0
442 docs/_templates/.placeholder | 0
443 docs/conf.py | 1 +
444 docs/index.rst | 15 ++
445 requirements-swh.txt | 2 +-
446 resources/loader/tar.ini | 39 ----
447 resources/producer/{tar-gnu.ini => tar-gnu.yml} | 14 +-
448 .../producer/{tar-old-gnu.ini => tar-old-gnu.yml} | 14 +-
449 setup.py | 4 +-
450 swh/__init__.py | 1 +
451 swh/loader/__init__.py | 1 +
452 swh/loader/tar/loader.py | 95 ++++-----
453 swh/loader/tar/producer.py | 4 +-
454 swh/loader/tar/tarball.py | 7 +-
455 swh/loader/tar/tasks.py | 11 +-
456 swh/loader/tar/tests/test_loader.py | 212 +++++++++++++++++++
457 21 files changed, 411 insertions(+), 261 deletions(-)
458 create mode 100644 docs/.gitignore
459 create mode 100644 docs/Makefile
460 create mode 100644 docs/_static/.placeholder
461 create mode 100644 docs/_templates/.placeholder
462 create mode 100644 docs/conf.py
463 create mode 100644 docs/index.rst
464 delete mode 100644 resources/loader/tar.ini
465 rename resources/producer/{tar-gnu.ini => tar-gnu.yml} (69%)
466 rename resources/producer/{tar-old-gnu.ini => tar-old-gnu.yml} (65%)
467 create mode 100644 swh/__init__.py
468 create mode 100644 swh/loader/__init__.py
469 create mode 100644 swh/loader/tar/tests/test_loader.py
470
471mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-mirror-forge
472mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-mirror-forge
473From ssh://forge.softwareheritage.org/source/swh-mirror-forge
474 665fa92..832c09d master -> origin/master
475Updating 665fa92..832c09d
476Fast-forward
477 debian/control | 2 +-
478 debian/rules | 8 +++++---
479 docs/.gitignore | 3 +++
480 docs/Makefile | 1 +
481 docs/_static/.placeholder | 0
482 docs/_templates/.placeholder | 0
483 docs/conf.py | 1 +
484 docs/index.rst | 15 +++++++++++++++
485 setup.py | 4 ++--
486 swh/__init__.py | 1 +
487 swh/mirror/__init__.py | 1 +
488 11 files changed, 30 insertions(+), 6 deletions(-)
489 create mode 100644 docs/.gitignore
490 create mode 100644 docs/Makefile
491 create mode 100644 docs/_static/.placeholder
492 create mode 100644 docs/_templates/.placeholder
493 create mode 100644 docs/conf.py
494 create mode 100644 docs/index.rst
495 create mode 100644 swh/__init__.py
496 create mode 100644 swh/mirror/__init__.py
497
498mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-model
499mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-model
500From ssh://forge.softwareheritage.org/diffusion/DMOD/swh-model
501 11de644..0b7f217 master -> origin/master
502 * [new tag] v0.0.19 -> v0.0.19
503 * [new tag] v0.0.18 -> v0.0.18
504Updating 11de644..0b7f217
505Fast-forward
506 debian/control | 7 +-
507 debian/rules | 10 +-
508 docs/.gitignore | 3 +
509 docs/Makefile | 1 +
510 docs/_static/.placeholder | 0
511 docs/_templates/.placeholder | 0
512 docs/conf.py | 1 +
513 docs/data-model.rst | 13 +
514 docs/index.rst | 20 +
515 setup.py | 16 +-
516 swh/__init__.py | 1 +
517 swh/model/from_disk.py | 346 +++++++++++
518 swh/model/git.py | 587 ------------------
519 swh/model/hashutil.py | 71 ++-
520 swh/model/identifiers.py | 147 ++---
521 swh/model/merkle.py | 286 +++++++++
522 swh/model/tests/generate_testdata_from_disk.py | 92 +++
523 swh/model/tests/test_from_disk.py | 789 +++++++++++++++++++++++++
524 swh/model/tests/test_git.py | 734 -----------------------
525 swh/model/tests/test_git_slow.py | 404 -------------
526 swh/model/tests/test_hashutil.py | 6 +-
527 swh/model/tests/test_merkle.py | 229 +++++++
528 22 files changed, 1934 insertions(+), 1829 deletions(-)
529 create mode 100644 docs/.gitignore
530 create mode 100644 docs/Makefile
531 create mode 100644 docs/_static/.placeholder
532 create mode 100644 docs/_templates/.placeholder
533 create mode 100644 docs/conf.py
534 create mode 100644 docs/data-model.rst
535 create mode 100644 docs/index.rst
536 create mode 100644 swh/__init__.py
537 create mode 100644 swh/model/from_disk.py
538 delete mode 100644 swh/model/git.py
539 create mode 100644 swh/model/merkle.py
540 create mode 100644 swh/model/tests/generate_testdata_from_disk.py
541 create mode 100644 swh/model/tests/test_from_disk.py
542 delete mode 100644 swh/model/tests/test_git.py
543 delete mode 100644 swh/model/tests/test_git_slow.py
544 create mode 100644 swh/model/tests/test_merkle.py
545
546mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-py-template
547mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-py-template
548From ssh://forge.softwareheritage.org/diffusion/DTPL/swh-py-template
549 f09909b..c52353d master -> origin/master
550Updating f09909b..c52353d
551Fast-forward
552 debian/control | 6 +++---
553 debian/rules | 6 ++----
554 docs/.gitignore | 3 +++
555 docs/Makefile | 1 +
556 docs/_static/.placeholder | 0
557 docs/_templates/.placeholder | 0
558 docs/conf.py | 1 +
559 docs/index.rst | 15 +++++++++++++++
560 swh/__init__.py | 1 +
561 9 files changed, 26 insertions(+), 7 deletions(-)
562 create mode 100644 docs/.gitignore
563 create mode 100644 docs/Makefile
564 create mode 100644 docs/_static/.placeholder
565 create mode 100644 docs/_templates/.placeholder
566 create mode 100644 docs/conf.py
567 create mode 100644 docs/index.rst
568 create mode 100644 swh/__init__.py
569
570mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-objstorage
571mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-objstorage
572From ssh://forge.softwareheritage.org/diffusion/DOBJS/swh-objstorage
573 4412792..77b54b4 master -> origin/master
574 * [new tag] v0.0.23 -> v0.0.23
575Updating 4412792..77b54b4
576Fast-forward
577 debian/rules | 7 ++-
578 docs/.gitignore | 3 ++
579 docs/Makefile | 1 +
580 docs/_static/.placeholder | 0
581 docs/_templates/.placeholder | 0
582 docs/conf.py | 1 +
583 docs/index.rst | 15 ++++++
584 setup.py | 10 +---
585 swh/__init__.py | 1 +
586 swh/objstorage/__init__.py | 2 +
587 swh/objstorage/api/client.py | 8 +++-
588 swh/objstorage/api/server.py | 7 +++
589 swh/objstorage/cloud/objstorage_azure.py | 16 ++++++-
590 swh/objstorage/cloud/objstorage_cloud.py | 8 +++-
591 swh/objstorage/multiplexer/__init__.py | 2 +-
592 swh/objstorage/multiplexer/filter/__init__.py | 17 +++----
593 swh/objstorage/multiplexer/filter/filter.py | 3 ++
594 .../multiplexer/filter/read_write_filter.py | 3 ++
595 .../multiplexer/multiplexer_objstorage.py | 33 ++++++++-----
596 swh/objstorage/objstorage.py | 20 ++++++++
597 swh/objstorage/objstorage_in_memory.py | 55 ++++++++++++++++++++++
598 swh/objstorage/objstorage_pathslicing.py | 15 +++++-
599 swh/objstorage/tests/objstorage_testing.py | 31 ++++++++++++
600 swh/objstorage/tests/server_testing.py | 6 +--
601 swh/objstorage/tests/test_objstorage_api.py | 1 +
602 swh/objstorage/tests/test_objstorage_azure.py | 9 ++++
603 swh/objstorage/tests/test_objstorage_cloud.py | 10 ++++
604 swh/objstorage/tests/test_objstorage_in_memory.py | 16 +++++++
605 .../tests/test_objstorage_multiplexer.py | 12 +++++
606 29 files changed, 270 insertions(+), 42 deletions(-)
607 create mode 100644 docs/.gitignore
608 create mode 100644 docs/Makefile
609 create mode 100644 docs/_static/.placeholder
610 create mode 100644 docs/_templates/.placeholder
611 create mode 100644 docs/conf.py
612 create mode 100644 docs/index.rst
613 create mode 100644 swh/__init__.py
614 create mode 100644 swh/objstorage/objstorage_in_memory.py
615 create mode 100644 swh/objstorage/tests/test_objstorage_in_memory.py
616
617mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage-testdata
618mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage-testdata
619From ssh://forge.softwareheritage.org/diffusion/DSTOT/swh-storage-testdata
620 66bab35..082d26c master -> origin/master
621Updating 66bab35..082d26c
622Fast-forward
623 Makefile | 38 +-
624 dumps/swh-archiver.dump | Bin 13451 -> 11883 bytes
625 dumps/swh-archiver.sql | 59 +--
626 dumps/swh-scheduler.dump | Bin 0 -> 26328 bytes
627 dumps/swh-scheduler.sql | 751 +++++++++++++++++++++++++++
628 dumps/swh.dump | Bin 183826 -> 200398 bytes
629 dumps/swh.sql | 566 ++++++++++++++++++--
630 svn-folders/pkg-gourmet-with-external-id.tgz | Bin 0 -> 35440 bytes
631 8 files changed, 1285 insertions(+), 129 deletions(-)
632 create mode 100644 dumps/swh-scheduler.dump
633 create mode 100644 dumps/swh-scheduler.sql
634 create mode 100644 svn-folders/pkg-gourmet-with-external-id.tgz
635
636mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-scheduler
637mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-scheduler
638From ssh://forge.softwareheritage.org/diffusion/DSCH/swh-scheduler
639 0e14eff..cd827b6 master -> origin/master
640 * [new tag] v0.0.17 -> v0.0.17
641 * [new tag] v0.0.16 -> v0.0.16
642Updating 0e14eff..cd827b6
643Fast-forward
644 debian/control | 6 +-
645 debian/rules | 11 +-
646 docs/.gitignore | 3 +
647 docs/Makefile | 1 +
648 docs/_static/.placeholder | 0
649 docs/_templates/.placeholder | 0
650 docs/conf.py | 1 +
651 docs/index.rst | 15 +++
652 requirements-swh.txt | 2 +-
653 setup.py | 8 +-
654 sql/.gitignore | 3 +
655 sql/Makefile | 48 +++++++
656 sql/swh-scheduler-schema.sql | 149 +++++++++++++--------
657 sql/updates/04.sql | 53 ++++++++
658 sql/updates/05.sql | 144 ++++++++++++++++++++
659 sql/updates/06.sql | 23 ++++
660 swh/__init__.py | 1 +
661 swh/scheduler/__init__.py | 0
662 swh/scheduler/backend.py | 128 ++++++++++++------
663 swh/scheduler/celery_backend/runner.py | 46 +++++--
664 swh/scheduler/cli.py | 7 +-
665 swh/scheduler/tests/__init__.py | 0
666 swh/scheduler/tests/test_scheduler.py | 238 +++++++++++++++++++++++++++++++++
667 23 files changed, 766 insertions(+), 121 deletions(-)
668 create mode 100644 docs/.gitignore
669 create mode 100644 docs/Makefile
670 create mode 100644 docs/_static/.placeholder
671 create mode 100644 docs/_templates/.placeholder
672 create mode 100644 docs/conf.py
673 create mode 100644 docs/index.rst
674 create mode 100644 sql/.gitignore
675 create mode 100644 sql/Makefile
676 create mode 100644 sql/updates/04.sql
677 create mode 100644 sql/updates/05.sql
678 create mode 100644 sql/updates/06.sql
679 create mode 100644 swh/__init__.py
680 create mode 100644 swh/scheduler/__init__.py
681 create mode 100644 swh/scheduler/tests/__init__.py
682 create mode 100644 swh/scheduler/tests/test_scheduler.py
683
684mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-vault
685mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-vault
686From ssh://forge.softwareheritage.org/diffusion/DVAU/swh-vault
687 6f4441b..1edcd77 master -> origin/master
688Updating 6f4441b..1edcd77
689Fast-forward
690 debian/control | 21 ++-
691 debian/rules | 8 +-
692 docs/.gitignore | 3 +
693 docs/Makefile | 1 +
694 docs/_static/.placeholder | 0
695 docs/_templates/.placeholder | 0
696 docs/conf.py | 1 +
697 docs/index.rst | 15 ++
698 requirements-swh.txt | 2 +-
699 setup.py | 1 +
700 sql/swh-vault-schema.sql | 2 +
701 swh/__init__.py | 1 +
702 swh/vault/api/server.py | 12 +-
703 swh/vault/backend.py | 81 +++++++++--
704 swh/vault/cache.py | 62 ++++-----
705 swh/vault/cookers/base.py | 14 +-
706 swh/vault/cooking_tasks.py | 4 +-
707 swh/vault/tests/test_backend.py | 290 +++++++++++++++++++++++++++++++++++++++
708 swh/vault/tests/test_cache.py | 76 ++++++++++
709 swh/vault/tests/test_cookers.py | 272 ++++++++++++++++++++++++++++++++++++
710 swh/vault/tests/vault_testing.py | 63 +++++++++
711 21 files changed, 862 insertions(+), 67 deletions(-)
712 create mode 100644 docs/.gitignore
713 create mode 100644 docs/Makefile
714 create mode 100644 docs/_static/.placeholder
715 create mode 100644 docs/_templates/.placeholder
716 create mode 100644 docs/conf.py
717 create mode 100644 docs/index.rst
718 create mode 100644 swh/__init__.py
719 create mode 100644 swh/vault/tests/test_backend.py
720 create mode 100644 swh/vault/tests/test_cache.py
721 create mode 100644 swh/vault/tests/test_cookers.py
722 create mode 100644 swh/vault/tests/vault_testing.py
723
724mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-web
725mr checkout: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-web
726Cloning into 'swh-web'...
727
728mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage
729mr update: /home/temp-drydock/drydock/workingcopy-177/repo/swh-environment/swh-storage
730From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
731 b8c480f..d35e739 master -> origin/master
732 * [new tag] v0.0.89 -> v0.0.89
733 * [new tag] v0.0.90 -> v0.0.90
734 * [new tag] v0.0.91 -> v0.0.91
735Updating b8c480f..d35e739
736Fast-forward
737 debian/control | 22 +-
738 debian/rules | 14 +-
739 docs/.gitignore | 3 +
740 docs/Makefile | 1 +
741 docs/_static/.placeholder | 0
742 docs/_templates/.placeholder | 0
743 docs/conf.py | 1 +
744 docs/index.rst | 15 +
745 requirements-swh.txt | 3 +-
746 requirements.txt | 1 -
747 setup.py | 13 +-
748 .../revision_metadata.translated_metadata.json | 59 ++
749 sql/swh-data.sql | 6 +
750 sql/swh-func.sql | 282 ++++++++-
751 sql/swh-indexes.sql | 25 +
752 sql/swh-schema.sql | 37 +-
753 sql/upgrades/108.sql | 58 ++
754 sql/upgrades/109.sql | 33 ++
755 swh/__init__.py | 1 +
756 swh/storage/api/client.py | 24 +
757 swh/storage/api/server.py | 36 ++
758 swh/storage/converters.py | 81 ++-
759 swh/storage/db.py | 61 ++
760 swh/storage/listener.py | 13 +-
761 swh/storage/schemata/distribution.py | 250 ++++++++
762 swh/storage/storage.py | 461 ++++++++++-----
763 swh/storage/tests/server_testing.py | 3 +-
764 swh/storage/tests/storage_testing.py | 72 +++
765 swh/storage/tests/test_api_client.py | 2 +-
766 swh/storage/tests/test_converters.py | 26 +
767 swh/storage/tests/test_db.py | 4 +-
768 swh/storage/tests/test_storage.py | 630 ++++++++++++++++++---
769 32 files changed, 1925 insertions(+), 312 deletions(-)
770 create mode 100644 docs/.gitignore
771 create mode 100644 docs/Makefile
772 create mode 100644 docs/_static/.placeholder
773 create mode 100644 docs/_templates/.placeholder
774 create mode 100644 docs/conf.py
775 create mode 100644 docs/index.rst
776 create mode 100644 sql/json/revision_metadata.translated_metadata.json
777 create mode 100644 sql/upgrades/108.sql
778 create mode 100644 sql/upgrades/109.sql
779 create mode 100644 swh/__init__.py
780 create mode 100644 swh/storage/schemata/distribution.py
781 create mode 100644 swh/storage/tests/storage_testing.py
782
783mr update: finished (24 ok)
784

Clone on Software Heritage Worker

When
Completed at Oct 12 2017, 7:51 PM · Built instantly
Status
Passed

Event Timeline