Page MenuHomeSoftware Heritage
Harbormaster B473 Build 696

Build 696
Public
Actions

You are viewing an older run of this build. View Current Build

Properties

Buildable
B473: rDSTOd0cbf0a54917: Archiver Director/Worker: Add copy to backend worker implementation
Build Plan
Plan 2 Software Heritage Python tests
Status
Passed

History

Run 3
Run 2
Run 1

Lint

When
Completed at Sep 14 2016, 12:14 PM · Built for 2 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 2405 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1python3 -m flake8 swh bin/swh-storage-add-dir
2

Python tests

When
Completed at Sep 14 2016, 12:14 PM · Built for 1 s
Status
Failed
1 empty logs are hidden. Show all logs.

Build Log 2404 (remote - stderr)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1W: unknown repository 'swh-environment', you might want to remove it
2Failure: ImportError (No module named 'azure') ... ERROR
3db_to_author (test_converters.TestConverters) ... ok
4db_to_git_headers (test_converters.TestConverters) ... ok
5db_to_release (test_converters.TestConverters) ... ok
6db_to_revision (test_converters.TestConverters) ... ok
7
8======================================================================
9ERROR: Failure: ImportError (No module named 'azure')
10----------------------------------------------------------------------
11Traceback (most recent call last):
12 File "/usr/lib/python3/dist-packages/nose/failure.py", line 39, in runTest
13 raise self.exc_val.with_traceback(self.tb)
14 File "/usr/lib/python3/dist-packages/nose/loader.py", line 414, in loadTestsFromName
15 addr.filename, addr.module)
16 File "/usr/lib/python3/dist-packages/nose/importer.py", line 47, in importFromPath
17 return self.importFromDir(dir_path, fqname)
18 File "/usr/lib/python3/dist-packages/nose/importer.py", line 94, in importFromDir
19 mod = load_module(part_fqname, fh, filename, desc)
20 File "/usr/lib/python3.4/imp.py", line 235, in load_module
21 return load_source(name, filename, file)
22 File "/usr/lib/python3.4/imp.py", line 171, in load_source
23 module = methods.load()
24 File "<frozen importlib._bootstrap>", line 1220, in load
25 File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
26 File "<frozen importlib._bootstrap>", line 1129, in _exec
27 File "<frozen importlib._bootstrap>", line 1471, in exec_module
28 File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
29 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/tests/test_archiver.py", line 19, in <module>
30 from swh.storage.archiver import ArchiverWithRetentionPolicyDirector
31 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-storage/swh/storage/archiver/__init__.py", line 7, in <module>
32 from swh.objstorage.cloud import AzureCloudObjStorage # noqa
33 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-objstorage/swh/objstorage/cloud/__init__.py", line 2, in <module>
34 from .objstorage_azure import AzureCloudObjStorage
35 File "/home/temp-drydock/drydock/workingcopy-173/repo/swh-objstorage/swh/objstorage/cloud/objstorage_azure.py", line 12, in <module>
36 from azure.storage.blob import BlockBlobService
37ImportError: No module named 'azure'
38
39----------------------------------------------------------------------
40Ran 5 tests in 0.580s
41
42FAILED (errors=1)
43

Update environment from working copy

When
Completed at Sep 14 2016, 12:14 PM · Built for 8 s
Status
Passed
1 empty logs are hidden. Show all logs.

Build Log 2401 (remote - stdout)
25 - 50 - 100 - Unlimited Lines
New View (Prototype)

1mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/snippets
2mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/snippets
3Already up-to-date.
4
5mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-core
6mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-core
7Already up-to-date.
8
9mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-fetcher-googlecode
10mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-fetcher-googlecode
11Already up-to-date.
12
13mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-cloner-git
14mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-cloner-git
15Already up-to-date.
16
17mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-journal
18mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-journal
19Already up-to-date.
20
21mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-debian
22mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-debian
23Already up-to-date.
24
25mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-antelink
26mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-antelink
27Already up-to-date.
28
29mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-lister-github
30mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-lister-github
31From ssh://forge.softwareheritage.org/diffusion/DLSGH/swh-lister-github
32 9550ca3..e2a96f1 master -> origin/master
33 * [new branch] qless-refactoring -> origin/qless-refactoring
34Updating 9550ca3..e2a96f1
35Fast-forward
36 README | 24 +++--
37 TODO | 8 ++
38 bin/batch | 41 ++++++++
39 bin/ghlister | 150 +++++++++++++++++++++++++++
40 bin/reset.sh | 9 ++
41 bin/status | 18 ++++
42 etc/crontab | 5 +
43 requirements.txt | 7 +-
44 sql/crawler.sql | 106 +++++++++++++++++++
45 sql/pimp_db.sql | 36 +++++++
46 swh/lister/github/cache.py | 40 --------
47 swh/lister/github/constants.py | 7 --
48 swh/lister/github/converters.py | 95 -----------------
49 swh/lister/github/db_utils.py | 18 ++++
50 swh/lister/github/generate_tasks.py | 111 ++++++++++++++++++++
51 swh/lister/github/github_api.py | 137 -------------------------
52 swh/lister/github/lister.py | 197 +++++++++++++++++++++++++++++-------
53 swh/lister/github/models.py | 44 ++++++++
54 swh/lister/github/processors.py | 163 -----------------------------
55 swh/lister/github/req_queue.py | 31 ------
56 swh/lister/github/storage_utils.py | 117 ---------------------
57 21 files changed, 727 insertions(+), 637 deletions(-)
58 create mode 100755 bin/batch
59 create mode 100755 bin/ghlister
60 create mode 100644 bin/reset.sh
61 create mode 100755 bin/status
62 create mode 100644 etc/crontab
63 create mode 100644 sql/crawler.sql
64 create mode 100644 sql/pimp_db.sql
65 delete mode 100644 swh/lister/github/cache.py
66 delete mode 100644 swh/lister/github/constants.py
67 delete mode 100644 swh/lister/github/converters.py
68 create mode 100644 swh/lister/github/db_utils.py
69 create mode 100644 swh/lister/github/generate_tasks.py
70 delete mode 100644 swh/lister/github/github_api.py
71 create mode 100644 swh/lister/github/models.py
72 delete mode 100644 swh/lister/github/processors.py
73 delete mode 100644 swh/lister/github/req_queue.py
74 delete mode 100644 swh/lister/github/storage_utils.py
75
76mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-dir
77mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-dir
78Already up-to-date.
79
80mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-core
81mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-core
82Already up-to-date.
83
84mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-git
85mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-git
86Already up-to-date.
87
88mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-svn
89mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-svn
90Already up-to-date.
91
92mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-tar
93mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-loader-tar
94Already up-to-date.
95
96mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-model
97mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-model
98Already up-to-date.
99
100mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-objstorage
101mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-objstorage
102From ssh://forge.softwareheritage.org/diffusion/DOBJS/swh-objstorage
103 629f836..87c85be master -> origin/master
104 * [new tag] v0.0.9 -> v0.0.9
105Updating 629f836..87c85be
106Fast-forward
107 bin/swh-objstorage-azure | 6 +++++-
108 swh/objstorage/__init__.py | 28 +++++++++++++++++++++++++++-
109 swh/objstorage/cloud/__init__.py | 8 +++++++-
110 swh/objstorage/cloud/objstorage_azure.py | 14 ++++++++++----
111 swh/objstorage/objstorage_pathslicing.py | 2 +-
112 5 files changed, 50 insertions(+), 8 deletions(-)
113
114mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-py-template
115mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-py-template
116Already up-to-date.
117
118mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-scheduler
119mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-scheduler
120Already up-to-date.
121
122mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage
123mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage
124From ssh://forge.softwareheritage.org/diffusion/DSTO/swh-storage
125 b11cfe3..791444a master -> origin/master
126Updating b11cfe3..791444a
127Fast-forward
128 debian/control | 3 +-
129 requirements.txt | 1 +
130 sql/archiver/swh-archiver-data.sql | 4 +-
131 sql/archiver/swh-archiver-schema.sql | 12 +-
132 sql/archiver/upgrades/004.sql | 12 +
133 sql/swh-func.sql | 17 ++
134 sql/swh-schema.sql | 2 +-
135 sql/upgrades/080.sql | 23 ++
136 swh/storage/api/client.py | 4 +
137 swh/storage/api/server.py | 6 +
138 swh/storage/archiver/__init__.py | 15 +-
139 swh/storage/archiver/db.py | 5 +-
140 swh/storage/archiver/director.py | 145 +++++++++---
141 swh/storage/archiver/tasks.py | 17 +-
142 swh/storage/archiver/worker.py | 411 +++++++++++++++++++++++----------
143 swh/storage/db.py | 20 +-
144 swh/storage/storage.py | 17 ++
145 swh/storage/tests/test_archiver.py | 34 +--
146 swh/storage/tests/test_storage.py | 87 +++++++
147 swh/storage/vault/api/client.py | 71 ++++++
148 swh/storage/vault/api/cooking_tasks.py | 24 ++
149 swh/storage/vault/api/server.py | 92 ++++++++
150 22 files changed, 818 insertions(+), 204 deletions(-)
151 create mode 100644 sql/archiver/upgrades/004.sql
152 create mode 100644 sql/upgrades/080.sql
153 create mode 100644 swh/storage/vault/api/client.py
154 create mode 100644 swh/storage/vault/api/cooking_tasks.py
155 create mode 100644 swh/storage/vault/api/server.py
156
157mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-web-ui
158mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-web-ui
159Already up-to-date.
160
161mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage-testdata
162mr update: /home/temp-drydock/drydock/workingcopy-173/repo/swh-environment/swh-storage-testdata
163From ssh://forge.softwareheritage.org/diffusion/DSTOT/swh-storage-testdata
164 a61dd8e..01a27bc master -> origin/master
165Updating a61dd8e..01a27bc
166Fast-forward
167 dumps/swh-archiver.dump | Bin 8586 -> 8097 bytes
168 dumps/swh-archiver.sql | 27 ++------
169 dumps/swh.dump | Bin 122848 -> 121778 bytes
170 dumps/swh.sql | 161 ++++++++++++++++++++----------------------------
171 4 files changed, 72 insertions(+), 116 deletions(-)
172
173mr update: finished (20 ok)
174

Clone on Software Heritage Worker

When
Completed at Sep 14 2016, 12:13 PM · Built instantly
Status
Passed
About · Developer information · Legal