Page Menu
Home
Software Heritage
Search
Configure Global Search
Log In
Paste
P119
Problem when running reader-git in uffizi
Active
Public
Actions
Authored by
ardumont
on Oct 26 2016, 4:18 PM.
Edit Paste
Archive Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
Git loader
Subscribers
None
Oct 26 14:09:31 uffizi python3[16259]: [2016-10-26 14:09:31,108: ERROR/MainProcess] Task swh.loader.git.tasks.ReaderGitRepository[a9df82ad-802f-4271-8c49-73d8ed4e4746] raised unexpected: UnboundLocalError("local variable 'err' referenced before assignment",)
Oct 26 14:09:31 uffizi python3[16259]: Traceback (most recent call last):
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 240, in trace_task
Oct 26 14:09:31 uffizi python3[16259]: R = retval = fun(*args, **kwargs)
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 437, in __protected_call__
Oct 26 14:09:31 uffizi python3[16259]: return self.run(*args, **kwargs)
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/swh/loader/git/tasks.py", line 53, in run
Oct 26 14:09:31 uffizi python3[16259]: return loader.load(repo_url)
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/swh/loader/git/reader.py", line 157, in load
Oct 26 14:09:31 uffizi python3[16259]: self.fetch_data()
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/swh/loader/git/updater.py", line 303, in fetch_data
Oct 26 14:09:31 uffizi python3[16259]: do_progress)
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/swh/loader/git/updater.py", line 232, in fetch_pack_from_origin
Oct 26 14:09:31 uffizi python3[16259]: progress=do_activity)
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/dulwich/client.py", line 555, in fetch_pack
Oct 26 14:09:31 uffizi python3[16259]: proto, can_read = self._connect(b'upload-pack', path)
Oct 26 14:09:31 uffizi python3[16259]: File "/usr/lib/python3/dist-packages/dulwich/client.py", line 643, in _connect
Oct 26 14:09:31 uffizi python3[16259]: raise err
Oct 26 14:09:31 uffizi python3[16259]: UnboundLocalError: local variable 'err' referenced before assignment
The message is not so clear but the code references (dulwich/client.py around line 643):
```
err = socket.error("no address found for %s" % self._host)
for (family, socktype, proto, canonname, sockaddr) in sockaddrs:
s = socket.socket(family, socktype, proto)
s.setsockopt(socket.IPPROTO_TCP, socket.TCP_NODELAY, 1)
try:
s.connect(sockaddr)
break
except socket.error as err:
if s is not None:
s.close()
s = None
if s is None:
raise err
```
So when trying to raise the 'err' variable, it's when s is None
and s is None when the socket opening somehow fails.
I don't grok why err is not defined since it is (maybe the try except which overrides it).
So it must be environment related (firewall or something).
Will try in another worker.
Issues: https://github.com/jelmer/dulwich/issues/459
PR: https://github.com/jelmer/dulwich/issues/460
Well, an issue in dulwich was making unclear the reason.
Fixing the code in dulwich, made the error clear.
github.com was not resolved in uffizi (it is now).
Event Timeline
ardumont
created this paste.
Oct 26 2016, 4:18 PM
2016-10-26 16:18:15 (UTC+2)
ardumont
edited the content of this paste.
(Show Details)
ardumont
edited the content of this paste.
(Show Details)
Oct 26 2016, 4:23 PM
2016-10-26 16:23:28 (UTC+2)
ardumont
edited projects, added
Git loader
; removed
Indexer
.
ardumont
mentioned this in
rSPSITE0938eb6f869e: uffizi/worker01: Swap the reader git from uffizi to worker01
.
Oct 26 2016, 4:30 PM
2016-10-26 16:30:24 (UTC+2)
ardumont
edited the content of this paste.
(Show Details)
Oct 26 2016, 5:03 PM
2016-10-26 17:03:00 (UTC+2)
ardumont
edited the content of this paste.
(Show Details)
Oct 26 2016, 7:29 PM
2016-10-26 19:29:27 (UTC+2)
ardumont
edited the content of this paste.
(Show Details)
Log In to Comment