Page MenuHomeSoftware Heritage

Mirror: year is out of range
Closed, MigratedEdits Locked

Description

2021-04-01T22:23:26.923969854Z swh_storage.1.yjtfpr7ambpm@libra    | ERROR:root:year 292278994 is out of range
2021-04-01T22:23:26.924163854Z swh_storage.1.yjtfpr7ambpm@libra    | Traceback (most recent call last):
2021-04-01T22:23:26.924168697Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/flask/app.py", line 1813, in full_dispatch_request
2021-04-01T22:23:26.924175947Z swh_storage.1.yjtfpr7ambpm@libra    |     rv = self.dispatch_request()
2021-04-01T22:23:26.924177750Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/flask/app.py", line 1799, in dispatch_request
2021-04-01T22:23:26.924179518Z swh_storage.1.yjtfpr7ambpm@libra    |     return self.view_functions[rule.endpoint](**req.view_args)
2021-04-01T22:23:26.924181074Z swh_storage.1.yjtfpr7ambpm@libra    |   File "<decorator-gen-40>", line 2, in revision_add
2021-04-01T22:23:26.924182968Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/core/api/negotiation.py", line 147, in _negotiate
2021-04-01T22:23:26.924184554Z swh_storage.1.yjtfpr7ambpm@libra    |     return f.negotiator(*args, **kwargs)
2021-04-01T22:23:26.924186035Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/core/api/negotiation.py", line 81, in __call__
2021-04-01T22:23:26.924187765Z swh_storage.1.yjtfpr7ambpm@libra    |     result = self.func(*args, **kwargs)
2021-04-01T22:23:26.924189315Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/core/api/__init__.py", line 458, in _f
2021-04-01T22:23:26.924190948Z swh_storage.1.yjtfpr7ambpm@libra    |     return obj_meth(**kw)
2021-04-01T22:23:26.924192476Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/storage/metrics.py", line 24, in d
2021-04-01T22:23:26.924194066Z swh_storage.1.yjtfpr7ambpm@libra    |     return f(*a, **kw)
2021-04-01T22:23:26.924195569Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/storage/metrics.py", line 77, in d
2021-04-01T22:23:26.924197141Z swh_storage.1.yjtfpr7ambpm@libra    |     r = f(*a, **kw)
2021-04-01T22:23:26.924198635Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/core/db/common.py", line 62, in _meth
2021-04-01T22:23:26.924200378Z swh_storage.1.yjtfpr7ambpm@libra    |     return meth(self, *args, db=db, cur=cur, **kwargs)
2021-04-01T22:23:26.924201978Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/storage/postgresql/storage.py", line 571, in revision_add
2021-04-01T22:23:26.924203682Z swh_storage.1.yjtfpr7ambpm@libra    |     db_revisions_filtered = list(map(converters.revision_to_db, revisions_filtered))
2021-04-01T22:23:26.924205317Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/storage/postgresql/converters.py", line 153, in revision_to_db
2021-04-01T22:23:26.924206937Z swh_storage.1.yjtfpr7ambpm@libra    |     date = date_to_db(revision.date)
2021-04-01T22:23:26.924208418Z swh_storage.1.yjtfpr7ambpm@libra    |   File "/usr/lib/python3/dist-packages/swh/storage/postgresql/converters.py", line 137, in date_to_db
2021-04-01T22:23:26.924210021Z swh_storage.1.yjtfpr7ambpm@libra    |     timestamp = datetime.datetime.fromtimestamp(ts.seconds, datetime.timezone.utc)
2021-04-01T22:23:26.924211597Z swh_storage.1.yjtfpr7ambpm@libra    | ValueError: year 292278994 is out of range

Context:

ii  python3-swh.core        0.12.0-1~swh1~bpo10+1 all          Software Heritage core utilities
ii  python3-swh.journal     0.7.1-1~swh1~bpo10+1  all          Software Heritage Journal utilities
ii  python3-swh.model       2.3.0-1~swh1~bpo10+1  all          Software Heritage data model
ii  python3-swh.objstorage  0.2.2-1~swh1~bpo10+1  all          Software Heritage Object Storage
ii  python3-swh.scheduler   0.10.0-1~swh1~bpo10+1 all          Software Heritage Scheduler
ii  python3-swh.storage     0.27.0-1~swh1~bpo10+1 all          Software Heritage storage utilities

Event Timeline

douardda triaged this task as High priority.Apr 2 2021, 9:51 AM
douardda created this task.

See T3170 (error generated by the same invalid kafka messages).

Ah fun, one of the revisions with this pb, on staging (ba3343bc4fa403a8dfbfcab7fc1a8c29ee34bd69) seems to have been crafted by https://gitlab.com/gitlab-org/gitlab-foss/-/blob/staging-26-fix_add_deploy_key_spec/spec/models/merge_request_diff_commit_spec.rb