Page MenuHomeSoftware Heritage
Feed Advanced Search

Tue, Nov 9

olasd added a comment to T3286: Use journal clients for webapp and deposit to subscribe to events.

Moving towards event notifications and stream processing instead of polling sounds worthwhile, before the amount of polling becomes more important than managing the event notification mechanism. For the two systems you've mentioned, I think we're really, really far away from that, but it's still worth considering a way to do event-driven notifications properly, so we don't have to rush it through.

Tue, Nov 9, 5:26 PM · Save Code Now, SWORD deposit, Web app

Oct 26 2021

anlambert closed T3690: Save code now ui rejects valid git sourceforge origin as Resolved.

Fixed and deployed, origin https://git.code.sf.net/u/bsomervi/hamlib.git has been successfully submitted and is currently being loaded into the archive, closing this.

Oct 26 2021, 5:45 PM · Save Code Now
anlambert added a revision to T3690: Save code now ui rejects valid git sourceforge origin: D6551: assets/save: Fix sourceforge git repository URL validation.
Oct 26 2021, 11:30 AM · Save Code Now
anlambert added a comment to T3690: Save code now ui rejects valid git sourceforge origin.

This is because I made the wrong assumption that URL paths to git repos for the git.code.sf.net netloc are necessarily prefixed by /p/.
So URLs starting with https://git.code.sf.net/u/ are currently rejected when submitting save requests through the Web UI , see related frontend code.

Oct 26 2021, 11:18 AM · Save Code Now
ardumont updated the task description for T3690: Save code now ui rejects valid git sourceforge origin.
Oct 26 2021, 10:40 AM · Save Code Now
ardumont added a project to T3690: Save code now ui rejects valid git sourceforge origin: Save Code Now.
Oct 26 2021, 10:38 AM · Save Code Now

Oct 20 2021

anlambert closed T3257: Template the save code now rejection reason to ease operator workflow, a subtask of T3256: Propose reason for rejecting a save code now, as Resolved.
Oct 20 2021, 12:36 PM · Save Code Now, Easy hack, Web app
anlambert closed T3257: Template the save code now rejection reason to ease operator workflow as Resolved.

It has been implemented and deployed to production, closing this.

Oct 20 2021, 12:36 PM · Save Code Now, Easy hack, Web app
anlambert closed T3256: Propose reason for rejecting a save code now, a subtask of T3252: Better handling of erroneous origins submitted to save code now, as Resolved.
Oct 20 2021, 12:36 PM · System administration, Save Code Now, Web app
anlambert closed T3256: Propose reason for rejecting a save code now as Resolved.

It has been implemented and deployed to production, closing this.

Oct 20 2021, 12:36 PM · Save Code Now, Easy hack, Web app

Oct 19 2021

anlambert added a revision to T3256: Propose reason for rejecting a save code now: D6502: assets/origin-save: Display rejection reason in request info popover.
Oct 19 2021, 11:21 AM · Save Code Now, Easy hack, Web app
anlambert added a revision to T3256: Propose reason for rejecting a save code now: D6501: assets/admin/origin-save: Enable to add note when rejecting a request.
Oct 19 2021, 11:20 AM · Save Code Now, Easy hack, Web app
anlambert added a revision to T3257: Template the save code now rejection reason to ease operator workflow: D6501: assets/admin/origin-save: Enable to add note when rejecting a request.
Oct 19 2021, 11:20 AM · Save Code Now, Easy hack, Web app

Oct 15 2021

ardumont closed T1524: save code now: also add new origins for unknown repos, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Oct 15 2021, 12:29 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont closed T1524: save code now: also add new origins for unknown repos as Resolved.

It's regularly crawled now so closing this.

Oct 15 2021, 12:29 PM · Save Code Now, Web app

Oct 11 2021

anlambert closed T3618: Reschedule loading of dumb git origins submitted to "Save code now" service as Resolved.

Issues related to git dumb loading have been handled and the 5 dumb origins that were failing have been resubmitted through save code now and successfully loaded, closing this.

Oct 11 2021, 1:51 PM · Save Code Now, Archive coverage, Git loader

Oct 8 2021

ardumont added a revision to T3458: save code now: Requests are not getting updated from time to time: D6439: Make workers send task events only when required.
Oct 8 2021, 10:53 AM · Save Code Now

Oct 6 2021

anlambert added a project to T3286: Use journal clients for webapp and deposit to subscribe to events: Save Code Now.
Oct 6 2021, 5:14 PM · Save Code Now, SWORD deposit, Web app

Oct 5 2021

anlambert added a revision to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service: D6416: dumb: Handle missing or corrupted pack file.
Oct 5 2021, 4:14 PM · Save Code Now, Archive coverage, Git loader
anlambert added a revision to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service: D6415: dumb: Handle empty repository edge case.
Oct 5 2021, 3:37 PM · Save Code Now, Archive coverage, Git loader
ardumont added a revision to T3458: save code now: Requests are not getting updated from time to time: D6408: Stop sending next-gen scheduled task results to scheduler listener.
Oct 5 2021, 9:18 AM · Save Code Now

Oct 4 2021

ardumont added a comment to T3458: save code now: Requests are not getting updated from time to time.

*very old comment not pushed for some reason*

Oct 4 2021, 6:38 PM · Save Code Now
ardumont added a revision to T3458: save code now: Requests are not getting updated from time to time: D6405: Respect task configuration to allow ignoring task result event.
Oct 4 2021, 5:49 PM · Save Code Now

Oct 2 2021

ardumont merged task T3459: save code now: some requests are not getting updated into T3458: save code now: Requests are not getting updated from time to time.
Oct 2 2021, 1:04 PM · Save Code Now
ardumont merged T3459: save code now: some requests are not getting updated into T3458: save code now: Requests are not getting updated from time to time.
Oct 2 2021, 1:04 PM · Save Code Now

Oct 1 2021

ardumont closed T3583: check icinga alert for svn save-code-now as Resolved.

It resolved itself, it's green again.

Oct 1 2021, 6:04 PM · Scheduling utilities, Save Code Now, Monitoring
ardumont closed T3583: check icinga alert for svn save-code-now, a subtask of T3458: save code now: Requests are not getting updated from time to time, as Resolved.
Oct 1 2021, 6:04 PM · Save Code Now

Sep 29 2021

anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

All save requests have been processed, 127 succeeded and 5 failed due to the following issues:

Sep 29 2021, 2:53 PM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

This is the execution result of the script above:

anlambert@carnavalet:~/tmp$ python3 reload_dumb_git_origins.py
{'loading_task_id': 400298414,
 'origin_url': 'https://git.pengutronix.de/cgit/tools/libsocketcan',
 'save_request_date': '2021-09-29T10:07:54.080280+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298415,
 'origin_url': 'https://git.stoutner.com/UltraPrivacy.git',
 'save_request_date': '2021-09-29T10:07:54.507288+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298416,
 'origin_url': 'https://git.stoutner.com/UltraList.git',
 'save_request_date': '2021-09-29T10:07:54.795405+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298417,
 'origin_url': 'https://git.stoutner.com/PrivacyCell.git',
 'save_request_date': '2021-09-29T10:07:54.979121+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298418,
 'origin_url': 'https://git.stoutner.com/PrivacyBrowserROMIntegration.git',
 'save_request_date': '2021-09-29T10:07:55.205037+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298419,
 'origin_url': 'https://git.stoutner.com/PrivacyBrowser.git',
 'save_request_date': '2021-09-29T10:07:55.404696+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298420,
 'origin_url': 'https://git.raptorengineering.com/git/hqemu',
 'save_request_date': '2021-09-29T10:07:55.627926+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298421,
 'origin_url': 'https://forge.touhey.org/casio/packaging.git',
 'save_request_date': '2021-09-29T10:07:55.919487+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298422,
 'origin_url': 'https://forge.touhey.org/casio/libcasio.git',
 'save_request_date': '2021-09-29T10:07:56.202117+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298423,
 'origin_url': 'https://git.tuxfamily.org/harmonist/harmonist.git',
 'save_request_date': '2021-09-29T10:07:56.482737+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298424,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git',
 'save_request_date': '2021-09-29T10:07:57.516829+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298425,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git',
 'save_request_date': '2021-09-29T10:07:57.811821+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298424,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git',
 'save_request_date': '2021-09-29T10:07:57.516829+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298426,
 'origin_url': 'https://depp.brause.cc/nov.el.git',
 'save_request_date': '2021-09-29T10:07:58.360459+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298427,
 'origin_url': 'https://www.6809.org.uk/git/asm6809.git',
 'save_request_date': '2021-09-29T10:07:58.925928+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298428,
 'origin_url': 'http://git.ghostscript.com/mupdf.git',
 'save_request_date': '2021-09-29T10:07:59.179198+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298429,
 'origin_url': 'https://git.joeyh.name/git/oldusenet.git',
 'save_request_date': '2021-09-29T10:07:59.423211+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298430,
 'origin_url': 'https://git.drobilla.net/ganv.git',
 'save_request_date': '2021-09-29T10:07:59.660229+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298431,
 'origin_url': 'https://genome-source.gi.ucsc.edu/samtabix.git',
 'save_request_date': '2021-09-29T10:07:59.901717+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298432,
 'origin_url': 'http://software.legiasoft.com/git/quickcheck.git',
 'save_request_date': '2021-09-29T10:08:00.111266+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298433,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/lziprecover',
 'save_request_date': '2021-09-29T10:08:00.336308+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298434,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/plzip',
 'save_request_date': '2021-09-29T10:08:00.538700+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298435,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/tarlz',
 'save_request_date': '2021-09-29T10:08:00.758586+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298436,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/lzip',
 'save_request_date': '2021-09-29T10:08:00.976973+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298437,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git',
 'save_request_date': '2021-09-29T10:08:01.213923+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298439,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git',
 'save_request_date': '2021-09-29T10:08:01.458344+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298440,
 'origin_url': 'https://git.yoctoproject.org/cgit/cgit.cgi/opkg-utils',
 'save_request_date': '2021-09-29T10:08:01.671555+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298441,
 'origin_url': 'https://c9x.me/git/qbe.git',
 'save_request_date': '2021-09-29T10:08:01.891677+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298442,
 'origin_url': 'https://git.tuxfamily.org/ostorybook/code.git',
 'save_request_date': '2021-09-29T10:08:02.096468+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298444,
 'origin_url': 'https://thingshare.ion.nu/thingshare.git',
 'save_request_date': '2021-09-29T10:08:02.333379+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298445,
 'origin_url': 'https://inqlab.net/git/guile-sodium.git',
 'save_request_date': '2021-09-29T10:08:02.603023+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298446,
 'origin_url': 'https://git.systemreboot.net/guile-xapian',
 'save_request_date': '2021-09-29T10:08:02.980312+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298447,
 'origin_url': 'https://git.netfilter.org/iptables',
 'save_request_date': '2021-09-29T10:08:03.692976+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298448,
 'origin_url': 'https://inqlab.net/git/guile-cbor.git',
 'save_request_date': '2021-09-29T10:08:03.966797+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298449,
 'origin_url': 'https://git.openembedded.org/openembedded-core',
 'save_request_date': '2021-09-29T10:08:04.228102+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298451,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/mcstas.git',
 'save_request_date': '2021-09-29T10:08:04.444651+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298437,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git',
 'save_request_date': '2021-09-29T10:08:01.213923+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298439,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git',
 'save_request_date': '2021-09-29T10:08:01.458344+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298425,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git',
 'save_request_date': '2021-09-29T10:07:57.811821+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298452,
 'origin_url': 'https://git.beyermatthi.as/prometheus-mpd-exporter',
 'save_request_date': '2021-09-29T10:08:05.289687+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298453,
 'origin_url': 'https://git.joeyh.name/git/arduino-copilot.git',
 'save_request_date': '2021-09-29T10:08:05.547289+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298454,
 'origin_url': 'https://git.netfilter.org/libmnl',
 'save_request_date': '2021-09-29T10:08:05.849481+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298455,
 'origin_url': 'https://jff.email/cgit/libunistring.git',
 'save_request_date': '2021-09-29T10:08:06.257710+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298456,
 'origin_url': 'https://inqlab.net/git/eris.git',
 'save_request_date': '2021-09-29T10:08:06.494460+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298457,
 'origin_url': 'https://jff.email/cgit/dmidecode.git',
 'save_request_date': '2021-09-29T10:08:06.776931+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298697,
 'origin_url': 'https://git.tukaani.org/xz.git',
 'save_request_date': '2021-09-29T10:08:06.996597+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298458,
 'origin_url': 'https://git.dthompson.us/guile-parser-combinators.git',
 'save_request_date': '2021-09-29T10:08:07.200536+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298459,
 'origin_url': 'http://git.foldling.org/vim-scheme.git',
 'save_request_date': '2021-09-29T10:08:07.417546+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298460,
 'origin_url': 'https://git.opensvc.com/multipath-tools/.git',
 'save_request_date': '2021-09-29T10:08:07.656692+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298461,
 'origin_url': 'https://git.osmocom.org/rtl-sdr',
 'save_request_date': '2021-09-29T10:08:08.073457+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298463,
 'origin_url': 'http://git.kpe.io/uffi.git',
 'save_request_date': '2021-09-29T10:08:08.438223+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298465,
 'origin_url': 'http://git.kpe.io/clsql.git',
 'save_request_date': '2021-09-29T10:08:09.662233+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298466,
 'origin_url': 'http://git.kpe.io/ptester.git',
 'save_request_date': '2021-09-29T10:08:11.056976+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298467,
 'origin_url': 'https://git.osmocom.org/gr-osmosdr',
 'save_request_date': '2021-09-29T10:08:11.892136+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298468,
 'origin_url': 'https://git.osmocom.org/libosmo-dsp',
 'save_request_date': '2021-09-29T10:08:12.314649+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298469,
 'origin_url': 'http://git.kpe.io/xlunit.git',
 'save_request_date': '2021-09-29T10:08:12.602773+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298470,
 'origin_url': 'http://git.kpe.io/kmrcl.git',
 'save_request_date': '2021-09-29T10:08:13.082206+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298471,
 'origin_url': 'https://git.open-music-kontrollers.ch/lv2/lv2lint',
 'save_request_date': '2021-09-29T10:08:13.630219+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298472,
 'origin_url': 'https://git.systemreboot.net/exiftool.el',
 'save_request_date': '2021-09-29T10:08:14.011802+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298473,
 'origin_url': 'http://git.kpe.io/cl-base64.git',
 'save_request_date': '2021-09-29T10:08:14.521164+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298475,
 'origin_url': 'http://git.savannah.gnu.org/r/gtick.git',
 'save_request_date': '2021-09-29T10:08:15.004437+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298476,
 'origin_url': 'http://git.sv.gnu.org/r/gtick.git',
 'save_request_date': '2021-09-29T10:08:15.279068+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298477,
 'origin_url': 'https://git.osmocom.org/gr-iqbal',
 'save_request_date': '2021-09-29T10:08:15.475285+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298479,
 'origin_url': 'https://git.savannah.gnu.org/r/guix.git',
 'save_request_date': '2021-09-29T10:08:15.755672+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298480,
 'origin_url': 'https://www.cl.cam.ac.uk/~mgk25/git/tripos',
 'save_request_date': '2021-09-29T10:08:16.222379+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298481,
 'origin_url': 'https://www.cl.cam.ac.uk/~mgk25/git/jbigkit',
 'save_request_date': '2021-09-29T10:08:16.425781+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298482,
 'origin_url': 'https://git.rockbox.org/cgit/sandbox.git',
 'save_request_date': '2021-09-29T10:08:16.631493+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298483,
 'origin_url': 'https://git.rockbox.org/cgit/themesite.git',
 'save_request_date': '2021-09-29T10:08:16.856420+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298484,
 'origin_url': 'https://git.rockbox.org/cgit/translate.git',
 'save_request_date': '2021-09-29T10:08:17.059833+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298485,
 'origin_url': 'https://git.rockbox.org/cgit/www.git',
 'save_request_date': '2021-09-29T10:08:17.277452+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298486,
 'origin_url': 'https://git.rockbox.org/cgit/rockbox.git',
 'save_request_date': '2021-09-29T10:08:17.453703+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298487,
 'origin_url': 'https://git.qsomula.top/SUGAR__STRAWBERRIES/SUGAR__AND__STRAWBERRIES.git',
 'save_request_date': '2021-09-29T10:08:17.696238+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298488,
 'origin_url': 'https://source.netsurf-browser.org/alphagen.git',
 'save_request_date': '2021-09-29T10:08:17.905282+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298489,
 'origin_url': 'https://source.netsurf-browser.org/ttf2f.git',
 'save_request_date': '2021-09-29T10:08:18.124307+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298490,
 'origin_url': 'https://source.netsurf-browser.org/toolchains.git',
 'save_request_date': '2021-09-29T10:08:18.332149+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298491,
 'origin_url': 'https://source.netsurf-browser.org/squeeze.git',
 'save_request_date': '2021-09-29T10:08:18.541807+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298492,
 'origin_url': 'https://source.netsurf-browser.org/packaging/fedora.git',
 'save_request_date': '2021-09-29T10:08:18.775088+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298493,
 'origin_url': 'https://source.netsurf-browser.org/packaging/debian.git',
 'save_request_date': '2021-09-29T10:08:18.958225+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298494,
 'origin_url': 'https://source.netsurf-browser.org/nstheme.git',
 'save_request_date': '2021-09-29T10:08:19.163989+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298495,
 'origin_url': 'https://source.netsurf-browser.org/nsgenbind.git',
 'save_request_date': '2021-09-29T10:08:19.383856+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298496,
 'origin_url': 'https://source.netsurf-browser.org/netsurf.git',
 'save_request_date': '2021-09-29T10:08:19.593296+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298497,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-wiki.git',
 'save_request_date': '2021-09-29T10:08:19.800945+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298498,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-website.git',
 'save_request_date': '2021-09-29T10:08:19.997824+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298500,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-test.git',
 'save_request_date': '2021-09-29T10:08:20.747537+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298501,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-all.git',
 'save_request_date': '2021-09-29T10:08:20.948499+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298502,
 'origin_url': 'https://source.netsurf-browser.org/makerun.git',
 'save_request_date': '2021-09-29T10:08:21.168633+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298503,
 'origin_url': 'https://source.netsurf-browser.org/libwapcaplet.git',
 'save_request_date': '2021-09-29T10:08:21.391437+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298504,
 'origin_url': 'https://source.netsurf-browser.org/libutf8proc.git',
 'save_request_date': '2021-09-29T10:08:21.575900+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298506,
 'origin_url': 'https://source.netsurf-browser.org/libsvgtiny.git',
 'save_request_date': '2021-09-29T10:08:21.766147+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298507,
 'origin_url': 'https://source.netsurf-browser.org/librufl.git',
 'save_request_date': '2021-09-29T10:08:21.971342+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298508,
 'origin_url': 'https://source.netsurf-browser.org/librosprite.git',
 'save_request_date': '2021-09-29T10:08:22.163567+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298509,
 'origin_url': 'https://source.netsurf-browser.org/libpencil.git',
 'save_request_date': '2021-09-29T10:08:22.373564+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298510,
 'origin_url': 'https://source.netsurf-browser.org/libparserutils.git',
 'save_request_date': '2021-09-29T10:08:22.544880+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298511,
 'origin_url': 'https://source.netsurf-browser.org/libnsutils.git',
 'save_request_date': '2021-09-29T10:08:22.742637+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298512,
 'origin_url': 'https://source.netsurf-browser.org/libnspsl.git',
 'save_request_date': '2021-09-29T10:08:22.962451+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298513,
 'origin_url': 'https://source.netsurf-browser.org/libnspdf.git',
 'save_request_date': '2021-09-29T10:08:23.146196+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298514,
 'origin_url': 'https://source.netsurf-browser.org/libnslog.git',
 'save_request_date': '2021-09-29T10:08:23.341888+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298515,
 'origin_url': 'https://source.netsurf-browser.org/libnslayout.git',
 'save_request_date': '2021-09-29T10:08:23.541333+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298516,
 'origin_url': 'https://source.netsurf-browser.org/libnsgif.git',
 'save_request_date': '2021-09-29T10:08:23.747382+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298517,
 'origin_url': 'https://source.netsurf-browser.org/libnsfb.git',
 'save_request_date': '2021-09-29T10:08:23.950486+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298518,
 'origin_url': 'https://source.netsurf-browser.org/libnsbmp.git',
 'save_request_date': '2021-09-29T10:08:24.128810+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298519,
 'origin_url': 'https://source.netsurf-browser.org/libhubbub.git',
 'save_request_date': '2021-09-29T10:08:24.335594+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298520,
 'origin_url': 'https://source.netsurf-browser.org/libdom.git',
 'save_request_date': '2021-09-29T10:08:24.557136+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298521,
 'origin_url': 'https://source.netsurf-browser.org/libcss.git',
 'save_request_date': '2021-09-29T10:08:24.760323+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298522,
 'origin_url': 'https://source.netsurf-browser.org/json-c.git',
 'save_request_date': '2021-09-29T10:08:24.999232+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298523,
 'origin_url': 'https://source.netsurf-browser.org/iconv.git',
 'save_request_date': '2021-09-29T10:08:25.178058+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298524,
 'origin_url': 'https://source.netsurf-browser.org/ci-tools.git',
 'save_request_date': '2021-09-29T10:08:25.398196+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298525,
 'origin_url': 'https://source.netsurf-browser.org/buildsystem.git',
 'save_request_date': '2021-09-29T10:08:25.568154+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298526,
 'origin_url': 'https://source.netsurf-browser.org/art.git',
 'save_request_date': '2021-09-29T10:08:25.759202+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298527,
 'origin_url': 'http://galexander.org/git/simplesshd.git',
 'save_request_date': '2021-09-29T10:08:26.002317+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298528,
 'origin_url': 'https://tinc-vpn.org/git/tinc',
 'save_request_date': '2021-09-29T10:08:26.228797+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298529,
 'origin_url': 'https://git.joeyh.name/git/concurrent-output.git',
 'save_request_date': '2021-09-29T10:08:26.428783+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298530,
 'origin_url': 'https://git.joeyh.name/git/brainfuck-monad.git',
 'save_request_date': '2021-09-29T10:08:26.652730+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298532,
 'origin_url': 'https://git.neodarz.net/pro/umosapicpp.git',
 'save_request_date': '2021-09-29T10:08:26.890221+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298533,
 'origin_url': 'https://git.neodarz.net/pro/umosapi.git',
 'save_request_date': '2021-09-29T10:08:27.129709+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298534,
 'origin_url': 'https://git.neodarz.net/neodarz/waveshare-7inch-touchscreen-driver.git',
 'save_request_date': '2021-09-29T10:08:27.295848+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298535,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/feed_finder.git',
 'save_request_date': '2021-09-29T10:08:27.489133+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298536,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/convert.py.git',
 'save_request_date': '2021-09-29T10:08:27.669389+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298537,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/bandcamp-dl_script.git',
 'save_request_date': '2021-09-29T10:08:27.843411+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298538,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/arte.tv-dl.git',
 'save_request_date': '2021-09-29T10:08:28.021717+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298539,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/archlinux_iso_checker.git',
 'save_request_date': '2021-09-29T10:08:28.184597+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298540,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/SimplyQrGen.git',
 'save_request_date': '2021-09-29T10:08:28.359197+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298541,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/EphermalVPN.git',
 'save_request_date': '2021-09-29T10:08:28.549753+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298542,
 'origin_url': 'https://git.neodarz.net/neodarz/school/the_transcriber_backend.git',
 'save_request_date': '2021-09-29T10:08:28.711372+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298543,
 'origin_url': 'https://git.neodarz.net/neodarz/resumejson_converter.git',
 'save_request_date': '2021-09-29T10:08:28.875127+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298544,
 'origin_url': 'https://git.neodarz.net/code_archive/freetorrent.git',
 'save_request_date': '2021-09-29T10:08:29.058812+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298545,
 'origin_url': 'https://git.e2factory.org/git/e2factory.git',
 'save_request_date': '2021-09-29T10:08:29.235115+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298546,
 'origin_url': 'https://git.zap.org.au/git/console-fonts-utils.git',
 'save_request_date': '2021-09-29T10:08:29.485093+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298547,
 'origin_url': 'https://git.zap.org.au/git/console-fonts-lucida.git',
 'save_request_date': '2021-09-29T10:08:29.705671+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298548,
 'origin_url': 'https://git.zap.org.au/git/console-fonts-zap.git',
 'save_request_date': '2021-09-29T10:08:29.896133+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298549,
 'origin_url': 'https://git.zap.org.au/git/trader.git',
 'save_request_date': '2021-09-29T10:08:30.119825+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298550,
 'origin_url': 'http://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git',
 'save_request_date': '2021-09-29T10:08:30.279433+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
Sep 29 2021, 12:20 PM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

We will use the following script to create new save requests for those origins:

reload_dumb_git_origins.py
import os
from pprint import pprint
Sep 29 2021, 12:17 PM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

This is the result of the above script execution:

dumb_git_origins
anlambert@carnavalet:~/tmp$ python3 get_save_code_now_dumb_git_repos.py 2>/dev/null
https://git.pengutronix.de/cgit/tools/libsocketcan
https://git.stoutner.com/UltraPrivacy.git
https://git.stoutner.com/UltraList.git
https://git.stoutner.com/PrivacyCell.git
https://git.stoutner.com/PrivacyBrowserROMIntegration.git
https://git.stoutner.com/PrivacyBrowser.git
https://git.raptorengineering.com/git/hqemu/
https://forge.touhey.org/casio/packaging.git
https://forge.touhey.org/casio/libcasio.git
https://git.tuxfamily.org/harmonist/harmonist.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git/
https://depp.brause.cc/nov.el.git
https://www.6809.org.uk/git/asm6809.git
http://git.ghostscript.com/mupdf.git
https://git.joeyh.name/git/oldusenet.git
https://git.drobilla.net/ganv.git
https://genome-source.gi.ucsc.edu/samtabix.git
http://software.legiasoft.com/git/quickcheck.git
https://git.progress-linux.org/users/daniel.baumann/debian/packages/lziprecover
https://git.progress-linux.org/users/daniel.baumann/debian/packages/plzip
https://git.progress-linux.org/users/daniel.baumann/debian/packages/tarlz
https://git.progress-linux.org/users/daniel.baumann/debian/packages/lzip
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git
https://git.yoctoproject.org/cgit/cgit.cgi/opkg-utils
https://c9x.me/git/qbe.git
https://git.tuxfamily.org/ostorybook/code.git
https://thingshare.ion.nu/thingshare.git/
https://inqlab.net/git/guile-sodium.git
https://git.systemreboot.net/guile-xapian
https://git.netfilter.org/iptables
https://inqlab.net/git/guile-cbor.git
https://git.openembedded.org/openembedded-core
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/mcstas.git/
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git/
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git/
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git/
https://git.beyermatthi.as/prometheus-mpd-exporter
https://git.joeyh.name/git/arduino-copilot.git
https://git.netfilter.org/libmnl/
https://jff.email/cgit/libunistring.git
https://inqlab.net/git/eris.git
https://jff.email/cgit/dmidecode.git
https://git.tukaani.org/xz.git
https://git.dthompson.us/guile-parser-combinators.git
http://git.foldling.org/vim-scheme.git
https://git.opensvc.com/multipath-tools/.git
https://git.osmocom.org/rtl-sdr
http://git.kpe.io/uffi.git
http://git.kpe.io/clsql.git
http://git.kpe.io/ptester.git
https://git.osmocom.org/gr-osmosdr
https://git.osmocom.org/libosmo-dsp
http://git.kpe.io/xlunit.git
http://git.kpe.io/kmrcl.git
https://git.open-music-kontrollers.ch/lv2/lv2lint
https://git.systemreboot.net/exiftool.el
http://git.kpe.io/cl-base64.git
http://git.savannah.gnu.org/r/gtick.git
http://git.sv.gnu.org/r/gtick.git
https://git.osmocom.org/gr-iqbal
https://git.savannah.gnu.org/r/guix.git
https://www.cl.cam.ac.uk/~mgk25/git/tripos/
https://www.cl.cam.ac.uk/~mgk25/git/jbigkit
https://git.rockbox.org/cgit/sandbox.git/
https://git.rockbox.org/cgit/themesite.git/
https://git.rockbox.org/cgit/translate.git/
https://git.rockbox.org/cgit/www.git/
https://git.rockbox.org/cgit/rockbox.git/
https://git.qsomula.top/SUGAR__STRAWBERRIES/SUGAR__AND__STRAWBERRIES.git
https://source.netsurf-browser.org/alphagen.git/
https://source.netsurf-browser.org/ttf2f.git/
https://source.netsurf-browser.org/toolchains.git/
https://source.netsurf-browser.org/squeeze.git/
https://source.netsurf-browser.org/packaging/fedora.git/
https://source.netsurf-browser.org/packaging/debian.git/
https://source.netsurf-browser.org/nstheme.git/
https://source.netsurf-browser.org/nsgenbind.git/
https://source.netsurf-browser.org/netsurf.git/
https://source.netsurf-browser.org/netsurf-wiki.git/
https://source.netsurf-browser.org/netsurf-website.git/
https://source.netsurf-browser.org/netsurf-test.git/
https://source.netsurf-browser.org/netsurf-all.git/
https://source.netsurf-browser.org/makerun.git/
https://source.netsurf-browser.org/libwapcaplet.git/
https://source.netsurf-browser.org/libutf8proc.git/
https://source.netsurf-browser.org/libsvgtiny.git/
https://source.netsurf-browser.org/librufl.git/
https://source.netsurf-browser.org/librosprite.git/
https://source.netsurf-browser.org/libpencil.git/
https://source.netsurf-browser.org/libparserutils.git/
https://source.netsurf-browser.org/libnsutils.git/
https://source.netsurf-browser.org/libnspsl.git/
https://source.netsurf-browser.org/libnspdf.git/
https://source.netsurf-browser.org/libnslog.git/
https://source.netsurf-browser.org/libnslayout.git/
https://source.netsurf-browser.org/libnsgif.git/
https://source.netsurf-browser.org/libnsfb.git/
https://source.netsurf-browser.org/libnsbmp.git/
https://source.netsurf-browser.org/libhubbub.git/
https://source.netsurf-browser.org/libdom.git/
https://source.netsurf-browser.org/libcss.git/
https://source.netsurf-browser.org/json-c.git/
https://source.netsurf-browser.org/iconv.git/
https://source.netsurf-browser.org/ci-tools.git/
https://source.netsurf-browser.org/buildsystem.git/
https://source.netsurf-browser.org/art.git/
http://galexander.org/git/simplesshd.git
https://tinc-vpn.org/git/tinc
https://git.joeyh.name/git/concurrent-output.git
https://git.joeyh.name/git/brainfuck-monad.git
https://git.neodarz.net/pro/umosapicpp.git
https://git.neodarz.net/pro/umosapi.git
https://git.neodarz.net/neodarz/waveshare-7inch-touchscreen-driver.git
https://git.neodarz.net/neodarz/scripts/feed_finder.git
https://git.neodarz.net/neodarz/scripts/convert.py.git
https://git.neodarz.net/neodarz/scripts/bandcamp-dl_script.git
https://git.neodarz.net/neodarz/scripts/arte.tv-dl.git
https://git.neodarz.net/neodarz/scripts/archlinux_iso_checker.git
https://git.neodarz.net/neodarz/scripts/SimplyQrGen.git
https://git.neodarz.net/neodarz/scripts/EphermalVPN.git
https://git.neodarz.net/neodarz/school/the_transcriber_backend.git
https://git.neodarz.net/neodarz/resumejson_converter.git
https://git.neodarz.net/code_archive/freetorrent.git
https://git.e2factory.org/git/e2factory.git
https://git.zap.org.au/git/console-fonts-utils.git
https://git.zap.org.au/git/console-fonts-lucida.git
https://git.zap.org.au/git/console-fonts-zap.git
https://git.zap.org.au/git/trader.git
http://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git/
Sep 29 2021, 11:57 AM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

Afterwards, we use the following script to identify the dumb git origins that can be reloaded:

get_save_code_now_dumb_git_repos.py
import io
import os
Sep 29 2021, 11:54 AM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

Then we copy that dump locally and load it into our development database:

anlambert@carnavalet:~/tmp$ scp anlambert@moma:swh-web-db.json .
swh-web-db.json                                                                                                                                                                                                                                        100%   33MB   5.6MB/s   00:05    
anlambert@carnavalet:~/tmp$ django-admin loaddata --settings swh.web.settings.development swh-web-db.json
Installed 93893 object(s) from 1 fixture(s)
anlambert@carnavalet:~/tmp$
Sep 29 2021, 11:51 AM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

First we need a JSON dump of production database:

anlambert@carnavalet:~/tmp$ ssh anlambert@moma
Linux moma 5.10.0-0.bpo.5-amd64 #1 SMP Debian 5.10.24-1~bpo10+1 (2021-03-29) x86_64
Sep 29 2021, 11:49 AM · Save Code Now, Archive coverage, Git loader
anlambert triaged T3618: Reschedule loading of dumb git origins submitted to "Save code now" service as Normal priority.
Sep 29 2021, 11:21 AM · Save Code Now, Archive coverage, Git loader

Sep 20 2021

anlambert added a revision to T3256: Propose reason for rejecting a save code now: D6311: admin/origin_save: Parse optional note from rejection POST request body.
Sep 20 2021, 5:48 PM · Save Code Now, Easy hack, Web app
anlambert added a revision to T3256: Propose reason for rejecting a save code now: D6309: common/models: Add note text field to SaveOriginRequest model.
Sep 20 2021, 4:00 PM · Save Code Now, Easy hack, Web app

Sep 17 2021

ardumont added a parent task for T3583: check icinga alert for svn save-code-now: T3458: save code now: Requests are not getting updated from time to time.
Sep 17 2021, 9:34 AM · Scheduling utilities, Save Code Now, Monitoring
ardumont added a subtask for T3458: save code now: Requests are not getting updated from time to time: T3583: check icinga alert for svn save-code-now.
Sep 17 2021, 9:34 AM · Save Code Now
ardumont updated the task description for T3583: check icinga alert for svn save-code-now.
Sep 17 2021, 9:33 AM · Scheduling utilities, Save Code Now, Monitoring

Sep 8 2021

anlambert added a comment to T3458: save code now: Requests are not getting updated from time to time.

Indeed some save requests are still marked as running while they clearly are not.

Sep 8 2021, 2:21 PM · Save Code Now

Sep 3 2021

ardumont closed T3546: Status "scheduled" over hours, but archiving doesn't seem to start as Resolved.
Sep 3 2021, 11:28 AM · Save Code Now
ardumont added a comment to T3546: Status "scheduled" over hours, but archiving doesn't seem to start.

I've opened a task to try and monitor this pattern [1].

Sep 3 2021, 11:28 AM · Save Code Now
ardumont triaged T3548: Monitor and raise alert when save code now requests seem unusually long as Normal priority.
Sep 3 2021, 11:27 AM · System administration, Save Code Now, Monitoring
ardumont added a comment to T3546: Status "scheduled" over hours, but archiving doesn't seem to start.

I actually requested https://github.com/tue-alga/CoordinatedSchematization which did
not start for over 45 minutes or so (which is unusual), then noticed that the one
above was also in "scheduled" state over hours and decided to open a task here.

Sep 3 2021, 11:25 AM · Save Code Now
mdidas added a comment to T3546: Status "scheduled" over hours, but archiving doesn't seem to start.

Thanks for the quick help!

Sep 3 2021, 11:22 AM · Save Code Now
mdidas added a comment to T3546: Status "scheduled" over hours, but archiving doesn't seem to start.

I actually requested https://github.com/tue-alga/CoordinatedSchematization which did not start for over 45 minutes or so (which is unusual), then noticed that the one above was also in "scheduled" state over hours and decided to open a task here.

Sep 3 2021, 11:21 AM · Save Code Now
ardumont added a comment to T3546: Status "scheduled" over hours, but archiving doesn't seem to start.

For some unknown reason, that particular origins is scheduled but I don't see any log about that run.
I triggered it back and it got finished almost immediately (uneventful).

Sep 3 2021, 11:20 AM · Save Code Now
ardumont added a comment to T3546: Status "scheduled" over hours, but archiving doesn't seem to start.

(was looking into it)
I'd say this one qualifies (in UTC+2):

Sep 3 2021, 11:09 AM · Save Code Now
vlorentz triaged T3546: Status "scheduled" over hours, but archiving doesn't seem to start as Unbreak Now! priority.

@mdidas what are the repositories you requested?

Sep 3 2021, 10:52 AM · Save Code Now

Sep 1 2021

ardumont added a comment to T1524: save code now: also add new origins for unknown repos.

The scheduler is getting there.
We are now able to trigger a runner for that part:

Sep 1 2021, 6:02 PM · Save Code Now, Web app

Aug 4 2021

ardumont added a project to T3458: save code now: Requests are not getting updated from time to time: Save Code Now.
Aug 4 2021, 11:06 AM · Save Code Now
ardumont renamed T3459: save code now: some requests are not getting updated from save code now: Requests are not getting updated from time to time to save code now: some requests are not getting updated.
Aug 4 2021, 10:50 AM · Save Code Now
ardumont triaged T3459: save code now: some requests are not getting updated as Normal priority.
Aug 4 2021, 10:50 AM · Save Code Now

Jun 28 2021

ardumont closed T3378: Improve save code now status report so the status and browse experience stay consistent, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Jun 28 2021, 1:56 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont closed T3378: Improve save code now status report so the status and browse experience stay consistent as Resolved.

Deployed.

Jun 28 2021, 1:56 PM · Save Code Now
ardumont removed a subtask for T3082: Improve Save Code Now handling: T3256: Propose reason for rejecting a save code now.
Jun 28 2021, 9:39 AM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont added a subtask for T3252: Better handling of erroneous origins submitted to save code now: T3256: Propose reason for rejecting a save code now.
Jun 28 2021, 9:39 AM · System administration, Save Code Now, Web app
ardumont edited parent tasks for T3256: Propose reason for rejecting a save code now, added: T3252: Better handling of erroneous origins submitted to save code now; removed: T3082: Improve Save Code Now handling.
Jun 28 2021, 9:39 AM · Save Code Now, Easy hack, Web app

Jun 25 2021

ardumont closed D5896: save code now: Simplify the request status update computation.
Jun 25 2021, 2:31 PM · Save Code Now
swh-public-ci added a comment to D5896: save code now: Simplify the request status update computation.

Build is green

Jun 25 2021, 2:29 PM · Save Code Now
ardumont added inline comments to D5896: save code now: Simplify the request status update computation.
Jun 25 2021, 2:15 PM · Save Code Now
ardumont updated the diff for D5896: save code now: Simplify the request status update computation.

Adapt according to review

Jun 25 2021, 2:15 PM · Save Code Now
swh-public-ci added a comment to D5896: save code now: Simplify the request status update computation.

Build is green

Jun 25 2021, 11:30 AM · Save Code Now
anlambert accepted D5896: save code now: Simplify the request status update computation.

Looks good to me ! Thanks, the save code now handling code definitely needed some cleanup after all those years.

Jun 25 2021, 11:28 AM · Save Code Now
swh-public-ci added a comment to D5896: save code now: Simplify the request status update computation.

Build has FAILED

Jun 25 2021, 11:16 AM · Save Code Now
swh-public-ci added a comment to D5896: save code now: Simplify the request status update computation.

Build was aborted

Jun 25 2021, 11:05 AM · Save Code Now

Jun 24 2021

ardumont closed T3213: Enable save code now of software source code archives for specific users, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Jun 24 2021, 3:57 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont closed T3213: Enable save code now of software source code archives for specific users as Resolved.
Jun 24 2021, 3:57 PM · Save Code Now, Web app
ardumont added a comment to T3213: Enable save code now of software source code archives for specific users.

The issue mentioned ^ has been fixed and deployed.
Everything is deployed.

Jun 24 2021, 3:57 PM · Save Code Now, Web app
ardumont closed T2750: mercurial loader fails on save code now, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Jun 24 2021, 3:48 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont requested review of D5896: save code now: Simplify the request status update computation.
Jun 24 2021, 3:35 PM · Save Code Now
vlorentz removed a project from T3266: Improve save code now failed/uneventful status reporting: meta-task.
Jun 24 2021, 2:36 PM · Save Code Now, Roadmap 2021, System administrators, Web app

Jun 21 2021

douardda added a comment to T3382: Save process seems to be stuck.

I agree having access to the logs of the task (more or less) in real-time would be very handy (as one can expect on any CI-like tool nowadays).

Jun 21 2021, 10:50 AM · Save Code Now

Jun 18 2021

ardumont added a revision to T3378: Improve save code now status report so the status and browse experience stay consistent: D5896: save code now: Simplify the request status update computation.
Jun 18 2021, 2:58 PM · Save Code Now
ardumont added a subtask for T3082: Improve Save Code Now handling: T3378: Improve save code now status report so the status and browse experience stay consistent.
Jun 18 2021, 2:51 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont added a parent task for T3378: Improve save code now status report so the status and browse experience stay consistent: T3082: Improve Save Code Now handling.
Jun 18 2021, 2:51 PM · Save Code Now
ardumont updated the task description for T3378: Improve save code now status report so the status and browse experience stay consistent.
Jun 18 2021, 12:37 PM · Save Code Now
ardumont claimed T3378: Improve save code now status report so the status and browse experience stay consistent.
Jun 18 2021, 12:36 PM · Save Code Now

Jun 16 2021

ardumont added a comment to T1524: save code now: also add new origins for unknown repos.

Remain the runner to actually consume those regularly to be deployed (or maybe it's already the case, i need to check that part).

Jun 16 2021, 3:27 PM · Save Code Now, Web app
ardumont added a comment to T1524: save code now: also add new origins for unknown repos.

The first part got deployed (modification in the webapp routines to update the save code
now statuses).

Jun 16 2021, 8:38 AM · Save Code Now, Web app

Jun 15 2021

zack updated subscribers of T3382: Save process seems to be stuck.

Thanks @ardumont for following up to this task.

Jun 15 2021, 4:27 PM · Save Code Now
ardumont added a revision to T1524: save code now: also add new origins for unknown repos: D5874: web: Configure instance_name configuration key per webapp instance.
Jun 15 2021, 4:07 PM · Save Code Now, Web app
ardumont added a revision to T1524: save code now: also add new origins for unknown repos: D5873: web: Add the instance_name configuration key.
Jun 15 2021, 4:01 PM · Save Code Now, Web app
ardumont closed T3382: Save process seems to be stuck as Resolved.

Sure.

Jun 15 2021, 3:50 PM · Save Code Now
mwagner added a comment to T3382: Save process seems to be stuck.

Perfect. Thanks for the support!

Jun 15 2021, 3:46 PM · Save Code Now
ardumont added a comment to T3382: Save process seems to be stuck.

It recently finished:

Jun 15 13:10:29 worker02 python3[2461343]: [2021-06-15 13:10:29,513: INFO/ForkPoolWorker-1] Task swh.loader.git.tasks.UpdateGitRepository[4b1cdb75-952f-4949-b95f-67259c5bfb62] succeeded in 22746.730732845142s: {'status': 'eventful'}
Jun 15 2021, 3:38 PM · Save Code Now
ardumont updated the task description for T3382: Save process seems to be stuck.
Jun 15 2021, 12:26 PM · Save Code Now
ardumont added a project to T3382: Save process seems to be stuck: Save Code Now.
Jun 15 2021, 12:26 PM · Save Code Now

Jun 14 2021

anlambert closed T3365: save code now: Failure to ingest new 'archives' type when head response is incomplete as Resolved.

Issue has been resolved and tarballs hosted on the Internet Archive can now be properly loaded in production (see example).

Jun 14 2021, 3:28 PM · Save Code Now

Jun 11 2021

rdicosmo added a comment to T3365: save code now: Failure to ingest new 'archives' type when head response is incomplete.

Great, it seems we are getting there :-)

Jun 11 2021, 5:40 PM · Save Code Now
ardumont added a project to T3378: Improve save code now status report so the status and browse experience stay consistent: Save Code Now.
Jun 11 2021, 5:27 PM · Save Code Now
anlambert added a comment to T3365: save code now: Failure to ingest new 'archives' type when head response is incomplete.

Fix implemented in D5859 works \o/

Jun 11 2021, 5:11 PM · Save Code Now
anlambert added a revision to T3365: save code now: Failure to ingest new 'archives' type when head response is incomplete: D5859: common/origin_save/origin_exists: Handle Internet Archive artifact URLs.
Jun 11 2021, 4:43 PM · Save Code Now
ardumont added a revision to T1524: save code now: also add new origins for unknown repos: D5858: Schedule save code now as recurring origins to ingest when successful.
Jun 11 2021, 4:06 PM · Save Code Now, Web app
ardumont added a comment to T1524: save code now: also add new origins for unknown repos.

It is possibly also the only reasonable place where we can have heuristics to
de-duplicate URLs that point to the same repo, e.g., non-canonical GitHub repos URLs.

Jun 11 2021, 3:35 PM · Save Code Now, Web app
anlambert added a comment to T3365: save code now: Failure to ingest new 'archives' type when head response is incomplete.

I just figured out that data we are missing (Content-Length, Last-Modified) from tarballs archived by the Internet archive are in fact available in x-archive-orig-* HTTP response headers

Jun 11 2021, 2:59 PM · Save Code Now
ardumont closed T3361: "Save code now" seems to be stuck as Resolved.

This task led to an internal improvment so thanks for the heads up.

Jun 11 2021, 12:02 PM · Save Code Now
ardumont closed T3367: scheduler: Separate scheduling save code now tasks from the recurrent tasks as Resolved.
Jun 11 2021, 11:59 AM · System administration, Scheduling utilities, Save Code Now
ardumont moved T3367: scheduler: Separate scheduling save code now tasks from the recurrent tasks from deployed/landed to done on the System administration board.
Jun 11 2021, 11:59 AM · System administration, Scheduling utilities, Save Code Now