Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 5 2021

anlambert committed rDWAPPSf2765a820add: tests: Wrap users creation in pytest fixtures (authored by anlambert).
tests: Wrap users creation in pytest fixtures
Oct 5 2021, 2:57 PM
anlambert requested review of D6411: tests: Wrap users creation in pytest fixtures.
Oct 5 2021, 2:38 PM
anlambert triaged T3631: Make snapshot query parameter mandatory when browsing objects in an origin context as Normal priority.
Oct 5 2021, 11:44 AM · Web app
anlambert added inline comments to D6382: make "yarn install" non-fatal in swh-web entrypoint.
Oct 5 2021, 11:06 AM
anlambert requested changes to D6382: make "yarn install" non-fatal in swh-web entrypoint.

Looks good to me apart the warning message that is not correct.

Oct 5 2021, 11:02 AM
anlambert accepted D6407: Adapt logrotate configuration so extra directory is also logrotated.

+1, thanks !

Oct 5 2021, 10:50 AM
anlambert added a comment to T3608: Deprecate most of the /browse/origin/.* URLs.

The issue is, the redirected url (/browse/directory/<sha1>?origin_url=<>) will call the same function (get_snapshot_context) again. This is true for all the urls.
Do you see some other efficient alternative to fix this ticket?

Oct 5 2021, 10:32 AM · Web app

Oct 1 2021

anlambert accepted D6391: Add specific test to the filtering branch function.
Oct 1 2021, 5:32 PM
anlambert closed D6390: search: Add query language support for staff users.
Oct 1 2021, 3:57 PM
anlambert committed rDWAPPSd7ed7cae590d: search: Add query language support for staff users (authored by anlambert).
search: Add query language support for staff users
Oct 1 2021, 3:57 PM
anlambert updated the diff for D6390: search: Add query language support for staff users.

Rebase

Oct 1 2021, 3:36 PM
anlambert added a comment to D6390: search: Add query language support for staff users.

Oh, I forgot we already had the code for this. Thanks :)

Oct 1 2021, 3:34 PM
anlambert requested review of D6390: search: Add query language support for staff users.
Oct 1 2021, 3:18 PM
anlambert added a revision to T2254: textual search language for the Web UI: D6390: search: Add query language support for staff users.
Oct 1 2021, 3:03 PM · Archive search, Web app
anlambert added a comment to D6372: Replace Sqlite with Postgres in unit tests.

Fixed the issue in timestamp comparison

Oct 1 2021, 2:14 PM
anlambert accepted D6385: git: Add debugging log around the packfile retrieval step.

Looks good to me !

Oct 1 2021, 1:13 PM
anlambert added inline comments to D6385: git: Add debugging log around the packfile retrieval step.
Oct 1 2021, 12:58 PM
anlambert accepted D6372: Replace Sqlite with Postgres in unit tests.

Looks good to me, I added two nitpick comments for small improvements.

Oct 1 2021, 12:35 PM
anlambert added a comment to D6377: wip: git: Group objects per type early to drop the packfile reference asap.

I truly doubt that proceeding like this will optimize the memory consumption of the loader as objects in a pack file are gzip compressed and usually deltified to optimize size.

Oct 1 2021, 10:19 AM

Sep 29 2021

anlambert accepted D6373: svn: Capture svnrdump failure as not_found instead of failed.

Looks good to me !

Sep 29 2021, 7:16 PM
anlambert requested changes to D6373: svn: Capture svnrdump failure as not_found instead of failed.

Wrong variable used in code (see inline comment), I will accept the diff afterwards.

Sep 29 2021, 7:07 PM
anlambert requested changes to D6373: svn: Capture svnrdump failure as not_found instead of failed.

We should capture all svn errors in order to:

  • raise exception based on an error code
  • give more details about the failure by appending error messages to fallback exception
Sep 29 2021, 6:50 PM
anlambert closed D6375: misc/coverage: Add opam to listed origins.
Sep 29 2021, 6:35 PM
anlambert committed rDWAPPS784340803774: misc/coverage: Add opam to listed origins (authored by anlambert).
misc/coverage: Add opam to listed origins
Sep 29 2021, 6:35 PM
anlambert requested review of D6375: misc/coverage: Add opam to listed origins.
Sep 29 2021, 3:50 PM
anlambert closed D6374: query_language/tokens.js: Add new visit types.
Sep 29 2021, 3:48 PM
anlambert committed rDSEAf8385df40249: query_language/tokens.js: Add new visit types (authored by anlambert).
query_language/tokens.js: Add new visit types
Sep 29 2021, 3:48 PM
anlambert retitled D6374: query_language/tokens.js: Add new visit types from query_language/tokens.js: Add opam visit type to query_language/tokens.js: Add new visit types.
Sep 29 2021, 3:43 PM
anlambert updated the diff for D6374: query_language/tokens.js: Add new visit types.

Update: Also add bzr and cvs visit types.

Sep 29 2021, 3:42 PM
anlambert added a comment to D6374: query_language/tokens.js: Add new visit types.

ok for me.

Don't we want to add bzr and cvs immediately though?

Sep 29 2021, 3:39 PM
anlambert added a revision to T3424: Opam support: D6375: misc/coverage: Add opam to listed origins.
Sep 29 2021, 3:34 PM · Archive coverage, Opam
anlambert committed rDWAPPS67b334e4e22f: mypy.ini: Skip psycopg2 typing analysis (authored by anlambert).
mypy.ini: Skip psycopg2 typing analysis
Sep 29 2021, 3:32 PM
anlambert added a revision to T3424: Opam support: D6374: query_language/tokens.js: Add new visit types.
Sep 29 2021, 3:27 PM · Archive coverage, Opam
anlambert updated the summary of D6374: query_language/tokens.js: Add new visit types.
Sep 29 2021, 3:27 PM
anlambert requested review of D6374: query_language/tokens.js: Add new visit types.
Sep 29 2021, 3:21 PM
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

All save requests have been processed, 127 succeeded and 5 failed due to the following issues:

Sep 29 2021, 2:53 PM · Save Code Now, Archive coverage, Git loader
anlambert added inline comments to D6373: svn: Capture svnrdump failure as not_found instead of failed.
Sep 29 2021, 2:48 PM
anlambert committed rDWAPPS36f7ed0e5dae: settings/common: Filter out debug logs of swh.core.statsd (authored by anlambert).
settings/common: Filter out debug logs of swh.core.statsd
Sep 29 2021, 1:29 PM
anlambert closed D6371: common/converters: Filter out id field when converting Origin model.
Sep 29 2021, 1:29 PM
anlambert committed rDWAPPSed98e5f8b5ff: common/converters: Filter out id field when converting Origin model (authored by anlambert).
common/converters: Filter out id field when converting Origin model
Sep 29 2021, 1:29 PM
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

This is the execution result of the script above:

anlambert@carnavalet:~/tmp$ python3 reload_dumb_git_origins.py
{'loading_task_id': 400298414,
 'origin_url': 'https://git.pengutronix.de/cgit/tools/libsocketcan',
 'save_request_date': '2021-09-29T10:07:54.080280+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298415,
 'origin_url': 'https://git.stoutner.com/UltraPrivacy.git',
 'save_request_date': '2021-09-29T10:07:54.507288+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298416,
 'origin_url': 'https://git.stoutner.com/UltraList.git',
 'save_request_date': '2021-09-29T10:07:54.795405+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298417,
 'origin_url': 'https://git.stoutner.com/PrivacyCell.git',
 'save_request_date': '2021-09-29T10:07:54.979121+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298418,
 'origin_url': 'https://git.stoutner.com/PrivacyBrowserROMIntegration.git',
 'save_request_date': '2021-09-29T10:07:55.205037+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298419,
 'origin_url': 'https://git.stoutner.com/PrivacyBrowser.git',
 'save_request_date': '2021-09-29T10:07:55.404696+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298420,
 'origin_url': 'https://git.raptorengineering.com/git/hqemu',
 'save_request_date': '2021-09-29T10:07:55.627926+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298421,
 'origin_url': 'https://forge.touhey.org/casio/packaging.git',
 'save_request_date': '2021-09-29T10:07:55.919487+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298422,
 'origin_url': 'https://forge.touhey.org/casio/libcasio.git',
 'save_request_date': '2021-09-29T10:07:56.202117+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298423,
 'origin_url': 'https://git.tuxfamily.org/harmonist/harmonist.git',
 'save_request_date': '2021-09-29T10:07:56.482737+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298424,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git',
 'save_request_date': '2021-09-29T10:07:57.516829+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298425,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git',
 'save_request_date': '2021-09-29T10:07:57.811821+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298424,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git',
 'save_request_date': '2021-09-29T10:07:57.516829+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298426,
 'origin_url': 'https://depp.brause.cc/nov.el.git',
 'save_request_date': '2021-09-29T10:07:58.360459+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298427,
 'origin_url': 'https://www.6809.org.uk/git/asm6809.git',
 'save_request_date': '2021-09-29T10:07:58.925928+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298428,
 'origin_url': 'http://git.ghostscript.com/mupdf.git',
 'save_request_date': '2021-09-29T10:07:59.179198+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298429,
 'origin_url': 'https://git.joeyh.name/git/oldusenet.git',
 'save_request_date': '2021-09-29T10:07:59.423211+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298430,
 'origin_url': 'https://git.drobilla.net/ganv.git',
 'save_request_date': '2021-09-29T10:07:59.660229+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298431,
 'origin_url': 'https://genome-source.gi.ucsc.edu/samtabix.git',
 'save_request_date': '2021-09-29T10:07:59.901717+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298432,
 'origin_url': 'http://software.legiasoft.com/git/quickcheck.git',
 'save_request_date': '2021-09-29T10:08:00.111266+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298433,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/lziprecover',
 'save_request_date': '2021-09-29T10:08:00.336308+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298434,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/plzip',
 'save_request_date': '2021-09-29T10:08:00.538700+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298435,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/tarlz',
 'save_request_date': '2021-09-29T10:08:00.758586+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298436,
 'origin_url': 'https://git.progress-linux.org/users/daniel.baumann/debian/packages/lzip',
 'save_request_date': '2021-09-29T10:08:00.976973+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298437,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git',
 'save_request_date': '2021-09-29T10:08:01.213923+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298439,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git',
 'save_request_date': '2021-09-29T10:08:01.458344+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298440,
 'origin_url': 'https://git.yoctoproject.org/cgit/cgit.cgi/opkg-utils',
 'save_request_date': '2021-09-29T10:08:01.671555+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298441,
 'origin_url': 'https://c9x.me/git/qbe.git',
 'save_request_date': '2021-09-29T10:08:01.891677+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298442,
 'origin_url': 'https://git.tuxfamily.org/ostorybook/code.git',
 'save_request_date': '2021-09-29T10:08:02.096468+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298444,
 'origin_url': 'https://thingshare.ion.nu/thingshare.git',
 'save_request_date': '2021-09-29T10:08:02.333379+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298445,
 'origin_url': 'https://inqlab.net/git/guile-sodium.git',
 'save_request_date': '2021-09-29T10:08:02.603023+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298446,
 'origin_url': 'https://git.systemreboot.net/guile-xapian',
 'save_request_date': '2021-09-29T10:08:02.980312+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298447,
 'origin_url': 'https://git.netfilter.org/iptables',
 'save_request_date': '2021-09-29T10:08:03.692976+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298448,
 'origin_url': 'https://inqlab.net/git/guile-cbor.git',
 'save_request_date': '2021-09-29T10:08:03.966797+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298449,
 'origin_url': 'https://git.openembedded.org/openembedded-core',
 'save_request_date': '2021-09-29T10:08:04.228102+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298451,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/mcstas.git',
 'save_request_date': '2021-09-29T10:08:04.444651+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298437,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git',
 'save_request_date': '2021-09-29T10:08:01.213923+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298439,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git',
 'save_request_date': '2021-09-29T10:08:01.458344+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298425,
 'origin_url': 'https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git',
 'save_request_date': '2021-09-29T10:07:57.811821+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298452,
 'origin_url': 'https://git.beyermatthi.as/prometheus-mpd-exporter',
 'save_request_date': '2021-09-29T10:08:05.289687+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298453,
 'origin_url': 'https://git.joeyh.name/git/arduino-copilot.git',
 'save_request_date': '2021-09-29T10:08:05.547289+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298454,
 'origin_url': 'https://git.netfilter.org/libmnl',
 'save_request_date': '2021-09-29T10:08:05.849481+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298455,
 'origin_url': 'https://jff.email/cgit/libunistring.git',
 'save_request_date': '2021-09-29T10:08:06.257710+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298456,
 'origin_url': 'https://inqlab.net/git/eris.git',
 'save_request_date': '2021-09-29T10:08:06.494460+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298457,
 'origin_url': 'https://jff.email/cgit/dmidecode.git',
 'save_request_date': '2021-09-29T10:08:06.776931+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298697,
 'origin_url': 'https://git.tukaani.org/xz.git',
 'save_request_date': '2021-09-29T10:08:06.996597+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298458,
 'origin_url': 'https://git.dthompson.us/guile-parser-combinators.git',
 'save_request_date': '2021-09-29T10:08:07.200536+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298459,
 'origin_url': 'http://git.foldling.org/vim-scheme.git',
 'save_request_date': '2021-09-29T10:08:07.417546+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298460,
 'origin_url': 'https://git.opensvc.com/multipath-tools/.git',
 'save_request_date': '2021-09-29T10:08:07.656692+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298461,
 'origin_url': 'https://git.osmocom.org/rtl-sdr',
 'save_request_date': '2021-09-29T10:08:08.073457+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298463,
 'origin_url': 'http://git.kpe.io/uffi.git',
 'save_request_date': '2021-09-29T10:08:08.438223+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298465,
 'origin_url': 'http://git.kpe.io/clsql.git',
 'save_request_date': '2021-09-29T10:08:09.662233+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298466,
 'origin_url': 'http://git.kpe.io/ptester.git',
 'save_request_date': '2021-09-29T10:08:11.056976+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298467,
 'origin_url': 'https://git.osmocom.org/gr-osmosdr',
 'save_request_date': '2021-09-29T10:08:11.892136+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298468,
 'origin_url': 'https://git.osmocom.org/libosmo-dsp',
 'save_request_date': '2021-09-29T10:08:12.314649+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298469,
 'origin_url': 'http://git.kpe.io/xlunit.git',
 'save_request_date': '2021-09-29T10:08:12.602773+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298470,
 'origin_url': 'http://git.kpe.io/kmrcl.git',
 'save_request_date': '2021-09-29T10:08:13.082206+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298471,
 'origin_url': 'https://git.open-music-kontrollers.ch/lv2/lv2lint',
 'save_request_date': '2021-09-29T10:08:13.630219+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298472,
 'origin_url': 'https://git.systemreboot.net/exiftool.el',
 'save_request_date': '2021-09-29T10:08:14.011802+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298473,
 'origin_url': 'http://git.kpe.io/cl-base64.git',
 'save_request_date': '2021-09-29T10:08:14.521164+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298475,
 'origin_url': 'http://git.savannah.gnu.org/r/gtick.git',
 'save_request_date': '2021-09-29T10:08:15.004437+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298476,
 'origin_url': 'http://git.sv.gnu.org/r/gtick.git',
 'save_request_date': '2021-09-29T10:08:15.279068+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298477,
 'origin_url': 'https://git.osmocom.org/gr-iqbal',
 'save_request_date': '2021-09-29T10:08:15.475285+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298479,
 'origin_url': 'https://git.savannah.gnu.org/r/guix.git',
 'save_request_date': '2021-09-29T10:08:15.755672+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298480,
 'origin_url': 'https://www.cl.cam.ac.uk/~mgk25/git/tripos',
 'save_request_date': '2021-09-29T10:08:16.222379+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298481,
 'origin_url': 'https://www.cl.cam.ac.uk/~mgk25/git/jbigkit',
 'save_request_date': '2021-09-29T10:08:16.425781+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298482,
 'origin_url': 'https://git.rockbox.org/cgit/sandbox.git',
 'save_request_date': '2021-09-29T10:08:16.631493+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298483,
 'origin_url': 'https://git.rockbox.org/cgit/themesite.git',
 'save_request_date': '2021-09-29T10:08:16.856420+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298484,
 'origin_url': 'https://git.rockbox.org/cgit/translate.git',
 'save_request_date': '2021-09-29T10:08:17.059833+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298485,
 'origin_url': 'https://git.rockbox.org/cgit/www.git',
 'save_request_date': '2021-09-29T10:08:17.277452+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298486,
 'origin_url': 'https://git.rockbox.org/cgit/rockbox.git',
 'save_request_date': '2021-09-29T10:08:17.453703+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298487,
 'origin_url': 'https://git.qsomula.top/SUGAR__STRAWBERRIES/SUGAR__AND__STRAWBERRIES.git',
 'save_request_date': '2021-09-29T10:08:17.696238+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298488,
 'origin_url': 'https://source.netsurf-browser.org/alphagen.git',
 'save_request_date': '2021-09-29T10:08:17.905282+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298489,
 'origin_url': 'https://source.netsurf-browser.org/ttf2f.git',
 'save_request_date': '2021-09-29T10:08:18.124307+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298490,
 'origin_url': 'https://source.netsurf-browser.org/toolchains.git',
 'save_request_date': '2021-09-29T10:08:18.332149+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298491,
 'origin_url': 'https://source.netsurf-browser.org/squeeze.git',
 'save_request_date': '2021-09-29T10:08:18.541807+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298492,
 'origin_url': 'https://source.netsurf-browser.org/packaging/fedora.git',
 'save_request_date': '2021-09-29T10:08:18.775088+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298493,
 'origin_url': 'https://source.netsurf-browser.org/packaging/debian.git',
 'save_request_date': '2021-09-29T10:08:18.958225+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298494,
 'origin_url': 'https://source.netsurf-browser.org/nstheme.git',
 'save_request_date': '2021-09-29T10:08:19.163989+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298495,
 'origin_url': 'https://source.netsurf-browser.org/nsgenbind.git',
 'save_request_date': '2021-09-29T10:08:19.383856+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298496,
 'origin_url': 'https://source.netsurf-browser.org/netsurf.git',
 'save_request_date': '2021-09-29T10:08:19.593296+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298497,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-wiki.git',
 'save_request_date': '2021-09-29T10:08:19.800945+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298498,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-website.git',
 'save_request_date': '2021-09-29T10:08:19.997824+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298500,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-test.git',
 'save_request_date': '2021-09-29T10:08:20.747537+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298501,
 'origin_url': 'https://source.netsurf-browser.org/netsurf-all.git',
 'save_request_date': '2021-09-29T10:08:20.948499+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298502,
 'origin_url': 'https://source.netsurf-browser.org/makerun.git',
 'save_request_date': '2021-09-29T10:08:21.168633+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298503,
 'origin_url': 'https://source.netsurf-browser.org/libwapcaplet.git',
 'save_request_date': '2021-09-29T10:08:21.391437+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298504,
 'origin_url': 'https://source.netsurf-browser.org/libutf8proc.git',
 'save_request_date': '2021-09-29T10:08:21.575900+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298506,
 'origin_url': 'https://source.netsurf-browser.org/libsvgtiny.git',
 'save_request_date': '2021-09-29T10:08:21.766147+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298507,
 'origin_url': 'https://source.netsurf-browser.org/librufl.git',
 'save_request_date': '2021-09-29T10:08:21.971342+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298508,
 'origin_url': 'https://source.netsurf-browser.org/librosprite.git',
 'save_request_date': '2021-09-29T10:08:22.163567+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298509,
 'origin_url': 'https://source.netsurf-browser.org/libpencil.git',
 'save_request_date': '2021-09-29T10:08:22.373564+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298510,
 'origin_url': 'https://source.netsurf-browser.org/libparserutils.git',
 'save_request_date': '2021-09-29T10:08:22.544880+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298511,
 'origin_url': 'https://source.netsurf-browser.org/libnsutils.git',
 'save_request_date': '2021-09-29T10:08:22.742637+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298512,
 'origin_url': 'https://source.netsurf-browser.org/libnspsl.git',
 'save_request_date': '2021-09-29T10:08:22.962451+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298513,
 'origin_url': 'https://source.netsurf-browser.org/libnspdf.git',
 'save_request_date': '2021-09-29T10:08:23.146196+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298514,
 'origin_url': 'https://source.netsurf-browser.org/libnslog.git',
 'save_request_date': '2021-09-29T10:08:23.341888+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298515,
 'origin_url': 'https://source.netsurf-browser.org/libnslayout.git',
 'save_request_date': '2021-09-29T10:08:23.541333+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298516,
 'origin_url': 'https://source.netsurf-browser.org/libnsgif.git',
 'save_request_date': '2021-09-29T10:08:23.747382+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298517,
 'origin_url': 'https://source.netsurf-browser.org/libnsfb.git',
 'save_request_date': '2021-09-29T10:08:23.950486+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298518,
 'origin_url': 'https://source.netsurf-browser.org/libnsbmp.git',
 'save_request_date': '2021-09-29T10:08:24.128810+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298519,
 'origin_url': 'https://source.netsurf-browser.org/libhubbub.git',
 'save_request_date': '2021-09-29T10:08:24.335594+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298520,
 'origin_url': 'https://source.netsurf-browser.org/libdom.git',
 'save_request_date': '2021-09-29T10:08:24.557136+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298521,
 'origin_url': 'https://source.netsurf-browser.org/libcss.git',
 'save_request_date': '2021-09-29T10:08:24.760323+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298522,
 'origin_url': 'https://source.netsurf-browser.org/json-c.git',
 'save_request_date': '2021-09-29T10:08:24.999232+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298523,
 'origin_url': 'https://source.netsurf-browser.org/iconv.git',
 'save_request_date': '2021-09-29T10:08:25.178058+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298524,
 'origin_url': 'https://source.netsurf-browser.org/ci-tools.git',
 'save_request_date': '2021-09-29T10:08:25.398196+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298525,
 'origin_url': 'https://source.netsurf-browser.org/buildsystem.git',
 'save_request_date': '2021-09-29T10:08:25.568154+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298526,
 'origin_url': 'https://source.netsurf-browser.org/art.git',
 'save_request_date': '2021-09-29T10:08:25.759202+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298527,
 'origin_url': 'http://galexander.org/git/simplesshd.git',
 'save_request_date': '2021-09-29T10:08:26.002317+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298528,
 'origin_url': 'https://tinc-vpn.org/git/tinc',
 'save_request_date': '2021-09-29T10:08:26.228797+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298529,
 'origin_url': 'https://git.joeyh.name/git/concurrent-output.git',
 'save_request_date': '2021-09-29T10:08:26.428783+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298530,
 'origin_url': 'https://git.joeyh.name/git/brainfuck-monad.git',
 'save_request_date': '2021-09-29T10:08:26.652730+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298532,
 'origin_url': 'https://git.neodarz.net/pro/umosapicpp.git',
 'save_request_date': '2021-09-29T10:08:26.890221+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298533,
 'origin_url': 'https://git.neodarz.net/pro/umosapi.git',
 'save_request_date': '2021-09-29T10:08:27.129709+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298534,
 'origin_url': 'https://git.neodarz.net/neodarz/waveshare-7inch-touchscreen-driver.git',
 'save_request_date': '2021-09-29T10:08:27.295848+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298535,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/feed_finder.git',
 'save_request_date': '2021-09-29T10:08:27.489133+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298536,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/convert.py.git',
 'save_request_date': '2021-09-29T10:08:27.669389+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298537,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/bandcamp-dl_script.git',
 'save_request_date': '2021-09-29T10:08:27.843411+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298538,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/arte.tv-dl.git',
 'save_request_date': '2021-09-29T10:08:28.021717+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298539,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/archlinux_iso_checker.git',
 'save_request_date': '2021-09-29T10:08:28.184597+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298540,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/SimplyQrGen.git',
 'save_request_date': '2021-09-29T10:08:28.359197+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298541,
 'origin_url': 'https://git.neodarz.net/neodarz/scripts/EphermalVPN.git',
 'save_request_date': '2021-09-29T10:08:28.549753+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298542,
 'origin_url': 'https://git.neodarz.net/neodarz/school/the_transcriber_backend.git',
 'save_request_date': '2021-09-29T10:08:28.711372+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298543,
 'origin_url': 'https://git.neodarz.net/neodarz/resumejson_converter.git',
 'save_request_date': '2021-09-29T10:08:28.875127+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298544,
 'origin_url': 'https://git.neodarz.net/code_archive/freetorrent.git',
 'save_request_date': '2021-09-29T10:08:29.058812+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298545,
 'origin_url': 'https://git.e2factory.org/git/e2factory.git',
 'save_request_date': '2021-09-29T10:08:29.235115+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298546,
 'origin_url': 'https://git.zap.org.au/git/console-fonts-utils.git',
 'save_request_date': '2021-09-29T10:08:29.485093+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298547,
 'origin_url': 'https://git.zap.org.au/git/console-fonts-lucida.git',
 'save_request_date': '2021-09-29T10:08:29.705671+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298548,
 'origin_url': 'https://git.zap.org.au/git/console-fonts-zap.git',
 'save_request_date': '2021-09-29T10:08:29.896133+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298549,
 'origin_url': 'https://git.zap.org.au/git/trader.git',
 'save_request_date': '2021-09-29T10:08:30.119825+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
{'loading_task_id': 400298550,
 'origin_url': 'http://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git',
 'save_request_date': '2021-09-29T10:08:30.279433+00:00',
 'save_request_status': 'accepted',
 'save_task_status': 'not yet scheduled',
 'visit_date': None,
 'visit_status': None,
 'visit_type': 'git'}
Sep 29 2021, 12:20 PM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

We will use the following script to create new save requests for those origins:

reload_dumb_git_origins.py
import os
from pprint import pprint
Sep 29 2021, 12:17 PM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

This is the result of the above script execution:

dumb_git_origins
anlambert@carnavalet:~/tmp$ python3 get_save_code_now_dumb_git_repos.py 2>/dev/null
https://git.pengutronix.de/cgit/tools/libsocketcan
https://git.stoutner.com/UltraPrivacy.git
https://git.stoutner.com/UltraList.git
https://git.stoutner.com/PrivacyCell.git
https://git.stoutner.com/PrivacyBrowserROMIntegration.git
https://git.stoutner.com/PrivacyBrowser.git
https://git.raptorengineering.com/git/hqemu/
https://forge.touhey.org/casio/packaging.git
https://forge.touhey.org/casio/libcasio.git
https://git.tuxfamily.org/harmonist/harmonist.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tlibs.git/
https://depp.brause.cc/nov.el.git
https://www.6809.org.uk/git/asm6809.git
http://git.ghostscript.com/mupdf.git
https://git.joeyh.name/git/oldusenet.git
https://git.drobilla.net/ganv.git
https://genome-source.gi.ucsc.edu/samtabix.git
http://software.legiasoft.com/git/quickcheck.git
https://git.progress-linux.org/users/daniel.baumann/debian/packages/lziprecover
https://git.progress-linux.org/users/daniel.baumann/debian/packages/plzip
https://git.progress-linux.org/users/daniel.baumann/debian/packages/tarlz
https://git.progress-linux.org/users/daniel.baumann/debian/packages/lzip
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git
https://git.yoctoproject.org/cgit/cgit.cgi/opkg-utils
https://c9x.me/git/qbe.git
https://git.tuxfamily.org/ostorybook/code.git
https://thingshare.ion.nu/thingshare.git/
https://inqlab.net/git/guile-sodium.git
https://git.systemreboot.net/guile-xapian
https://git.netfilter.org/iptables
https://inqlab.net/git/guile-cbor.git
https://git.openembedded.org/openembedded-core
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/mcstas.git/
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/takin-data.git/
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/tastools.git/
https://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git/
https://git.beyermatthi.as/prometheus-mpd-exporter
https://git.joeyh.name/git/arduino-copilot.git
https://git.netfilter.org/libmnl/
https://jff.email/cgit/libunistring.git
https://inqlab.net/git/eris.git
https://jff.email/cgit/dmidecode.git
https://git.tukaani.org/xz.git
https://git.dthompson.us/guile-parser-combinators.git
http://git.foldling.org/vim-scheme.git
https://git.opensvc.com/multipath-tools/.git
https://git.osmocom.org/rtl-sdr
http://git.kpe.io/uffi.git
http://git.kpe.io/clsql.git
http://git.kpe.io/ptester.git
https://git.osmocom.org/gr-osmosdr
https://git.osmocom.org/libosmo-dsp
http://git.kpe.io/xlunit.git
http://git.kpe.io/kmrcl.git
https://git.open-music-kontrollers.ch/lv2/lv2lint
https://git.systemreboot.net/exiftool.el
http://git.kpe.io/cl-base64.git
http://git.savannah.gnu.org/r/gtick.git
http://git.sv.gnu.org/r/gtick.git
https://git.osmocom.org/gr-iqbal
https://git.savannah.gnu.org/r/guix.git
https://www.cl.cam.ac.uk/~mgk25/git/tripos/
https://www.cl.cam.ac.uk/~mgk25/git/jbigkit
https://git.rockbox.org/cgit/sandbox.git/
https://git.rockbox.org/cgit/themesite.git/
https://git.rockbox.org/cgit/translate.git/
https://git.rockbox.org/cgit/www.git/
https://git.rockbox.org/cgit/rockbox.git/
https://git.qsomula.top/SUGAR__STRAWBERRIES/SUGAR__AND__STRAWBERRIES.git
https://source.netsurf-browser.org/alphagen.git/
https://source.netsurf-browser.org/ttf2f.git/
https://source.netsurf-browser.org/toolchains.git/
https://source.netsurf-browser.org/squeeze.git/
https://source.netsurf-browser.org/packaging/fedora.git/
https://source.netsurf-browser.org/packaging/debian.git/
https://source.netsurf-browser.org/nstheme.git/
https://source.netsurf-browser.org/nsgenbind.git/
https://source.netsurf-browser.org/netsurf.git/
https://source.netsurf-browser.org/netsurf-wiki.git/
https://source.netsurf-browser.org/netsurf-website.git/
https://source.netsurf-browser.org/netsurf-test.git/
https://source.netsurf-browser.org/netsurf-all.git/
https://source.netsurf-browser.org/makerun.git/
https://source.netsurf-browser.org/libwapcaplet.git/
https://source.netsurf-browser.org/libutf8proc.git/
https://source.netsurf-browser.org/libsvgtiny.git/
https://source.netsurf-browser.org/librufl.git/
https://source.netsurf-browser.org/librosprite.git/
https://source.netsurf-browser.org/libpencil.git/
https://source.netsurf-browser.org/libparserutils.git/
https://source.netsurf-browser.org/libnsutils.git/
https://source.netsurf-browser.org/libnspsl.git/
https://source.netsurf-browser.org/libnspdf.git/
https://source.netsurf-browser.org/libnslog.git/
https://source.netsurf-browser.org/libnslayout.git/
https://source.netsurf-browser.org/libnsgif.git/
https://source.netsurf-browser.org/libnsfb.git/
https://source.netsurf-browser.org/libnsbmp.git/
https://source.netsurf-browser.org/libhubbub.git/
https://source.netsurf-browser.org/libdom.git/
https://source.netsurf-browser.org/libcss.git/
https://source.netsurf-browser.org/json-c.git/
https://source.netsurf-browser.org/iconv.git/
https://source.netsurf-browser.org/ci-tools.git/
https://source.netsurf-browser.org/buildsystem.git/
https://source.netsurf-browser.org/art.git/
http://galexander.org/git/simplesshd.git
https://tinc-vpn.org/git/tinc
https://git.joeyh.name/git/concurrent-output.git
https://git.joeyh.name/git/brainfuck-monad.git
https://git.neodarz.net/pro/umosapicpp.git
https://git.neodarz.net/pro/umosapi.git
https://git.neodarz.net/neodarz/waveshare-7inch-touchscreen-driver.git
https://git.neodarz.net/neodarz/scripts/feed_finder.git
https://git.neodarz.net/neodarz/scripts/convert.py.git
https://git.neodarz.net/neodarz/scripts/bandcamp-dl_script.git
https://git.neodarz.net/neodarz/scripts/arte.tv-dl.git
https://git.neodarz.net/neodarz/scripts/archlinux_iso_checker.git
https://git.neodarz.net/neodarz/scripts/SimplyQrGen.git
https://git.neodarz.net/neodarz/scripts/EphermalVPN.git
https://git.neodarz.net/neodarz/school/the_transcriber_backend.git
https://git.neodarz.net/neodarz/resumejson_converter.git
https://git.neodarz.net/code_archive/freetorrent.git
https://git.e2factory.org/git/e2factory.git
https://git.zap.org.au/git/console-fonts-utils.git
https://git.zap.org.au/git/console-fonts-lucida.git
https://git.zap.org.au/git/console-fonts-zap.git
https://git.zap.org.au/git/trader.git
http://forge.frm2.tum.de/cgit/cgit.cgi/frm2/mira/miezetools.git/
Sep 29 2021, 11:57 AM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

Afterwards, we use the following script to identify the dumb git origins that can be reloaded:

get_save_code_now_dumb_git_repos.py
import io
import os
Sep 29 2021, 11:54 AM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

Then we copy that dump locally and load it into our development database:

anlambert@carnavalet:~/tmp$ scp anlambert@moma:swh-web-db.json .
swh-web-db.json                                                                                                                                                                                                                                        100%   33MB   5.6MB/s   00:05    
anlambert@carnavalet:~/tmp$ django-admin loaddata --settings swh.web.settings.development swh-web-db.json
Installed 93893 object(s) from 1 fixture(s)
anlambert@carnavalet:~/tmp$
Sep 29 2021, 11:51 AM · Save Code Now, Archive coverage, Git loader
anlambert added a comment to T3618: Reschedule loading of dumb git origins submitted to "Save code now" service.

First we need a JSON dump of production database:

anlambert@carnavalet:~/tmp$ ssh anlambert@moma
Linux moma 5.10.0-0.bpo.5-amd64 #1 SMP Debian 5.10.24-1~bpo10+1 (2021-03-29) x86_64
Sep 29 2021, 11:49 AM · Save Code Now, Archive coverage, Git loader
anlambert triaged T3618: Reschedule loading of dumb git origins submitted to "Save code now" service as Normal priority.
Sep 29 2021, 11:21 AM · Save Code Now, Archive coverage, Git loader
anlambert requested review of D6371: common/converters: Filter out id field when converting Origin model.
Sep 29 2021, 11:16 AM
anlambert closed T2489: Git origin without smart transfer protocol support cannot be loaded as Resolved.

Dumb protocol support has been implemented in the git loader and deployed to production (see that origin example and its list of all visits), closing this.

Sep 29 2021, 11:09 AM · Git loader

Sep 28 2021

anlambert accepted D6368: Fix support of swh-model 3.0.0.

Looks good to me.

Sep 28 2021, 7:31 PM
anlambert committed rDSEA8176f2e67e3a: elasticsearch: Remove unused origin_dump method (authored by anlambert).
elasticsearch: Remove unused origin_dump method
Sep 28 2021, 5:39 PM
anlambert committed rDSEAf5fc88405774: elasticsearch: Fix mypy errors (authored by anlambert).
elasticsearch: Fix mypy errors
Sep 28 2021, 5:39 PM
anlambert committed rDSEAd02d4e9816d9: search: Remove use of deprecated origin_identifier function (authored by anlambert).
search: Remove use of deprecated origin_identifier function
Sep 28 2021, 5:39 PM
anlambert closed D6366: Fix a couple of issues since changes in swh-model and es module typing.
Sep 28 2021, 5:39 PM
anlambert committed rDSEA0a0832596768: test_journal_client: Fix invalid import (authored by anlambert).
test_journal_client: Fix invalid import
Sep 28 2021, 5:39 PM
anlambert requested review of D6366: Fix a couple of issues since changes in swh-model and es module typing.
Sep 28 2021, 5:11 PM
anlambert edited P1180 (An Untitled Masterwork).
Sep 28 2021, 4:51 PM
anlambert created P1180 (An Untitled Masterwork).
Sep 28 2021, 4:48 PM
anlambert closed D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 3:11 PM
anlambert committed rDLDGd3976ca6504c: loader: Add support for dumb HTTP transfer protocol (authored by anlambert).
loader: Add support for dumb HTTP transfer protocol
Sep 28 2021, 3:11 PM
anlambert updated the diff for D6342: loader: Add support for dumb HTTP transfer protocol.

Update: move comment inside if block

Sep 28 2021, 2:44 PM
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 2:22 PM
anlambert updated the language for P1178 swh-web config from autodetect to yaml.
Sep 28 2021, 2:07 PM
anlambert created P1178 swh-web config.
Sep 28 2021, 2:07 PM
anlambert updated the diff for D6342: loader: Add support for dumb HTTP transfer protocol.

Update:

  • Increase tests coverage: handle bare repo without pack files and check dumb repo can still be loaded if dulwich raises an exception in fetch_pack
  • Improve comment
Sep 28 2021, 1:48 PM
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 28 2021, 11:20 AM
anlambert closed D6343: misc/coverage: Add heptapod to listed origins.
Sep 28 2021, 11:16 AM
anlambert committed rDWAPPS14a3caeadc8c: misc/coverage: Add heptapod to listed origins (authored by anlambert).
misc/coverage: Add heptapod to listed origins
Sep 28 2021, 11:16 AM
anlambert added a comment to T3613: svn: An error occurred when running svnrdump and no exploitable dump file has been generated..

@ardumont, looking at debug logs, the error in [1] is due to a permission issue

svnrdump: E170013: Unable to connect to a repository at URL 'https://llvm.org/svn/llvm-project'
svnrdump: E175013: Access to '/svn/llvm-project' forbidden
Sep 28 2021, 11:13 AM · SVN Loader

Sep 24 2021

anlambert added a comment to D6343: misc/coverage: Add heptapod to listed origins.

By the way, this morning, we discussed with david and zack that it'd be great if that would be made dynamic.
No idea how to fetch the correct logo though.

Sep 24 2021, 6:56 PM
anlambert requested review of D6343: misc/coverage: Add heptapod to listed origins.
Sep 24 2021, 4:43 PM
anlambert updated the diff for D6342: loader: Add support for dumb HTTP transfer protocol.

Update:

  • address most of @vlorentz comments
  • use a DFS to walk on the commits graph instead of a BFS
  • improve some comments
  • add missing docstring for new test suite
Sep 24 2021, 4:01 PM
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 24 2021, 3:36 PM
anlambert accepted D6336: Naive attempt to add support for dsn url config style for production db.

Looks good to me.

Sep 24 2021, 3:33 PM
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 24 2021, 3:24 PM
anlambert added inline comments to D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 24 2021, 3:03 PM
anlambert updated the test plan for D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 24 2021, 2:51 PM
anlambert requested review of D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 24 2021, 2:44 PM
anlambert added a revision to T2489: Git origin without smart transfer protocol support cannot be loaded: D6342: loader: Add support for dumb HTTP transfer protocol.
Sep 24 2021, 2:42 PM · Git loader
anlambert committed rDWAPPS3c78440d47d1: webpack-dev-server: Do not watch files in node_modules folder (authored by anlambert).
webpack-dev-server: Do not watch files in node_modules folder
Sep 24 2021, 11:23 AM

Sep 23 2021

anlambert closed D5188: Stop using deprecated constants from swh.model.identifiers.
Sep 23 2021, 5:26 PM
anlambert committed rDWAPPSe0f629e75462: Stop using deprecated constants from swh.model.identifiers (authored by vlorentz).
Stop using deprecated constants from swh.model.identifiers
Sep 23 2021, 5:26 PM
anlambert updated the diff for D5188: Stop using deprecated constants from swh.model.identifiers.

Remove debug print

Sep 23 2021, 5:08 PM
anlambert triaged T3608: Deprecate most of the /browse/origin/.* URLs as Normal priority.
Sep 23 2021, 4:34 PM · Web app
anlambert requested review of D5188: Stop using deprecated constants from swh.model.identifiers.
Sep 23 2021, 4:29 PM
anlambert renamed T3603: Replace stateful hypothesis strategies by pytest fixtures from Replace non stateful hypothesis strategies by pytest fixtures to Replace stateful hypothesis strategies by pytest fixtures.
Sep 23 2021, 2:12 PM · Web app
anlambert triaged T3603: Replace stateful hypothesis strategies by pytest fixtures as Normal priority.
Sep 23 2021, 2:12 PM · Web app
anlambert added a comment to T3602: Use swh-storage PostgreSQL backend in tests.

Instead of running tests only with the pg backend, what about both the in-mem and pg, using a parametrized fixture?
This would allow catching discrepancies between backends, instead of accidentally relying on pg's.

And, as the in-mem backend is much faster, we could exclude the pg backend while iterating (eg. pytest -k 'not postgresql').

Sep 23 2021, 11:59 AM · Web app
anlambert triaged T3602: Use swh-storage PostgreSQL backend in tests as Normal priority.
Sep 23 2021, 11:25 AM · Web app
anlambert triaged T3601: Use PostgreSQL backend for django database in tests as Normal priority.
Sep 23 2021, 11:08 AM · Web app

Sep 22 2021

anlambert accepted D5992: add support for the CVS loader to 'Save Code Now'.

Looks good to me, just a small indentation issue to fix before landing this. Thanks !

Sep 22 2021, 6:22 PM
anlambert added a comment to D6271: tarball: Add support for uncompressing crate files.

oh i missed that, great ;)

Sep 22 2021, 3:29 PM
anlambert accepted D6289: vault: Escape provided email address in the URL.
Sep 22 2021, 2:01 PM

Sep 21 2021

anlambert requested changes to D6289: vault: Escape provided email address in the URL.

Cypress does not actually type in the field and I don't understand why :(

Sep 21 2021, 4:41 PM
anlambert closed D6315: postgresql: Fix regression introduced in previous commit.
Sep 21 2021, 1:15 PM
anlambert committed rDSTO59e63db65c51: postgresql: Fix regression introduced in previous commit (authored by anlambert).
postgresql: Fix regression introduced in previous commit
Sep 21 2021, 1:15 PM
anlambert requested review of D6315: postgresql: Fix regression introduced in previous commit.
Sep 21 2021, 12:36 PM
anlambert committed rDWAPPS9e51595ad734: test_apiurls: Fix failures when using django 3.2.7 (authored by anlambert).
test_apiurls: Fix failures when using django 3.2.7
Sep 21 2021, 11:07 AM
anlambert accepted D6313: gnu: Respect the pattern docstring about extra state initialization.

Looks good to me.

Sep 21 2021, 10:56 AM

Sep 20 2021

anlambert requested review of D6311: admin/origin_save: Parse optional note from rejection POST request body.
Sep 20 2021, 6:04 PM