Page MenuHomeSoftware Heritage

CGit listing of git.yoctoproject.org instance is broken
Closed, MigratedEdits Locked

Description

The listing of the git.yoctoproject.org cgit instance is currently broken in production.

This is due to the use of a no longer valid instance URL (http://git.yoctoproject.org/clean/cgit.cgi/) passed as lister parameter.

The URL parameter must be changed to http://git.yoctoproject.org/ in listing task arguments.

softwareheritage-scheduler=> select type, arguments from task where type = 'list-cgit';
   type    |                                                                                arguments                                                                                
-----------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 list-cgit | {"args": [], "kwargs": {"url": "https://git.openembedded.org/", "instance": "git.openembedded.org", "base_git_url": "https://git.openembedded.org/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.kernel.org/", "instance": "git.kernel.org", "base_git_url": "https://git.kernel.org/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.baserock.org/cgit/", "instance": "git.baserock.org", "base_git_url": "https://git.baserock.org/git/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://www.happyassassin.net/cgit/", "instance": "www.happyassassin.net"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://cgit.kde.org/", "instance": "kde"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://gitweb.torproject.org/", "instance": "gitweb.torproject.org", "base_git_url": "https://gitweb.torproject.org/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.zx2c4.com/", "instance": "git.zx2c4.com", "base_git_url": "https://git.zx2c4.com/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://code.qt.io/cgit/", "instance": "code.qt.io", "base_git_url": "http://code.qt.io/"}}
 list-cgit | {"args": [], "kwargs": {"url": "http://hdiff.luite.com/cgit/", "instance": "hdiff.luite.com", "base_git_url": "http://hdiff.luite.com/cgit/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://fedorapeople.org/cgit/", "instance": "fedorapeople.org", "base_git_url": "https://fedorapeople.org/cgit/"}}
 list-cgit | {"args": [], "kwargs": {"url": "http://git.gnu.org.ua/cgit/", "instance": "git.gnu.org.ua", "base_git_url": "https://git.gnu.org.ua/repo/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.alpinelinux.org/", "instance": "git.alpinelinux.org"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.savannah.gnu.org/cgit/", "instance": "gnu-savannah", "base_git_url": "https://git.savannah.gnu.org/git/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.joeyh.name/", "base_git_url": "https://git.joeyh.name/git/"}}
 list-cgit | {"args": [], "kwargs": {"url": "https://git.eclipse.org/c/", "instance": "git.eclipse.org", "base_git_url": "https://git.eclipse.org/r/"}}
 list-cgit | {"args": [], "kwargs": {"url": "http://git.yoctoproject.org/clean/cgit.cgi/", "instance": "git.yoctoproject.org", "base_git_url": "https://git.yoctoproject.org/git/"}}

Event Timeline

anlambert triaged this task as Normal priority.Mar 11 2022, 12:05 PM
anlambert created this task.

Should be a matter of updating such task with:

begin;

UPDATE task
SET arguments=jsonb_set(arguments, '{kwargs,url}', '"http://git.yoctoproject.org/"', false)
where id=168395993;

13:07:16 *softwareheritage-scheduler@belvedere:5432=> select * from task where id=168395993;
+-[ RECORD 1 ]-----+----------------------------------------------------------------------------------------------------------------------------------------------------------+
| id               | 168395993                                                                                                                                                |
| type             | list-cgit                                                                                                                                                |
| arguments        | {"args": [], "kwargs": {"url": "http://git.yoctoproject.org/", "instance": "git.yoctoproject.org", "base_git_url": "https://git.yoctoproject.org/git/"}} |
| next_run         | 2022-05-09 21:45:52.672814+00                                                                                                                            |
| current_interval | 64 days                                                                                                                                                  |
| status           | next_run_not_scheduled                                                                                                                                   |
| policy           | recurring                                                                                                                                                |
| retries_left     | 3                                                                                                                                                        |
| priority         | (null)                                                                                                                                                   |
+------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------+

Time: 6.199 ms
rollback;

Triggered back a run and it seemed to have run well:

Mar 11 12:23:15 worker14 python3[2494505]: [2022-03-11 12:23:15,252: INFO/MainProcess] Received task: swh.lister.cgit.tasks.CGitListerTask[e7674643-c7ca-4ae1-910e-9ea24e8c2335]
Mar 11 12:23:17 worker14 python3[2961235]: [2022-03-11 12:23:17,950: INFO/ForkPoolWorker-7] Task swh.lister.cgit.tasks.CGitListerTask[e7674643-c7ca-4ae1-910e-9ea24e8c2335] succeeded in 2.3799873050302267s: {'pages': 1, 'origins': 177}
ardumont claimed this task.