Page MenuHomeSoftware Heritage
Paste P1374

prod: loader frequency
ActivePublic
Actions

Authored by ardumont on Jun 3 2022, 9:55 AM.
09:52:37 softwareheritage-scheduler@belvedere:5432=> select * from task_type where type like 'load-%' or type like 'list-%';
+------------------------------+--------------------------------------------------------------+-----------------------------------------------------------+------------------+--------------+--------------+----------------+------------------+-------------+-------------+
| type | description | backend_name | default_interval | min_interval | max_interval | backoff_factor | max_queue_length | num_retries | retry_delay |
+------------------------------+--------------------------------------------------------------+-----------------------------------------------------------+------------------+--------------+--------------+----------------+------------------+-------------+-------------+
| load-hg | Update an origin of type mercurial | swh.loader.mercurial.tasks.LoadMercurial | 64 days | 1 day | 64 days | 2 | 5000 | 3 | (null) |
| load-svn | Create dump of a remote svn repository, mount it and load it | swh.loader.svn.tasks.DumpMountAndLoadSvnRepository | 1 day | 1 day | 1 day | 1 | 1000 | 3 | (null) |
| list-sourceforge-full | Full update of a SourceForge instance | swh.lister.sourceforge.tasks.FullSourceForgeLister | 90 days | 90 days | 90 days | 1 | (null) | (null) | (null) |
| load-npm | Load npm origin | swh.loader.package.npm.tasks.LoadNpm | 64 days | 12:00:00 | 64 days | 2 | 5000 | 3 | (null) |
| load-pypi | Load Pypi origin | swh.loader.package.pypi.tasks.LoadPyPI | 64 days | 12:00:00 | 64 days | 2 | 5000 | 3 | (null) |
| list-maven-full | Full update of a Maven repository instance | swh.lister.maven.tasks.FullMavenLister | 90 days | 90 days | 90 days | 1 | (null) | (null) | (null) |
| list-debian-distribution | List a Debian distribution | swh.lister.debian.tasks.DebianListerTask | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| list-gitlab-incremental | Incrementally list a Gitlab instance | swh.lister.gitlab.tasks.IncrementalGitLabLister | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-svn-from-archive | Loading svn repositories from svn dump | swh.loader.svn.tasks.MountAndLoadSvnRepository | 1 day | 1 day | 1 day | 1 | 1000 | 3 | (null) |
| load-hg-from-archive | Loading archive mercurial repository swh-loader-mercurial | swh.loader.mercurial.tasks.LoadArchiveMercurial | 1 day | 1 day | 1 day | 1 | 1000 | 3 | (null) |
| list-github-incremental | Incrementally list GitHub | swh.lister.github.tasks.IncrementalGitHubLister | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| list-gitlab-full | Full update of a Gitlab instance's repos list | swh.lister.gitlab.tasks.FullGitLabRelister | 90 days | 90 days | 90 days | 1 | 5000 | 3 | (null) |
| list-pypi | Full pypi lister | swh.lister.pypi.tasks.PyPIListerTask | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-nixguix | Load functional (e.g. guix/nix) package | swh.loader.package.nixguix.tasks.LoadNixguix | 1 day | 1 day | 1 day | 1 | 10 | 3 | (null) |
| list-gitea-full | Full update of a Gitea instance | swh.lister.gitea.tasks.FullGiteaRelister | 90 days | 90 days | 90 days | 1 | (null) | (null) | (null) |
| load-deb-package | Load a Debian package | swh.loader.package.debian.tasks.LoadDebian | (null) | (null) | (null) | (null) | 5000 | 5 | 01:00:00 |
| load-deposit | Loading deposit archive into swh through swh-loader-tar | swh.loader.package.deposit.tasks.LoadDeposit | 1 day | 1 day | 1 day | 1 | 1000 | 3 | (null) |
| list-gitea-incremental | Incremental update of a Gitea instance | swh.lister.gitea.tasks.IncrementalGiteaLister | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
| list-launchpad-full | Full update of Launchpad | swh.lister.launchpad.tasks.FullLaunchpadLister | 90 days | 90 days | 90 days | 1 | (null) | (null) | (null) |
| list-launchpad-incremental | Incremental update | swh.lister.launchpad.tasks.IncrementalLaunchpadLister | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
| list-launchpad-new | Update new entries of Launchpad | swh.lister.launchpad.tasks.NewLaunchpadLister | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
| list-github-full | Full update of GitHub repos list | swh.lister.github.tasks.FullGitHubRelister | 14 days | 14 days | 14 days | 1 | 5000 | 3 | (null) |
| list-npm-full | Full npm lister | swh.lister.npm.tasks.NpmListerTask | 7 days | 12:00:00 | 12:00:00 | 1 | (null) | 3 | (null) |
| list-sourceforge-incremental | Full update of a SourceForge instance | swh.lister.sourceforge.tasks.IncrementalSourceForgeLister | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
| list-opam | Lister task for the Opam registry | swh.lister.opam.tasks.OpamListerTask | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
| list-tuleap-full | Full update of a Tuleap instance | swh.lister.tuleap.tasks.FullTuleapLister | 90 days | 90 days | 90 days | 1 | (null) | (null) | (null) |
| list-maven-incremental | Incremental update of a Maven repository instance | swh.lister.maven.tasks.IncrementalMavenLister | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
| load-deb | Load Debian package | swh.loader.package.debian.tasks.LoadDebian | 1 day | 1 day | 1 day | 1 | 5000 | 5 | 01:00:00 |
| load-git | Update an origin of type git | swh.loader.git.tasks.UpdateGitRepository | 64 days | 12:00:00 | 64 days | 2 | 20000 | 3 | (null) |
| load-crates | Load Rust crate package | swh.loader.package.crates.tasks.LoadCrates | 1 day | 1 day | 1 day | 1 | 1000 | (null) | (null) |
| list-phabricator-full | Full Phabricator instance Lister | swh.lister.phabricator.tasks.FullPhabricatorLister | 90 days | (null) | (null) | 1 | (null) | 3 | (null) |
| list-gnu-full | Full GNU Lister | swh.lister.gnu.tasks.GNUListerTask | 7 days | (null) | (null) | 1 | (null) | 3 | (null) |
| list-bitbucket-incremental | Incrementally list BitBucket | swh.lister.bitbucket.tasks.IncrementalBitBucketLister | 1 day | 1 day | 1 day | 1 | (null) | 3 | (null) |
| list-cgit | CGit instance lister | swh.lister.cgit.tasks.CGitListerTask | 64 days | 64 days | 64 days | 1 | (null) | 3 | (null) |
| load-maven | Load maven jar artifacts. | swh.loader.package.maven.tasks.LoadMaven | 1 day | 1 day | 1 day | 1 | 1000 | (null) | (null) |
| load-bzr | Bazaar repository loading | swh.loader.bzr.tasks.LoadBazaar | 1 day | 1 day | 1 day | 1 | 1000 | (null) | (null) |
| list-bitbucket-full | Full update of the BitBucket forge | swh.lister.bitbucket.tasks.FullBitBucketRelister | 90 days | 90 days | 90 days | 1 | (null) | 3 | (null) |
| list-cran | Lister task for the CRAN registry | swh.lister.cran.tasks.CRANListerTask | 1 day | 1 day | 1 day | 1 | (null) | 3 | (null) |
| list-npm-incremental | Incremental lister for the npm (javascript) registry | swh.lister.npm.tasks.NpmIncrementalListerTask | 1 day | 1 day | 1 day | 1 | (null) | 3 | (null) |
| list-packagist | List the packagist (php) registry | swh.lister.packagist.tasks.PackagistListerTask | 1 day | 1 day | 1 day | 1 | (null) | 3 | (null) |
| load-archive-files | Load archive's artifacts (e.g gnu, etc...) | swh.loader.package.archive.tasks.LoadArchive | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-svn-from-remote-dump | 1. Mount a remote svn dump as a local svn repository. | swh.loader.svn.tasks.DumpMountAndLoadSvnRepository | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-cran | Load archive's artifacts (e.g gnu, etc...) | swh.loader.package.cran.tasks.LoadCRAN | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-git-from-dir | Import a git repository from a local repository | swh.loader.git.tasks.LoadDiskGitRepository | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-git-from-zip | Import a git repository from a zip archive | swh.loader.git.tasks.UncompressAndLoadDiskGitRepository | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| load-opam | Load Opam's artifacts | swh.loader.package.opam.tasks.LoadOpam | 1 day | 1 day | 1 day | 1 | 5000 | 3 | (null) |
| list-crates | Lister task for crates (rust) registry | swh.lister.crates.tasks.CratesListerTask | 1 day | 1 day | 1 day | 1 | (null) | (null) | (null) |
+------------------------------+--------------------------------------------------------------+-----------------------------------------------------------+------------------+--------------+--------------+----------------+------------------+-------------+-------------+
(47 rows)
Time: 6.896 ms
About · Developer information · Legal