Page MenuHomeSoftware Heritage
Paste P1211

swh-doco logs -f swh-scheduler-schedule-recurrent
ActivePublic

Authored by ardumont on Oct 27 2021, 3:42 PM.
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': ['swh.loader.svn.tasks', 'swh.loader.mercurial.tasks', 'swh.loader.git.tasks', 'swh.loader.package.archive.tasks', 'swh.loader.package.cran.tasks', 'swh.loader.package.debian.tasks', 'swh.loader.package.deposit.tasks', 'swh.loader.package.nixguix.tasks', 'swh.loader.package.npm.tasks', 'swh.loader.package.opam.tasks', 'swh.loader.package.pypi.tasks', 'swh.lister.bitbucket.tasks', 'swh.lister.cgit.tasks', 'swh.lister.cran.tasks', 'swh.lister.debian.tasks', 'swh.lister.gitea.tasks', 'swh.lister.github.tasks', 'swh.lister.gitlab.tasks', 'swh.lister.gnu.tasks', 'swh.lister.launchpad.tasks', 'swh.lister.npm.tasks', 'swh.lister.opam.tasks', 'swh.lister.packagist.tasks', 'swh.lister.phabricator.tasks', 'swh.lister.pypi.tasks', 'swh.lister.sourceforge.tasks', 'swh.lister.tuleap.tasks', 'swh.deposit.loader.tasks']}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:Creating a Celery app with {'task_soft_time_limit': 0, 'task_broker': 'amqp://guest:guest@amqp/%2f', 'task_queues': [<unbound Queue celery -> <unbound Exchange celery(direct)> -> celery>], 'broker_transport_options': {'max_retries': 1}, 'task_modules': []}
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type svn-from-remote-dump in queue swh.loader.svn.tasks.DumpMountAndLoadSvnRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type cran in queue swh.loader.package.cran.tasks.LoadCRAN
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type nixguix in queue swh.loader.package.nixguix.tasks.LoadNixguix
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type svn-from-remote-dump
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type cran
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type nixguix
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.mercurial.tasks.LoadMercurial HTTP/1.1" 404 49
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type hg in queue swh.loader.mercurial.tasks.LoadMercurial
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type hg
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type git-from-zip in queue swh.loader.git.tasks.UncompressAndLoadDiskGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.svn.tasks.MountAndLoadSvnRepository HTTP/1.1" 404 49
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type svn-from-archive in queue swh.loader.svn.tasks.MountAndLoadSvnRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type archive-files in queue swh.loader.package.archive.tasks.LoadArchive
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type deposit in queue swh.loader.package.deposit.tasks.LoadDeposit
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type pypi in queue swh.loader.package.pypi.tasks.LoadPyPI
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type svn-from-archive
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type git-from-zip
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type archive-files
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type deposit
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type pypi
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type git-from-dir in queue swh.loader.git.tasks.LoadDiskGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.mercurial.tasks.LoadArchiveMercurial HTTP/1.1" 404 49
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type hg-from-archive in queue swh.loader.mercurial.tasks.LoadArchiveMercurial
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type opam in queue swh.loader.package.opam.tasks.LoadOpam
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type git-from-dir
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type hg-from-archive
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type opam
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.svn.tasks.DumpMountAndLoadSvnRepository HTTP/1.1" 404 49
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type svn in queue swh.loader.svn.tasks.DumpMountAndLoadSvnRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.git.tasks.UpdateGitRepository HTTP/1.1" 404 49
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type deb-package in queue swh.loader.package.debian.tasks.LoadDebian
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type git in queue swh.loader.git.tasks.UpdateGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type npm in queue swh.loader.package.npm.tasks.LoadNpm
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type npm
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type deb-package
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type svn
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Skewed fetch for visit type git with policy already_visited_order_by_lag: fetched 0.0, requested 0.49
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Skewed fetch for visit type git with policy never_visited_oldest_update_first: fetched 1.0, requested 0.49
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Skewed fetch for visit type git with policy origins_without_last_update: fetched 0.0, requested 0.02
swh-scheduler-schedule-recurrent_1 | DEBUG:amqp:Start from server, version: 0.9, properties: {'capabilities': {'publisher_confirms': True, 'exchange_exchange_bindings': True, 'basic.nack': True, 'consumer_cancel_notify': True, 'connection.blocked': True, 'consumer_priorities': True, 'authentication_failure_close': True, 'per_consumer_qos': True, 'direct_reply_to': True}, 'cluster_name': 'rabbit@86a34dcea3bf', 'copyright': 'Copyright (C) 2007-2018 Pivotal Software, Inc.', 'information': 'Licensed under the MPL. See http://www.rabbitmq.com/', 'platform': 'Erlang/OTP 19.2.1', 'product': 'RabbitMQ', 'version': '3.6.16'}, mechanisms: [b'AMQPLAIN', b'PLAIN'], locales: ['en_US']
swh-scheduler-schedule-recurrent_1 | DEBUG:amqp:using channel_id: 1
swh-scheduler-schedule-recurrent_1 | DEBUG:amqp:Channel open
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:git: 4900 visits scheduled in queue swh.loader.git.tasks.UpdateGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.git.tasks.UpdateGitRepository HTTP/1.1" 200 235
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type git in queue swh.loader.git.tasks.UpdateGitRepository
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Skewed fetch for visit type git with policy already_visited_order_by_lag: fetched 0.0, requested 0.49
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Skewed fetch for visit type git with policy never_visited_oldest_update_first: fetched 1.0, requested 0.49
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Skewed fetch for visit type git with policy origins_without_last_update: fetched 0.0, requested 0.02
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:git: 4900 visits scheduled in queue swh.loader.git.tasks.UpdateGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.git.tasks.UpdateGitRepository HTTP/1.1" 200 630
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:100 available slots for visit type git in queue swh.loader.git.tasks.UpdateGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.mercurial.tasks.LoadMercurial HTTP/1.1" 200 704
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:queue swh.loader.mercurial.tasks.LoadMercurial status: 0
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:1000 available slots for visit type hg in queue swh.loader.mercurial.tasks.LoadMercurial
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type deposit in queue swh.loader.package.deposit.tasks.LoadDeposit
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:10000 available slots for visit type deb-package in queue swh.loader.package.debian.tasks.LoadDebian
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): amqp:15672
swh-scheduler-schedule-recurrent_1 | DEBUG:urllib3.connectionpool:http://amqp:15672 "GET /api/queues/%2F/swh.loader.git.tasks.UpdateGitRepository HTTP/1.1" 200 856
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.config:queue swh.loader.git.tasks.UpdateGitRepository status: 9643
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:357 available slots for visit type git in queue swh.loader.git.tasks.UpdateGitRepository
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:357 available slots < 500.0 for visit type git in queue swh.loader.git.tasks.UpdateGitRepository so backoff 60 seconds
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type deposit
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type deb-package
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:No origins to visit for type hg
...
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Termination requested...
swh-scheduler-schedule-recurrent_1 | INFO:swh.scheduler.celery_backend.recurrent_visits:Terminating visit scheduling threads: archive-files, cran, deb-package, deposit, git, git-from-dir, git-from-zip, hg, hg-from-archive, nixguix, npm, opam, pypi, svn, svn-from-archive, svn-from-remote-dump
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread svn-from-archive terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread svn terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread hg terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread hg-from-archive terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread git terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread svn-from-remote-dump terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread git-from-dir terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread git-from-zip terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread archive-files terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread cran terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread deb-package terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread deposit terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread nixguix terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread npm terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread opam terminated
swh-scheduler-schedule-recurrent_1 | DEBUG:swh.scheduler.celery_backend.recurrent_visits:Thread pypi terminated
docker_swh-scheduler-schedule-recurrent_1 exited with code 0