- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Oct 27 2022
Oct 27 2022
anlambert closed T4665: [pudbev lister] use alternative packages list endpoint, a subtask of T4465: Ingest pub.dev (Dart, Flutter), as Invalid.
Oct 21 2022
Oct 21 2022
anlambert edited projects for T4448: Implementation of Fedora Lister, added: RPM lister; removed Lister.
bchauvet edited parent tasks for T4448: Implementation of Fedora Lister, added: Unknown Object (Maniphest Task); removed: Unknown Object (Maniphest Task).
Oct 19 2022
Oct 19 2022
gitlab-migration closed T4626: staging: ingest openbsd.org cvs forge, a subtask of T3691: Implement CVS loader, as Migrated.
gitlab-migration closed T4625: staging: ingest netbsd.org cvs forge, a subtask of T3691: Implement CVS loader, as Migrated.
gitlab-migration changed the status of T4555: staging: Deploy bower lister from Resolved to Migrated.
gitlab-migration changed the status of T4555: staging: Deploy bower lister, a subtask of T4475: Ingest bower.io (Javascript package manager), from Resolved to Migrated.
gitlab-migration changed the status of T4545: staging: Deploy golang stack, a subtask of T4124: Golang support, from Resolved to Migrated.
gitlab-migration changed the status of T4545: staging: Deploy golang stack from Resolved to Migrated.
gitlab-migration changed the status of T4517: staging: Deploy pubdev, a subtask of T4465: Ingest pub.dev (Dart, Flutter), from Resolved to Migrated.
gitlab-migration changed the status of T4478: Deploy Gogs lister to staging, a subtask of T1721: Implementation of Gogs Lister, from Resolved to Migrated.
gitlab-migration changed the status of T4330: Deploy maven stack in production from Resolved to Migrated.
gitlab-migration changed the status of T4330: Deploy maven stack in production, a subtask of T1724: Maven Central repository support, from Resolved to Migrated.
gitlab-migration changed the status of T4326: Archive the pom file additionally to the source folder, a subtask of T3746: staging: Deploy maven indexer/lister/loader, from Invalid to Migrated.
gitlab-migration changed the status of T4326: Archive the pom file additionally to the source folder from Invalid to Migrated.
gitlab-migration changed the status of T4215: staging: Deploy latest maven stack, a subtask of T3874: staging: Analyze result of the maven listing and ingestion, from Resolved to Migrated.
gitlab-migration changed the status of T4215: staging: Deploy latest maven stack from Resolved to Migrated.
gitlab-migration changed the status of T4143: staging: Deploy maven stack fixes, a subtask of T3874: staging: Analyze result of the maven listing and ingestion, from Resolved to Migrated.
gitlab-migration changed the status of T4143: staging: Deploy maven stack fixes from Resolved to Migrated.
gitlab-migration changed the status of T4105: Push maven-index-exporter image to docker hub, a subtask of T3746: staging: Deploy maven indexer/lister/loader, from Resolved to Migrated.
gitlab-migration changed the status of T3947: Deploy swh.lister v2.7, a subtask of T3789: Adapt sourceforge lister to list cvs origins according to what the cvs loader expects, from Resolved to Migrated.
gitlab-migration changed the status of T3798: Debian package for swh.loader.cvs, a subtask of T3788: staging: Deploy cvs loader v0.1, from Resolved to Migrated.
gitlab-migration changed the status of T3798: Debian package for swh.loader.cvs from Resolved to Migrated.
gitlab-migration changed the status of T3788: staging: Deploy cvs loader v0.1, a subtask of T3691: Implement CVS loader, from Resolved to Migrated.
gitlab-migration changed the status of T3788: staging: Deploy cvs loader v0.1 from Resolved to Migrated.
gitlab-migration changed the status of T3785: Update scheduler metrics routine is taking too long from Resolved to Migrated.
gitlab-migration changed the status of T3774: Deploy swh.loader.core v2.0.0, a subtask of T2400: Ingest current and historical Ubuntu releases, from Resolved to Migrated.
gitlab-migration changed the status of T3765: Deploy latest swh.loader.core and swh.lister, a subtask of T2400: Ingest current and historical Ubuntu releases, from Resolved to Migrated.
gitlab-migration changed the status of T3746: staging: Deploy maven indexer/lister/loader, a subtask of T1724: Maven Central repository support, from Resolved to Migrated.
gitlab-migration changed the status of T3746: staging: Deploy maven indexer/lister/loader from Resolved to Migrated.
gitlab-migration changed the status of T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from Resolved to Migrated.
gitlab-migration changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Resolved to Migrated.
gitlab-migration changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3600: List heptapod instance https://heptapod.host/, a subtask of T3599: List and ingest heptapod instances, from Resolved to Migrated.
gitlab-migration changed the status of T3600: List heptapod instance https://heptapod.host/ from Resolved to Migrated.
gitlab-migration changed the status of T3599: List and ingest heptapod instances from Resolved to Migrated.
gitlab-migration changed the status of T3597: List heptapod instance https://forge.extranet.logilab.fr/, a subtask of T3599: List and ingest heptapod instances, from Resolved to Migrated.
gitlab-migration changed the status of T3597: List heptapod instance https://forge.extranet.logilab.fr/ from Resolved to Migrated.
gitlab-migration changed the status of T3581: List heptapod instance foss.heptapod.net, a subtask of T3599: List and ingest heptapod instances, from Resolved to Migrated.
gitlab-migration changed the status of T3581: List heptapod instance foss.heptapod.net from Resolved to Migrated.
gitlab-migration changed the status of T3568: Deploy opam lister/loader to production, a subtask of T3424: Opam support, from Resolved to Migrated.
gitlab-migration changed the status of T3568: Deploy opam lister/loader to production from Resolved to Migrated.
gitlab-migration changed the status of T3538: Send scheduler metrics to prometheus, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3471: production: Deploy swh.scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3471: production: Deploy swh.scheduler v0.17 from Resolved to Migrated.
gitlab-migration changed the status of T3470: lister-sourceforge: Activate sourceforge origins when listed, a subtask of T3374: Ingest sourceforge repositories (origins of type git, svn, hg), from Resolved to Migrated.
gitlab-migration changed the status of T3470: lister-sourceforge: Activate sourceforge origins when listed from Resolved to Migrated.
gitlab-migration changed the status of T3468: staging: current opam loading issues, a subtask of T3424: Opam support, from Resolved to Migrated.
gitlab-migration changed the status of T3456: staging: Deploy scheduler v0.17 from Resolved to Migrated.
gitlab-migration changed the status of T3456: staging: Deploy scheduler v0.17, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Resolved to Migrated.
gitlab-migration changed the status of T3438: Deploy opam lister/loader to staging, a subtask of T3424: Opam support, from Resolved to Migrated.
gitlab-migration changed the status of T3374: Ingest sourceforge repositories (origins of type git, svn, hg) from Resolved to Migrated.
gitlab-migration changed the status of T3350: Deploy sourceforge lister in production from Resolved to Migrated.
gitlab-migration changed the status of T2608: Deploy launchpad and gitea listers on production, a subtask of T1734: Create a Lister for launchpad.net, from Resolved to Migrated.
gitlab-migration changed the status of T2608: Deploy launchpad and gitea listers on production, a subtask of T2313: Archive git.fsfe.org (Gitea), from Resolved to Migrated.
gitlab-migration changed the status of T2608: Deploy launchpad and gitea listers on production from Resolved to Migrated.
gitlab-migration changed the status of T2594: production: Running nixguix on guix sources, a subtask of T1352: ingest Guix (SD) packages, from Resolved to Migrated.
gitlab-migration changed the status of T2594: production: Running nixguix on guix sources from Resolved to Migrated.
gitlab-migration changed the status of T2594: production: Running nixguix on guix sources, a subtask of T2485: staging: Running nixguix on guix sources , from Resolved to Migrated.
gitlab-migration changed the status of T2400: Ingest current and historical Ubuntu releases from Resolved to Migrated.
gitlab-migration changed the status of T2358: Deploy launchpad lister on staging from Resolved to Migrated.
gitlab-migration changed the status of T2358: Deploy launchpad lister on staging, a subtask of T1734: Create a Lister for launchpad.net, from Resolved to Migrated.
gitlab-migration changed the status of T360: create gid 5000 and add swhworker to it (to ingest gitorious repos), a subtask of T312: Gitorious import: ingest repositories, from Resolved to Migrated.
Oct 18 2022
Oct 18 2022
@vsellier, I landed all optimizations for the CVS loader and tagged a new version v0.5.0 so you can retry the NetBSD repository loading on staging.
Oct 17 2022
Oct 17 2022
anlambert closed Restricted Maniphest Task, a subtask of T4625: staging: ingest netbsd.org cvs forge, as Resolved.
Oct 14 2022
Oct 14 2022
thanks, I will try to restart the loading with the patch to see how it behaves
Oct 13 2022
Oct 13 2022
In T4625#93225, @vsellier wrote:
anlambert closed Restricted Maniphest Task, a subtask of T4625: staging: ingest netbsd.org cvs forge, as Resolved.
vlorentz added subtasks for T4625: staging: ingest netbsd.org cvs forge: Restricted Maniphest Task, Restricted Maniphest Task.
vlorentz updated the task description for T4628: Pubdev: load authors from API instead of pubspec.yaml.
The loading finally failed:
INFO:swh.loader.cvs.loader.CvsLoader:Load origin 'ssh://anoncvs@anoncvs.NetBSD.org:/cvsroot/src' with type 'cvs' DEBUG:swh.loader.cvs.loader.CvsLoader:lister_not provided, skipping extrinsic origin metadata DEBUG:swh.loader.cvs.loader.CvsLoader:prepare; origin_url=ssh://anoncvs@anoncvs.NetBSD.org:/cvsroot/src scheme=ssh path=/cvsroot/src Warning: Permanently added 'anoncvs.netbsd.org,199.233.217.198' (RSA) to the list of known hosts. DEBUG:swh.loader.cvs.loader.CvsLoader:Fetching CVS rlog from anoncvs.netbsd.org:/cvsroot/src
Oct 12 2022
Oct 12 2022
I've launched the loader on the /src subdirectory, if I follow the cvs loader documentation: https://forge.softwareheritage.org/source/swh-loader-cvs/browse/master/docs/ ,
it should also be launched on the other subdirectories:
The loader got killed after it starts to consume a lot of memory...
Warning: Permanently added 'anoncvs.netbsd.org,199.233.217.198' (RSA) to the list of known hosts. DEBUG:swh.loader.cvs.loader.CvsLoader:Fetching CVS rlog from anoncvs.netbsd.org:/cvsroot/src Killed swh@loader-cvs-manual:~$
vlorentz added a revision to T4465: Ingest pub.dev (Dart, Flutter): D8665: Pubdev: Add raw_extrinsic_metadata.
vsellier moved T4626: staging: ingest openbsd.org cvs forge from Backlog to in-progress on the System administration board.
vsellier moved T4625: staging: ingest netbsd.org cvs forge from Backlog to in-progress on the System administration board.
The first try with a oneshot task failed, the containe was killed:
swhscheduler@scheduler0:~$ swh scheduler --url http://scheduler0.internal.staging.swh.network:5008/ task add load-cvs -p oneshot ssh://anoncvs@anoncvs.NetBSD.org:/cvsroot/src Created 1 tasks
vsellier changed the status of T4626: staging: ingest openbsd.org cvs forge from Open to Work in Progress.
vsellier changed the status of T4625: staging: ingest netbsd.org cvs forge from Open to Work in Progress.
Oct 11 2022
Oct 11 2022
Oct 10 2022
Oct 10 2022
Oct 7 2022
Oct 7 2022
anlambert added a revision to T1777: Rubygems Lister: D8639: rubygems: Use gems database dump to improve listing output.
Oct 4 2022
Oct 4 2022