Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 14 2019

ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Branch diff to debian-loader branch

Oct 14 2019, 9:50 AM · Debian loader, Core Loader

Oct 13 2019

ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism from Open to Work in Progress.
Oct 13 2019, 6:37 PM · Origin-Debian, Debian loader, Archive coverage
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/174/ for more details.

Oct 13 2019, 6:20 PM · Debian loader, Core Loader
ardumont added inline comments to D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 13 2019, 6:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Remove unneeded overridden implementation (gnu)

Oct 13 2019, 6:18 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 13 2019, 6:16 PM · Debian loader, Core Loader
ardumont added inline comments to D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 13 2019, 6:14 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/173/ for more details.

Oct 13 2019, 6:03 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package: Fix py3.5 incompatibilities
Oct 13 2019, 6:02 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:55 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:55 PM · Debian loader, Core Loader
Harbormaster failed remote builds in B8382: Diff 7168 for D2135: package.debian: Re-implement debian loader within the package loader mechanism!
Oct 13 2019, 5:53 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:53 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package.loader: Fix type check annotation invalid in py3.5
Oct 13 2019, 5:52 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:49 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:46 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

I'm not sure the ci can build a diff when not on master...

[tox] $ git reset --hard origin/master
HEAD is now at c0af471 tox.ini: Fix py3 environment to only tests the swh/loader tests
[tox] $ git clean -fd -f
[tox] $ git submodule update --init --recursive
[tox] $ arc patch --diff 7167 --nocommit --nobranch --force --conduit-uri=https://forge.softwareheritage.org/ ********

This diff is against origin/package-loader...

Oct 13 2019, 5:43 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:38 PM · Debian loader, Core Loader

Oct 12 2019

ardumont added inline comments to D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 12 2019, 8:05 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 12 2019, 8:02 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 12 2019, 8:00 PM · Debian loader, Core Loader
ardumont added a comment to T2025: Re-implement debian loader with package loader mechanism.

Current input of the debian loader (without the optimization) (outputed from the lister):

Oct 12 2019, 9:27 AM · Origin-Debian, Debian loader, Archive coverage

Oct 5 2019

ardumont added a project to T2025: Re-implement debian loader with package loader mechanism: Origin-Debian.
Oct 5 2019, 2:31 PM · Origin-Debian, Debian loader, Archive coverage

Oct 1 2019

ardumont triaged T2025: Re-implement debian loader with package loader mechanism as Normal priority.
Oct 1 2019, 1:22 PM · Origin-Debian, Debian loader, Archive coverage

Jan 23 2019

seirl lowered the priority of T1493: Debian loader repeatedly fails on some packages, generating thousands of partial visits from High to Normal.
Jan 23 2019, 4:59 PM · Debian loader
seirl triaged T1493: Debian loader repeatedly fails on some packages, generating thousands of partial visits as High priority.
Jan 23 2019, 4:57 PM · Debian loader

Dec 17 2018

ardumont closed T1430: Add tests for the Debian loader as Resolved.
Dec 17 2018, 6:09 PM · Debian loader, Sprint 2018 12
ardumont moved T1430: Add tests for the Debian loader from done to deployed on the Sprint 2018 12 board.
Dec 17 2018, 6:08 PM · Debian loader, Sprint 2018 12
ardumont moved T1430: Add tests for the Debian loader from in progress to done on the Sprint 2018 12 board.
Dec 17 2018, 6:08 PM · Debian loader, Sprint 2018 12
ardumont lowered the priority of T1430: Add tests for the Debian loader from High to Normal.
Dec 17 2018, 2:49 PM · Debian loader, Sprint 2018 12
ardumont moved T1430: Add tests for the Debian loader from in progress to done on the Sprint 2018 12 board.
Dec 17 2018, 2:48 PM · Debian loader, Sprint 2018 12
ardumont changed the status of T1430: Add tests for the Debian loader from Open to Work in Progress.

D830

Dec 17 2018, 1:58 PM · Debian loader, Sprint 2018 12
ardumont raised the priority of T1430: Add tests for the Debian loader from Normal to High.
Dec 17 2018, 12:02 PM · Debian loader, Sprint 2018 12

Dec 14 2018

vlorentz claimed T1430: Add tests for the Debian loader.
Dec 14 2018, 5:45 PM · Debian loader, Sprint 2018 12

Dec 12 2018

zack added a project to T1430: Add tests for the Debian loader: Debian loader.
Dec 12 2018, 3:39 PM · Debian loader, Sprint 2018 12

Jun 6 2018

zack closed T120: regular debian archive producer as Resolved.

done by @olasd as part of Debian regular ingestion

Jun 6 2018, 1:40 PM · Debian loader, Origin-Debian

Mar 19 2018

olasd changed the status of T997: Debian loader sometimes thinks a package has been loaded when it has not from Open to Work in Progress.

I've cleaned up the cache for the revisions that haven't been loaded in the archive. We'll see how many holes we still have after another run of the loader.

Mar 19 2018, 7:55 PM · Debian loader

Mar 16 2018

olasd triaged T997: Debian loader sometimes thinks a package has been loaded when it has not as High priority.
Mar 16 2018, 6:01 PM · Debian loader

Aug 29 2016

ardumont added a parent task for T546: Update debian loader to register origin_visit's state: T534: Add completion information to softwareheritage.origin_visit table.
Aug 29 2016, 3:33 PM · Debian loader
ardumont created T546: Update debian loader to register origin_visit's state.
Aug 29 2016, 3:32 PM · Debian loader
ardumont added a comment to T539: Update loaders to register origin_visit's state.

This tasks takes care of:

  • loader-core
  • loader-dir (depends on loader-core)
  • loader-tar (depends on loader-dir and loader-core)
  • loader-git
  • loader-svn
Aug 29 2016, 3:31 PM · Directory loader, Tarball loader, Git loader, SVN Loader

Aug 23 2016

ardumont updated the task description for T539: Update loaders to register origin_visit's state.
Aug 23 2016, 11:46 AM · Directory loader, Tarball loader, Git loader, SVN Loader

May 13 2016

olasd changed the visibility for Debian loader.
May 13 2016, 5:23 PM
olasd changed the visibility for T214: Create occurrences for Debian packages.
May 13 2016, 5:07 PM · Origin-Debian, Debian loader
olasd changed the visibility for T213: Create synthetic releases for Debian packages.
May 13 2016, 5:07 PM · Origin-Debian, Debian loader
olasd changed the visibility for T212: Create synthetic revisions for Debian packages.
May 13 2016, 5:07 PM · Origin-Debian, Debian loader
olasd changed the visibility for T211: Load files and directories from a set of Debian packages.
May 13 2016, 5:07 PM · Origin-Debian, Debian loader
olasd changed the visibility for T120: regular debian archive producer.
May 13 2016, 5:06 PM · Debian loader, Origin-Debian
olasd changed the visibility for T119: snapshot.debian.org producer.
May 13 2016, 5:06 PM · Origin-Debian, Debian loader
olasd changed the visibility for T118: Create swh-loader-debian.
May 13 2016, 5:06 PM · Debian loader, Origin-Debian

Mar 10 2016

zack removed a project from T118: Create swh-loader-debian: Developers.
Mar 10 2016, 5:54 PM · Debian loader, Origin-Debian
zack removed a project from T119: snapshot.debian.org producer: Developers.
Mar 10 2016, 5:54 PM · Origin-Debian, Debian loader
zack removed a project from T212: Create synthetic revisions for Debian packages: Developers.
Mar 10 2016, 5:54 PM · Origin-Debian, Debian loader
zack removed a project from T211: Load files and directories from a set of Debian packages: Developers.
Mar 10 2016, 5:54 PM · Origin-Debian, Debian loader
zack removed a project from T213: Create synthetic releases for Debian packages: Developers.
Mar 10 2016, 5:54 PM · Origin-Debian, Debian loader
zack removed a project from T214: Create occurrences for Debian packages: Developers.
Mar 10 2016, 5:54 PM · Origin-Debian, Debian loader
zack removed projects from T120: regular debian archive producer: Developers, Staff.
Mar 10 2016, 5:52 PM · Debian loader, Origin-Debian
zack removed a project from T119: snapshot.debian.org producer: Staff.
Mar 10 2016, 5:49 PM · Origin-Debian, Debian loader
zack removed a project from T118: Create swh-loader-debian: Staff.
Mar 10 2016, 5:49 PM · Debian loader, Origin-Debian
zack removed a project from T211: Load files and directories from a set of Debian packages: Staff.
Mar 10 2016, 5:49 PM · Origin-Debian, Debian loader
zack removed a project from T213: Create synthetic releases for Debian packages: Staff.
Mar 10 2016, 5:49 PM · Origin-Debian, Debian loader
zack removed a project from T212: Create synthetic revisions for Debian packages: Staff.
Mar 10 2016, 5:49 PM · Origin-Debian, Debian loader
zack removed a project from T214: Create occurrences for Debian packages: Staff.
Mar 10 2016, 5:49 PM · Origin-Debian, Debian loader

Mar 5 2016

zack lowered the priority of T120: regular debian archive producer from High to Normal.
Mar 5 2016, 10:39 AM · Debian loader, Origin-Debian

Feb 23 2016

olasd closed T119: snapshot.debian.org producer as Resolved.

The initial import of the snapshot.debian.org data has been done in december.

Feb 23 2016, 1:39 PM · Origin-Debian, Debian loader

Feb 22 2016

olasd removed a member for Debian loader: olasd.
Feb 22 2016, 3:49 PM
olasd set the image for Debian loader to Unknown Object (File).
Feb 22 2016, 3:48 PM

Jan 2 2016

olasd closed T118: Create swh-loader-debian as Resolved.

The loader has been running over christmas break and is working.

Jan 2 2016, 1:06 AM · Debian loader, Origin-Debian
olasd closed T213: Create synthetic releases for Debian packages as Resolved.

as of rDLDDEB7ff7ecd22592c9f4dafb44a99ac91f803fd9cac2

Jan 2 2016, 1:06 AM · Origin-Debian, Debian loader
olasd closed T213: Create synthetic releases for Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Jan 2 2016, 1:06 AM · Debian loader, Origin-Debian
olasd closed T214: Create occurrences for Debian packages as Resolved.

rDLDDEBe7108fed5a4a9ece62ad4e52d4fa9a8f95377844 creates the "Software Heritage has seen this package at date <foo> in snapshot.d.o" occurrence

Jan 2 2016, 1:02 AM · Origin-Debian, Debian loader
olasd closed T214: Create occurrences for Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Jan 2 2016, 1:02 AM · Debian loader, Origin-Debian

Dec 9 2015

olasd closed T212: Create synthetic revisions for Debian packages as Resolved.

Done in rDLDDEBa05fc523fd.

Dec 9 2015, 3:56 PM · Origin-Debian, Debian loader
olasd closed T212: Create synthetic revisions for Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Dec 9 2015, 3:56 PM · Debian loader, Origin-Debian

Nov 23 2015

olasd claimed T119: snapshot.debian.org producer.
Nov 23 2015, 12:02 PM · Origin-Debian, Debian loader
olasd changed the status of T119: snapshot.debian.org producer from Open to Work in Progress.

The bulk import of Debian packages from snapshot.debian.org is robust since rDLDDEB9ce8e449eeb4.

Nov 23 2015, 12:02 PM · Origin-Debian, Debian loader
olasd closed T211: Load files and directories from a set of Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Nov 23 2015, 12:00 PM · Debian loader, Origin-Debian
olasd closed T211: Load files and directories from a set of Debian packages as Resolved.

in rDLDDEBd8a724a64822

Nov 23 2015, 12:00 PM · Origin-Debian, Debian loader
olasd created T214: Create occurrences for Debian packages.
Nov 23 2015, 12:00 PM · Origin-Debian, Debian loader
olasd created T213: Create synthetic releases for Debian packages.
Nov 23 2015, 11:58 AM · Origin-Debian, Debian loader
olasd created T212: Create synthetic revisions for Debian packages.
Nov 23 2015, 11:57 AM · Origin-Debian, Debian loader
olasd created T211: Load files and directories from a set of Debian packages.
Nov 23 2015, 11:56 AM · Origin-Debian, Debian loader
olasd changed the status of T118: Create swh-loader-debian from Open to Work in Progress.

This work started in the rDLDDEB repo.

Nov 23 2015, 11:55 AM · Debian loader, Origin-Debian

Oct 29 2015

zack renamed Debian loader from Debian Loader to Debian loader.
Oct 29 2015, 10:00 AM

Oct 28 2015

olasd added a comment to T119: snapshot.debian.org producer.

We should likely do the snapshot.d.o import in several passes:

Oct 28 2015, 6:47 PM · Origin-Debian, Debian loader

Oct 22 2015

olasd created T120: regular debian archive producer.
Oct 22 2015, 12:33 PM · Debian loader, Origin-Debian
olasd created T119: snapshot.debian.org producer.
Oct 22 2015, 12:32 PM · Origin-Debian, Debian loader
olasd created T118: Create swh-loader-debian.
Oct 22 2015, 12:30 PM · Debian loader, Origin-Debian
olasd set the color for Debian loader to Indigo.
Oct 22 2015, 12:28 PM
olasd set the color for Debian loader to Pink.
Oct 22 2015, 12:28 PM
olasd created Debian loader.
Oct 22 2015, 12:28 PM