Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 16 2019

ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package.debian: Check for known revisions using snapshot if any
  • package: Manipulate package information instead of artifacts
Oct 16 2019, 6:39 PM · Debian loader, Core Loader

Oct 15 2019

swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/192/ for more details.

Oct 15 2019, 5:07 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Fix edge case about date
Oct 15 2019, 5:06 PM · Debian loader, Core Loader
ardumont retitled D2135: package.debian: Re-implement debian loader within the package loader mechanism from debian: Implement debian loader with package loader mechanism to package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 2:41 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 2:08 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/187/ for more details.

Oct 15 2019, 2:00 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Add test to demonstrate we visit twice the artifacts for 2 visits (with no
change in between)

Oct 15 2019, 1:59 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/186/ for more details.

Oct 15 2019, 1:59 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian.loader: Update typing annotations
  • debian: Explicit we visit twice the same artifacts across 2 visits
  • package.debian: Check for known revisions using snapshot if any
Oct 15 2019, 1:58 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 1:11 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 1:10 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/185/ for more details.

Oct 15 2019, 12:19 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/184/ for more details.

Oct 15 2019, 12:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Diff against package-loader (not master :/)

Oct 15 2019, 12:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • test_debian: Add test around get_package_metadata function
Oct 15 2019, 12:17 PM · Debian loader, Core Loader

Oct 14 2019

swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/183/ for more details.

Oct 14 2019, 6:14 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian.tests: Update pytest_plugin version use
Oct 14 2019, 6:13 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/182/ for more details.

Oct 14 2019, 2:27 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/181/ for more details.

Oct 14 2019, 2:25 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Expose debian loader implementation first
Oct 14 2019, 2:25 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Improve dosctrings

Oct 14 2019, 2:24 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/180/ for more details.

Oct 14 2019, 2:19 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Add missing type annotations

Oct 14 2019, 2:18 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/179/ for more details.

Oct 14 2019, 2:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Simplify build revision code
Oct 14 2019, 2:16 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/178/ for more details.

Oct 14 2019, 1:58 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Remove dead code
Oct 14 2019, 1:56 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/177/ for more details.

Oct 14 2019, 1:55 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package.loader: Clarify download_package contract
  • package.debian: Compute the dsc information
  • debian: Remove duplicated computations step
Oct 14 2019, 1:54 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/176/ for more details.

Oct 14 2019, 10:05 AM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Improve docstrings

Oct 14 2019, 10:03 AM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/175/ for more details.

Oct 14 2019, 9:51 AM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Branch diff to debian-loader branch

Oct 14 2019, 9:50 AM · Debian loader, Core Loader

Oct 13 2019

swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/174/ for more details.

Oct 13 2019, 6:20 PM · Debian loader, Core Loader
ardumont added inline comments to D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 13 2019, 6:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Remove unneeded overridden implementation (gnu)

Oct 13 2019, 6:18 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 13 2019, 6:16 PM · Debian loader, Core Loader
ardumont added inline comments to D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 13 2019, 6:14 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/173/ for more details.

Oct 13 2019, 6:03 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package: Fix py3.5 incompatibilities
Oct 13 2019, 6:02 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:55 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:55 PM · Debian loader, Core Loader
Harbormaster failed remote builds in B8382: Diff 7168 for D2135: package.debian: Re-implement debian loader within the package loader mechanism!
Oct 13 2019, 5:53 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:53 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • package.loader: Fix type check annotation invalid in py3.5
Oct 13 2019, 5:52 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:49 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:46 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

I'm not sure the ci can build a diff when not on master...

[tox] $ git reset --hard origin/master
HEAD is now at c0af471 tox.ini: Fix py3 environment to only tests the swh/loader tests
[tox] $ git clean -fd -f
[tox] $ git submodule update --init --recursive
[tox] $ arc patch --diff 7167 --nocommit --nobranch --force --conduit-uri=https://forge.softwareheritage.org/ ********

This diff is against origin/package-loader...

Oct 13 2019, 5:43 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 13 2019, 5:38 PM · Debian loader, Core Loader

Oct 12 2019

ardumont added inline comments to D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 12 2019, 8:05 PM · Debian loader, Core Loader
ardumont added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build has FAILED

Oct 12 2019, 8:02 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 12 2019, 8:00 PM · Debian loader, Core Loader

Oct 1 2019

ardumont closed T2017: package loader: Discuss revision metadata normalization as Resolved.
Oct 1 2019, 6:46 PM · Metadata workflow, Restricted Project, Core Loader
ardumont added a parent task for T2017: package loader: Discuss revision metadata normalization: T1389: Implement a base "package" loader for package managers.
Oct 1 2019, 6:46 PM · Metadata workflow, Restricted Project, Core Loader
ardumont renamed T2017: package loader: Discuss revision metadata normalization from Discuss revision metadata normalization to package loader: Discuss revision metadata normalization.
Oct 1 2019, 6:45 PM · Metadata workflow, Restricted Project, Core Loader
ardumont added a comment to T2017: package loader: Discuss revision metadata normalization.

For the following, we will focus on package loader metadata.

Oct 1 2019, 2:31 PM · Metadata workflow, Restricted Project, Core Loader

Sep 30 2019

moranegg added projects to T2017: package loader: Discuss revision metadata normalization: Restricted Project, Metadata workflow.
Sep 30 2019, 11:22 AM · Metadata workflow, Restricted Project, Core Loader

Sep 28 2019

ardumont updated the task description for T2017: package loader: Discuss revision metadata normalization.
Sep 28 2019, 1:32 PM · Metadata workflow, Restricted Project, Core Loader

Sep 27 2019

ardumont triaged T2017: package loader: Discuss revision metadata normalization as Normal priority.
Sep 27 2019, 12:18 PM · Metadata workflow, Restricted Project, Core Loader

Sep 24 2019

ardumont added a comment to D2028: [wip] package-loader: Implement a common package loader mechanism.

roh, i did not want to close it...
I just wanted to update the diff... oh, well!

Sep 24 2019, 2:39 PM · Npm loader, PyPI loader, Origin-GNU, Core Loader
ardumont closed D2028: [wip] package-loader: Implement a common package loader mechanism.
Sep 24 2019, 2:37 PM · Npm loader, PyPI loader, Origin-GNU, Core Loader
ardumont updated the summary of D2028: [wip] package-loader: Implement a common package loader mechanism.
Sep 24 2019, 10:08 AM · Npm loader, PyPI loader, Origin-GNU, Core Loader

Apr 8 2019

ardumont closed D1364: swh.loader.core.utils: Add coverage on utils module.
Apr 8 2019, 11:37 AM · Core Loader
swh-public-ci added a comment to D1364: swh.loader.core.utils: Add coverage on utils module.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/113/ for more details.

Apr 8 2019, 11:30 AM · Core Loader
ardumont updated the diff for D1364: swh.loader.core.utils: Add coverage on utils module.
  • test_utils: Use @patch directly to declare expected behavior
Apr 8 2019, 11:28 AM · Core Loader
vlorentz accepted D1364: swh.loader.core.utils: Add coverage on utils module.
Apr 8 2019, 10:00 AM · Core Loader
vlorentz added a comment to D1364: swh.loader.core.utils: Add coverage on utils module.
@patch('foo')
def test_bar(foo):
    foo.return_value = 42
    pass # ...
Apr 8 2019, 9:59 AM · Core Loader

Apr 6 2019

swh-public-ci added a comment to D1364: swh.loader.core.utils: Add coverage on utils module.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/112/ for more details.

Apr 6 2019, 11:46 AM · Core Loader
ardumont added a project to D1364: swh.loader.core.utils: Add coverage on utils module: Core Loader.
Apr 6 2019, 11:45 AM · Core Loader
ardumont closed D1337: core.loader: Adapt according to latest storage api change.
Apr 6 2019, 10:07 AM · Core Loader
ardumont added a comment to D1337: core.loader: Adapt according to latest storage api change.

In a further step, it'd be nicer to make the loader-core counters compatible with the parsing done in swh.storage, so we can get a breakdown of operations per loader without jumping through too many hoops

Apr 6 2019, 9:30 AM · Core Loader
swh-public-ci added a comment to D1337: core.loader: Adapt according to latest storage api change.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/104/ for more details.

Apr 6 2019, 9:29 AM · Core Loader
ardumont updated the diff for D1337: core.loader: Adapt according to latest storage api change.

Remove badly named counter

Apr 6 2019, 9:27 AM · Core Loader

Apr 5 2019

ardumont triaged T1626: loader-core: Unify counter with the storage's results as Normal priority.
Apr 5 2019, 9:44 AM · Core Loader
ardumont added inline comments to D1337: core.loader: Adapt according to latest storage api change.
Apr 5 2019, 9:42 AM · Core Loader

Apr 4 2019

olasd accepted D1337: core.loader: Adapt according to latest storage api change.

It feels a little weird to have different counters in the dict and in the logs, but this is after filtering out the existing objects so the difference should be minimal anyway.

Apr 4 2019, 5:23 PM · Core Loader
swh-public-ci added a comment to D1337: core.loader: Adapt according to latest storage api change.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/103/ for more details.

Apr 4 2019, 2:43 PM · Core Loader
swh-public-ci added a comment to D1337: core.loader: Adapt according to latest storage api change.

Build has FAILED

Apr 4 2019, 11:47 AM · Core Loader

Apr 3 2019

Harbormaster failed remote builds in B5056: Diff 4289 for D1337: core.loader: Adapt according to latest storage api change!
Apr 3 2019, 6:16 PM · Core Loader
swh-public-ci added a comment to D1337: core.loader: Adapt according to latest storage api change.

Build has FAILED

Apr 3 2019, 6:16 PM · Core Loader
ardumont updated the diff for D1337: core.loader: Adapt according to latest storage api change.

Fix api call to origin_visit_update api

Apr 3 2019, 6:15 PM · Core Loader
olasd added inline comments to D1337: core.loader: Adapt according to latest storage api change.
Apr 3 2019, 3:43 PM · Core Loader
olasd added inline comments to D1337: core.loader: Adapt according to latest storage api change.
Apr 3 2019, 3:42 PM · Core Loader
ardumont updated the summary of D1337: core.loader: Adapt according to latest storage api change.
Apr 3 2019, 3:25 PM · Core Loader
swh-public-ci added a comment to D1337: core.loader: Adapt according to latest storage api change.

Build has FAILED

Apr 3 2019, 3:15 PM · Core Loader
Harbormaster failed remote builds in B5047: Diff 4280 for D1337: core.loader: Adapt according to latest storage api change!
Apr 3 2019, 3:15 PM · Core Loader
ardumont updated the diff for D1337: core.loader: Adapt according to latest storage api change.

snapshot_add now takes a list of snapshot as input

Apr 3 2019, 3:14 PM · Core Loader
ardumont added a comment to D1337: core.loader: Adapt according to latest storage api change.
In D1337#28947, @olasd wrote:

I wonder if it wouldn't make sense to just turn the counter attribute into a dict compatible with the output of the storage functions...

Apr 3 2019, 3:10 PM · Core Loader
ardumont added inline comments to D1337: core.loader: Adapt according to latest storage api change.
Apr 3 2019, 3:10 PM · Core Loader
vlorentz added inline comments to D1337: core.loader: Adapt according to latest storage api change.
Apr 3 2019, 2:57 PM · Core Loader
olasd added a comment to D1337: core.loader: Adapt according to latest storage api change.

I wonder if it wouldn't make sense to just turn the counter attribute into a dict compatible with the output of the storage functions...

Apr 3 2019, 2:51 PM · Core Loader
Harbormaster failed remote builds in B5037: Diff 4270 for D1337: core.loader: Adapt according to latest storage api change!
Apr 3 2019, 2:20 PM · Core Loader
swh-public-ci added a comment to D1337: core.loader: Adapt according to latest storage api change.

Build has FAILED

Apr 3 2019, 2:20 PM · Core Loader
ardumont updated the summary of D1337: core.loader: Adapt according to latest storage api change.
Apr 3 2019, 2:20 PM · Core Loader
ardumont added a project to D1337: core.loader: Adapt according to latest storage api change: Core Loader.
Apr 3 2019, 2:19 PM · Core Loader

Feb 19 2019

olasd added a parent task for T1461: Add loader-related metrics to swh-loader-core: T1535: Deploy prometheus-statsd-exporter to gather per-worker metrics.
Feb 19 2019, 2:25 PM · Core Loader, Metrics/monitoring

Jan 8 2019

olasd triaged T1461: Add loader-related metrics to swh-loader-core as High priority.
Jan 8 2019, 11:45 AM · Core Loader, Metrics/monitoring

Dec 13 2018

vlorentz closed T1300: Release swh-loader-core v0.0.36 as Resolved.
Dec 13 2018, 1:32 PM · Core Loader

Dec 5 2018

vlorentz closed T1393: swh/loader/core/loader.py has no proper test coverage as Resolved.

Resolved by D770.

Dec 5 2018, 3:23 PM · Core Loader

Dec 4 2018

vlorentz added a parent task for T1393: swh/loader/core/loader.py has no proper test coverage: T1411: reach a minimum of 80% SLOC coverage across all components.
Dec 4 2018, 11:32 AM · Core Loader