Page MenuHomeSoftware Heritage

ardumont (Antoine R. Dumont)
UserAdministrator

User Details

User Since
Sep 7 2015, 3:42 PM (214 w, 22 h)
Roles
Administrator

Recent Activity

Today

ardumont abandoned D1728: swh.loader.cran: Implement CRAN loader.
Tue, Oct 15, 2:27 PM
ardumont commandeered D1728: swh.loader.cran: Implement CRAN loader.
Tue, Oct 15, 2:27 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Tue, Oct 15, 2:21 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Tue, Oct 15, 2:19 PM
ardumont requested changes to D2141: Add a command-line too to run metadata translation..
Tue, Oct 15, 2:11 PM
ardumont updated the summary of D2135: debian: Implement debian loader with package loader mechanism.
Tue, Oct 15, 2:08 PM · Debian loader, Core Loader
ardumont added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Tue, Oct 15, 2:05 PM
ardumont created D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Tue, Oct 15, 2:02 PM
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Add test to demonstrate we visit twice the artifacts for 2 visits (with no
change in between)

Tue, Oct 15, 1:59 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • debian.loader: Update typing annotations
  • debian: Explicit we visit twice the same artifacts across 2 visits
  • package.debian: Check for known revisions using snapshot if any
Tue, Oct 15, 1:58 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: debian: Implement debian loader with package loader mechanism.
Tue, Oct 15, 1:11 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: debian: Implement debian loader with package loader mechanism.
Tue, Oct 15, 1:10 PM · Debian loader, Core Loader
ardumont updated the diff for D2134: debian.lister: Add integration test which checks scheduled tasks.

Rebase to latest master

Tue, Oct 15, 12:24 PM
ardumont committed rDLS960868badb08: pypi.tests: Remove trailing _ in test method name (authored by ardumont).
pypi.tests: Remove trailing _ in test method name
Tue, Oct 15, 12:23 PM
ardumont committed rDLSb73c657ea7a2: npm.lister: Align docstrings (authored by ardumont).
npm.lister: Align docstrings
Tue, Oct 15, 12:23 PM
ardumont committed rDLSb4867ccda965: npm.tests: Add an integration test on listing with pagination (authored by ardumont).
npm.tests: Add an integration test on listing with pagination
Tue, Oct 15, 12:23 PM
ardumont closed D2139: npm.tests: Add an integration test on listing with pagination.
Tue, Oct 15, 12:23 PM
ardumont updated the diff for D2139: npm.tests: Add an integration test on listing with pagination.

Branch diff to master

Tue, Oct 15, 12:20 PM
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Diff against package-loader (not master :/)

Tue, Oct 15, 12:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • test_debian: Add test around get_package_metadata function
Tue, Oct 15, 12:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2139: npm.tests: Add an integration test on listing with pagination.

Fix wrong typing import

Tue, Oct 15, 11:20 AM
ardumont updated the diff for D2139: npm.tests: Add an integration test on listing with pagination.

Fix docstring

Tue, Oct 15, 11:02 AM
ardumont created D2139: npm.tests: Add an integration test on listing with pagination.
Tue, Oct 15, 10:55 AM
ardumont added inline comments to D2109: rpc-server: Use directly the package's server module to start server.
Tue, Oct 15, 10:05 AM · System administration

Yesterday

ardumont added inline comments to D2134: debian.lister: Add integration test which checks scheduled tasks.
Mon, Oct 14, 6:30 PM
ardumont updated the diff for D2134: debian.lister: Add integration test which checks scheduled tasks.

Use latest pytest_plugin fixture with http support

Mon, Oct 14, 6:27 PM
ardumont committed rDLSa8cde12d72bd: tests: Update pytest_plugin according to latest version change (authored by ardumont).
tests: Update pytest_plugin according to latest version change
Mon, Oct 14, 6:21 PM
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • debian.tests: Update pytest_plugin version use
Mon, Oct 14, 6:13 PM · Debian loader, Core Loader
ardumont committed rDLDBASE0f217d7cc33a: Remove unused dataset (authored by ardumont).
Remove unused dataset
Mon, Oct 14, 6:09 PM
ardumont committed rDLDBASEfbf387fa9318: package.tests: Update pytest_plugin version use (authored by ardumont).
package.tests: Update pytest_plugin version use
Mon, Oct 14, 6:04 PM
ardumont committed rDCOREb89a97dddc99: pytest_plugin: Add support for http request (debian lister related) (authored by ardumont).
pytest_plugin: Add support for http request (debian lister related)
Mon, Oct 14, 5:52 PM
ardumont closed D2133: pytest_plugin: Add support for http request (debian lister related).
Mon, Oct 14, 5:52 PM
ardumont updated the diff for D2133: pytest_plugin: Add support for http request (debian lister related).

Update to look for file in top-level directory as <http_scheme>_<hostname>

Mon, Oct 14, 5:48 PM
ardumont updated the summary of D2133: pytest_plugin: Add support for http request (debian lister related).
Mon, Oct 14, 5:47 PM
ardumont added a comment to D2133: pytest_plugin: Add support for http request (debian lister related).

I'd rather change that after merging the package-loader branch if you don't mind.

Mon, Oct 14, 5:44 PM
ardumont updated the diff for D2133: pytest_plugin: Add support for http request (debian lister related).

Update according to the right suggestion of not mixing http/https data folder

Mon, Oct 14, 4:22 PM
ardumont added a comment to D2133: pytest_plugin: Add support for http request (debian lister related).

It's really just a mv of the top level directory; But I was really suggesting adding support, not replacing the current implementation.

Mon, Oct 14, 4:20 PM
ardumont added a comment to D2133: pytest_plugin: Add support for http request (debian lister related).

Could we make the top-level directory <domain_name>_http or http_<domain_name> for http-only requests?

Mon, Oct 14, 4:12 PM
ardumont added a comment to D2089: [WIP]Remove origin ids..

Doesn't this need a rebase?

Mon, Oct 14, 3:55 PM
ardumont accepted D1727: Immediately download archive if already cooked by the vault.

Looks good.

Mon, Oct 14, 3:54 PM
ardumont updated the summary of D2138: loader.debian: Send only the origin url instead of the origin dict.
Mon, Oct 14, 3:45 PM
ardumont updated the summary of D2137: schemata: Send only origin url for scheduling debian loader tasks.
Mon, Oct 14, 3:45 PM
ardumont updated the summary of D2138: loader.debian: Send only the origin url instead of the origin dict.
Mon, Oct 14, 3:44 PM
ardumont updated the summary of D2137: schemata: Send only origin url for scheduling debian loader tasks.
Mon, Oct 14, 3:42 PM
ardumont updated the summary of D2137: schemata: Send only origin url for scheduling debian loader tasks.
Mon, Oct 14, 3:40 PM
ardumont created D2138: loader.debian: Send only the origin url instead of the origin dict.
Mon, Oct 14, 3:39 PM
ardumont updated the diff for D2137: schemata: Send only origin url for scheduling debian loader tasks.

Rebase on latest master

Mon, Oct 14, 3:14 PM
ardumont created D2137: schemata: Send only origin url for scheduling debian loader tasks.
Mon, Oct 14, 3:06 PM
ardumont updated the diff for D2134: debian.lister: Add integration test which checks scheduled tasks.

Unify logger variable

Mon, Oct 14, 2:59 PM
ardumont updated the diff for D2134: debian.lister: Add integration test which checks scheduled tasks.

Rebase on latest master

Mon, Oct 14, 2:53 PM
ardumont committed rDLS9a1314c65609: tox.ini: Install ipdb dependency for development environment (authored by ardumont).
tox.ini: Install ipdb dependency for development environment
Mon, Oct 14, 2:53 PM
ardumont committed rDLSfcd8521622c9: tests/conftest: Log the db url used by tests (authored by ardumont).
tests/conftest: Log the db url used by tests
Mon, Oct 14, 2:53 PM
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • debian: Expose debian loader implementation first
Mon, Oct 14, 2:25 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Improve dosctrings

Mon, Oct 14, 2:24 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Add missing type annotations

Mon, Oct 14, 2:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • debian: Simplify build revision code
Mon, Oct 14, 2:16 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • debian: Remove dead code
Mon, Oct 14, 1:56 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • package.loader: Clarify download_package contract
  • package.debian: Compute the dsc information
  • debian: Remove duplicated computations step
Mon, Oct 14, 1:54 PM · Debian loader, Core Loader
ardumont accepted D2090: tests: refactor main storage tests.
Mon, Oct 14, 1:13 PM
ardumont accepted D2117: tests/algos: rewrite test_snapshot with pytest.
Mon, Oct 14, 11:11 AM
ardumont accepted D2090: tests: refactor main storage tests.
Mon, Oct 14, 11:06 AM
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Improve docstrings

Mon, Oct 14, 10:03 AM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Branch diff to debian-loader branch

Mon, Oct 14, 9:50 AM · Debian loader, Core Loader
ardumont committed rDLDBASE89f05060ef37: package: Fix py3.5 incompatibilities (authored by ardumont).
package: Fix py3.5 incompatibilities
Mon, Oct 14, 9:49 AM
ardumont committed rDLDBASE58f2927a148b: tox.ini: Install a py3-dev environment to ease development (authored by ardumont).
tox.ini: Install a py3-dev environment to ease development
Mon, Oct 14, 9:49 AM

Sun, Oct 13

ardumont changed the status of T2032: listers: Add proper integration tests to lister from Open to Work in Progress.
Sun, Oct 13, 6:37 PM · Lister
ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Sun, Oct 13, 6:37 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism from Open to Work in Progress.
Sun, Oct 13, 6:37 PM · Origin-Debian, Debian loader, Archive coverage
ardumont retitled D2136: jenkins-jobs: swh-tox: Allow job to build against remote branch (different than master) from jenkins-jobs: swh-tox: Allow job to build against remote branch to jenkins-jobs: swh-tox: Allow job to build against remote branch (different than master).
Sun, Oct 13, 6:35 PM
ardumont added inline comments to D2135: debian: Implement debian loader with package loader mechanism.
Sun, Oct 13, 6:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.

Remove unneeded overridden implementation (gnu)

Sun, Oct 13, 6:18 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: debian: Implement debian loader with package loader mechanism.
Sun, Oct 13, 6:16 PM · Debian loader, Core Loader
ardumont added inline comments to D2135: debian: Implement debian loader with package loader mechanism.
Sun, Oct 13, 6:14 PM · Debian loader, Core Loader
ardumont created D2136: jenkins-jobs: swh-tox: Allow job to build against remote branch (different than master).
Sun, Oct 13, 6:10 PM
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • package: Fix py3.5 incompatibilities
Sun, Oct 13, 6:02 PM · Debian loader, Core Loader
ardumont added a comment to D2135: debian: Implement debian loader with package loader mechanism.

Build has FAILED

Sun, Oct 13, 5:55 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: debian: Implement debian loader with package loader mechanism.
  • package.loader: Fix type check annotation invalid in py3.5
Sun, Oct 13, 5:52 PM · Debian loader, Core Loader
ardumont added a comment to D2135: debian: Implement debian loader with package loader mechanism.

Build has FAILED

Sun, Oct 13, 5:46 PM · Debian loader, Core Loader
ardumont added a comment to D2135: debian: Implement debian loader with package loader mechanism.

Build has FAILED

I'm not sure the ci can build a diff when not on master...

[tox] $ git reset --hard origin/master
HEAD is now at c0af471 tox.ini: Fix py3 environment to only tests the swh/loader tests
[tox] $ git clean -fd -f
[tox] $ git submodule update --init --recursive
[tox] $ arc patch --diff 7167 --nocommit --nobranch --force --conduit-uri=https://forge.softwareheritage.org/ ********

This diff is against origin/package-loader...

Sun, Oct 13, 5:43 PM · Debian loader, Core Loader

Sat, Oct 12

ardumont added inline comments to D2135: debian: Implement debian loader with package loader mechanism.
Sat, Oct 12, 8:05 PM · Debian loader, Core Loader
ardumont added a comment to D2135: debian: Implement debian loader with package loader mechanism.

Build has FAILED

Sat, Oct 12, 8:02 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: debian: Implement debian loader with package loader mechanism.
Sat, Oct 12, 8:00 PM · Debian loader, Core Loader
ardumont retitled D2135: debian: Implement debian loader with package loader mechanism from tox.ini: Install a py3-dev environment to ease development to debian: Implement debian loader with package loader mechanism.
Sat, Oct 12, 7:59 PM · Debian loader, Core Loader
ardumont created D2135: debian: Implement debian loader with package loader mechanism.
Sat, Oct 12, 7:58 PM · Debian loader, Core Loader
ardumont updated the summary of D2133: pytest_plugin: Add support for http request (debian lister related).
Sat, Oct 12, 5:07 PM
ardumont added a comment to T2025: Re-implement debian loader with package loader mechanism.

Current input of the debian loader (without the optimization) (outputed from the lister):

Sat, Oct 12, 9:27 AM · Origin-Debian, Debian loader, Archive coverage
ardumont added a comment to D2134: debian.lister: Add integration test which checks scheduled tasks.

I don't recall that what we saw (and it's way better as that seems consistent with the current loader ;).

Sat, Oct 12, 8:34 AM
ardumont added inline comments to D2134: debian.lister: Add integration test which checks scheduled tasks.
Sat, Oct 12, 8:09 AM
ardumont accepted D2117: tests/algos: rewrite test_snapshot with pytest.
Sat, Oct 12, 7:51 AM
ardumont added inline comments to D2134: debian.lister: Add integration test which checks scheduled tasks.
Sat, Oct 12, 7:50 AM
ardumont created D2134: debian.lister: Add integration test which checks scheduled tasks.
Sat, Oct 12, 5:12 AM
ardumont created D2133: pytest_plugin: Add support for http request (debian lister related).
Sat, Oct 12, 5:12 AM
ardumont committed rDLSf92ac8364612: bitbucket.lister: Add integration test which checks scheduled tasks (authored by ardumont).
bitbucket.lister: Add integration test which checks scheduled tasks
Sat, Oct 12, 5:07 AM
ardumont committed rDLS6b1c3d1fee86: lister.core.db_utils: Remove dead code (authored by ardumont).
lister.core.db_utils: Remove dead code
Sat, Oct 12, 5:07 AM
ardumont committed rDLS0b8b1419e14a: github.lister: Add integration test which checks scheduled tasks (authored by ardumont).
github.lister: Add integration test which checks scheduled tasks
Sat, Oct 12, 5:07 AM
ardumont committed rDLS1889875f67cc: gitlab.lister: Add integration test which checks scheduled tasks (authored by ardumont).
gitlab.lister: Add integration test which checks scheduled tasks
Sat, Oct 12, 5:07 AM
ardumont committed rDLS2a33f43006c9: tox.ini: Install a py3-dev environment to ease development (authored by ardumont).
tox.ini: Install a py3-dev environment to ease development
Sat, Oct 12, 5:07 AM
ardumont updated the task description for T2032: listers: Add proper integration tests to lister.
Sat, Oct 12, 2:59 AM · Lister

Fri, Oct 11

ardumont accepted D2091: test_storage: kill StorageTestDbFixture class.
Fri, Oct 11, 7:04 PM
ardumont accepted D2119: test_api_client: refactor the code for new pytest based infra.
Fri, Oct 11, 7:03 PM