Page MenuHomeSoftware Heritage

ardumont (Antoine R. Dumont)
UserAdministrator

User Details

User Since
Sep 7 2015, 3:42 PM (197 w, 2 d)
Roles
Administrator

Recent Activity

Today

ardumont updated the task description for T881: PostgreSQL backups based on pg_dump.
Thu, Jun 20, 1:53 PM · System administration
ardumont added a comment to T1826: bitbucket lister does not work.

@douardda As discussed orally, i was unsure at the time.

Thu, Jun 20, 1:51 PM · Bitbucket lister, Lister
ardumont triaged T1835: List major cgit instances as Normal priority.
Thu, Jun 20, 1:37 PM · CGit lister, Lister
ardumont edited P440 Migrate lister db.
Thu, Jun 20, 1:29 PM · Lister
ardumont added inline comments to D1610: swh.lister.cgit.
Thu, Jun 20, 12:24 PM
ardumont added inline comments to D1617: Update docs with release artifact and test scenarios.
Thu, Jun 20, 11:26 AM · SWORD deposit
ardumont added inline comments to D1617: Update docs with release artifact and test scenarios.
Thu, Jun 20, 10:20 AM · SWORD deposit
ardumont added a comment to D1610: swh.lister.cgit.

@nahimilega I did not review the diff completely, i let the initial reviewers finalize it.

Thu, Jun 20, 10:10 AM
ardumont accepted D1441: tutorial: How to run a new lister (within docker-dev).
Thu, Jun 20, 10:00 AM
ardumont accepted D1612: swh.lister.gnu: Change origin type to tar.
Thu, Jun 20, 9:58 AM
ardumont updated the summary of D1612: swh.lister.gnu: Change origin type to tar.
Thu, Jun 20, 9:52 AM

Yesterday

ardumont added inline comments to D1610: swh.lister.cgit.
Wed, Jun 19, 1:35 PM
ardumont added a comment to T1755: Create artifact release when 'releaseNotes' is in metadata .

Summarizing the last exchange to:

|-----------------------------------+----------------+-------------------+----------------------------------|
| metadata provided (codeMeta term) | Fallback value | SWH release field | Description                      |
|-----------------------------------+----------------+-------------------+----------------------------------|
| X                                 | X              | target            | revision containing all metadata |
| X                                 | X              | target_type       | hard-coded: 'revision'           |
| softwareVersion                   | X              | name              | Release name if any              |
| releaseNote                       | X              | message           | Release message if any           |
| datePublished (if any)            | `deposit_date` | date              | Publication date                 |
|-----------------------------------+----------------+-------------------+----------------------------------|
Wed, Jun 19, 1:26 PM · SWORD deposit
ardumont accepted D1607: Remove argument origin_id from call to Loader.send_origin_metadata..
Wed, Jun 19, 11:45 AM
ardumont accepted D1604: Use origin urls instead of origin ids (swh-loader-mercurial).
Wed, Jun 19, 11:44 AM
ardumont accepted D1564: Manipulate origin URLs instead of origin ids..
Wed, Jun 19, 11:43 AM
ardumont accepted D1600: Use origin urls instead of origin ids (swh-loader-npm).
Wed, Jun 19, 11:13 AM
ardumont added a comment to D1564: Manipulate origin URLs instead of origin ids..

Don't know why the build now.

Wed, Jun 19, 11:11 AM
ardumont accepted D1561: Update docker-compose logs command in README.
Wed, Jun 19, 10:59 AM
ardumont added a comment to D1574: Added pyblake2 in py3 test dependency.

Thanks for the fix!

Wed, Jun 19, 10:46 AM
ardumont added inline comments to D1603: Use origin urls instead of origin ids (swh-loader-core).
Wed, Jun 19, 10:38 AM
ardumont accepted D1606: Remove columns 'description' and 'origin_id'..

they are never read. origin-id is not even set by listers, and description is only set by half of them, so even if we had a use case for it, we would have to repopulate the table before using it.
And description belongs in the extrinsic metadata workflow anyway.

Wed, Jun 19, 10:37 AM
ardumont updated the summary of D1606: Remove columns 'description' and 'origin_id'..
Wed, Jun 19, 10:36 AM
ardumont added a comment to P440 Migrate lister db.

Related D1606

Wed, Jun 19, 10:35 AM · Lister
ardumont created P440 Migrate lister db.
Wed, Jun 19, 10:34 AM · Lister
ardumont requested changes to D1564: Manipulate origin URLs instead of origin ids..

Sounds good.

Wed, Jun 19, 10:32 AM
ardumont accepted D1595: Make the journal client create tasks for multiple origins instead of one at a time..

Sounds good to me.

Wed, Jun 19, 10:17 AM
ardumont added a comment to D1600: Use origin urls instead of origin ids (swh-loader-npm).

Can you please try and fix the build?

Wed, Jun 19, 10:07 AM
ardumont added a comment to D1607: Remove argument origin_id from call to Loader.send_origin_metadata..

Can you land and tag the loader-core's changes to ensure this build is fine?

Wed, Jun 19, 10:04 AM
ardumont accepted D1586: Don't use a join in origin_visit_get_latest..

sound good to me

Wed, Jun 19, 10:03 AM
ardumont added inline comments to D1604: Use origin urls instead of origin ids (swh-loader-mercurial).
Wed, Jun 19, 9:56 AM
ardumont updated the summary of D1604: Use origin urls instead of origin ids (swh-loader-mercurial).
Wed, Jun 19, 9:55 AM
ardumont added a comment to D1607: Remove argument origin_id from call to Loader.send_origin_metadata..

I just realized the dependency on D1603 for that.
That must be the real reason of the build failure (same goes for the other diff with the extra v in its requirements-swh.txt's version declared on the loader-core).

Wed, Jun 19, 9:55 AM
ardumont updated the summary of D1607: Remove argument origin_id from call to Loader.send_origin_metadata..
Wed, Jun 19, 9:54 AM
ardumont accepted D1603: Use origin urls instead of origin ids (swh-loader-core).

Sounds good (also clearer).

Wed, Jun 19, 9:41 AM
ardumont requested changes to D1604: Use origin urls instead of origin ids (swh-loader-mercurial).

For the build failure which i think i saw the reason, check the extra 'v' in the requirements-swh.txt.

Wed, Jun 19, 9:38 AM
ardumont added a comment to D1600: Use origin urls instead of origin ids (swh-loader-npm).

Build is not ok.

Wed, Jun 19, 9:32 AM
ardumont accepted D1602: Use origin urls instead of origin ids (swh-loader-pypi).

That's even clearer than before!
Thanks.

Wed, Jun 19, 9:31 AM
ardumont accepted D1601: Add direct journal writer to uffizi.

I have a question though in there but that's not blocking.

Wed, Jun 19, 9:24 AM
ardumont accepted D1599: Stop hardcoding journal brokers everywhere.

ah, now i grok better the previous diff \m/
Thanks.

Wed, Jun 19, 9:22 AM
ardumont updated the summary of D1601: Add direct journal writer to uffizi.
Wed, Jun 19, 9:22 AM
ardumont added a comment to D1601: Add direct journal writer to uffizi.

Ho, i just saw a previous diff, i'll amend the description then and repass on it.

Wed, Jun 19, 9:21 AM
ardumont requested changes to D1601: Add direct journal writer to uffizi.

For the sake of missing configuration field (looked multiple times differently and nowhere to be found on my side).

Wed, Jun 19, 9:20 AM
ardumont requested changes to D1606: Remove columns 'description' and 'origin_id'..

For the sake of discussion ;)

Wed, Jun 19, 9:03 AM
ardumont added a comment to D1606: Remove columns 'description' and 'origin_id'..

They are useless.

Wed, Jun 19, 9:03 AM
ardumont requested changes to D1441: tutorial: How to run a new lister (within docker-dev).

Almost there (again).
But this time, i'm right (hopefully ;)

Wed, Jun 19, 8:52 AM
ardumont added a comment to D1441: tutorial: How to run a new lister (within docker-dev).

I did not see it earlier, in your command sample, please insert a space between $ and the start of the command.
I think it's way clearer to read.
Also it eases copy/paste from a user perspective (one cannot always see clearly the limit between the prompt and the start of the cli she wants to execute).

Wed, Jun 19, 8:48 AM

Tue, Jun 18

ardumont accepted D1597: Use origin urls instead of origin ids (swh-loader-svn).

Sounds good.

Tue, Jun 18, 3:09 PM
ardumont updated subscribers of T1826: bitbucket lister does not work.

Heads up, a priori, there is a bootstrap step missing.
@olasd told me it's possible we need to start an incremental one first (thanks).

Tue, Jun 18, 3:07 PM · Bitbucket lister, Lister
ardumont triaged T1826: bitbucket lister does not work as Normal priority.
Tue, Jun 18, 2:58 PM · Bitbucket lister, Lister
ardumont committed rDLSe13912f7118c: phabricator_tests: Add missing headers (authored by ardumont).
phabricator_tests: Add missing headers
Tue, Jun 18, 2:49 PM
ardumont committed rDLSdf2754e5a681: phabricator.tasks: Remove unused code (authored by ardumont).
phabricator.tasks: Remove unused code
Tue, Jun 18, 2:49 PM
ardumont closed T1824: phabricator lister: Clean up incremental lister as Resolved.
Tue, Jun 18, 2:49 PM · Lister
ardumont updated the task description for T1824: phabricator lister: Clean up incremental lister.
Tue, Jun 18, 2:34 PM · Lister
ardumont committed rSPSITE02a2b373faf2: Remove incremental phabricator lister from the midst of listers (authored by ardumont).
Remove incremental phabricator lister from the midst of listers
Tue, Jun 18, 2:33 PM
ardumont triaged T1824: phabricator lister: Clean up incremental lister as Normal priority.
Tue, Jun 18, 2:28 PM · Lister
ardumont added a subtask for T808: phabricator lister: T1809: Deploy phabricator lister on swh forge.
Tue, Jun 18, 2:20 PM · Easy hack, Phabricator forge
ardumont added a parent task for T1809: Deploy phabricator lister on swh forge: T808: phabricator lister.
Tue, Jun 18, 2:20 PM · Lister
ardumont closed T807: dogfooding: ingest the Software Heritage forge into the archive (via the canonical URLs) as Resolved.
Tue, Jun 18, 2:19 PM · General
ardumont added a comment to P438 Grunt: Incremental phabricator lister fails with the following.

Ok, so without further ado, removing the incremental phabricator lister.
It does not really exist.

Tue, Jun 18, 2:11 PM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 2:10 PM · Lister
ardumont created P438 Grunt: Incremental phabricator lister fails with the following.
Tue, Jun 18, 1:57 PM · Lister
ardumont closed T1801: List all origins from major phabricator instances as Resolved.
Tue, Jun 18, 1:52 PM · Lister
ardumont renamed T1801: List all origins from major phabricator instances from list all origins from major phabricator instances to List all origins from major phabricator instances.
Tue, Jun 18, 1:52 PM · Lister
ardumont added a comment to T1801: List all origins from major phabricator instances.

From swh-lister db, all "main" instances listed:

Tue, Jun 18, 1:51 PM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 1:47 PM · Lister
ardumont added a comment to P437 wikimedia phabricator lister: ChunkedEncodingError.

Might be a flaky thing somewhere in our stack.
Rescheduling that task and it worked.

Tue, Jun 18, 1:41 PM · Lister
ardumont updated the title for P437 wikimedia phabricator lister: ChunkedEncodingError from wikimedia lister: ChunkedEncodingError to wikimedia phabricator lister: ChunkedEncodingError.
Tue, Jun 18, 1:37 PM · Lister
ardumont added a comment to P437 wikimedia phabricator lister: ChunkedEncodingError.

docker-run tryout for that same forge was fine.

Tue, Jun 18, 1:36 PM · Lister
ardumont created P437 wikimedia phabricator lister: ChunkedEncodingError.
Tue, Jun 18, 1:34 PM · Lister
ardumont added a comment to P436 blender phabricator lister failure.

Related T1801

Tue, Jun 18, 1:33 PM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 1:18 PM · Lister
ardumont added a comment to P436 blender phabricator lister failure.

Well, yeah, the real forge is https://developer.blender.org!

Tue, Jun 18, 1:18 PM · Lister
ardumont added a project to P436 blender phabricator lister failure: Lister.
Tue, Jun 18, 1:12 PM · Lister
ardumont created P436 blender phabricator lister failure.
Tue, Jun 18, 1:11 PM · Lister
ardumont added a comment to D1561: Update docker-compose logs command in README.

Which I changed here in this diff.

Tue, Jun 18, 12:20 PM
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 12:17 PM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 12:00 PM · Lister
ardumont added inline comments to D1441: tutorial: How to run a new lister (within docker-dev).
Tue, Jun 18, 11:44 AM
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 11:29 AM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 10:57 AM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 10:46 AM · Lister
ardumont added a comment to P434 After swh phabricator lister deployment: Alter swh-lister's phabricator table.

Migration done.

Tue, Jun 18, 10:45 AM · Lister
ardumont updated the test plan for D1594: phabricator: model: Reference the forge's instance name in model.
Tue, Jun 18, 10:44 AM
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 10:43 AM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 10:37 AM · Lister
ardumont updated the task description for T1801: List all origins from major phabricator instances.
Tue, Jun 18, 10:35 AM · Lister
ardumont committed rSPSITEd920b4c87ade: cleanup prado reference from infra (authored by ardumont).
cleanup prado reference from infra
Tue, Jun 18, 10:29 AM
ardumont closed D1593: cleanup prado reference from infra.
Tue, Jun 18, 10:29 AM
ardumont committed rDLSaf681ac1284e: phabricator: model: Reference the forge's instance name in model (authored by ardumont).
phabricator: model: Reference the forge's instance name in model
Tue, Jun 18, 10:27 AM
ardumont committed rDLSfc92c79b7ec5: models: Unify tablenames using singular as main archive's convention (authored by ardumont).
models: Unify tablenames using singular as main archive's convention
Tue, Jun 18, 10:27 AM
ardumont closed D1594: phabricator: model: Reference the forge's instance name in model.
Tue, Jun 18, 10:27 AM
ardumont retitled D1582: Add comments to tables dbversion, content, skipped_content and fetch_history from Added comments to tables dbversion, content, skipped_content and fetch_history to Add comments to tables dbversion, content, skipped_content and fetch_history.
Tue, Jun 18, 10:26 AM
ardumont retitled D1590: Add comments to few columns in dbversion, task and task_run from Added comments to few columns in dbversion, task and task_run to Add comments to few columns in dbversion, task and task_run.
Tue, Jun 18, 10:26 AM
ardumont added a comment to D1574: Added pyblake2 in py3 test dependency.

A middle-ground would be to change swh-model to install pyblake2 on all systems with a Python < 3.6, by using this in the dependency declaration: extras_require={':python_version<"3.6"':: ['pyblake2']}

Tue, Jun 18, 10:25 AM
ardumont added a comment to D1534: Add blake2s256 hash in the output of directory_ls..

If we apply this logic, it's not only on directory that this is missing...

Tue, Jun 18, 10:12 AM
ardumont closed T1809: Deploy phabricator lister on swh forge, a subtask of T1797: Deploy new listers (gnu, phabricator), as Resolved.
Tue, Jun 18, 9:53 AM · Lister
ardumont closed T1809: Deploy phabricator lister on swh forge as Resolved.
Tue, Jun 18, 9:53 AM · Lister
ardumont updated the task description for T1809: Deploy phabricator lister on swh forge.
Tue, Jun 18, 9:52 AM · Lister
ardumont updated subscribers of D1594: phabricator: model: Reference the forge's instance name in model.
Tue, Jun 18, 7:42 AM