Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 23 2022

ardumont updated the diff for D8874: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.

Update (not using a variable as this fails the build)

Nov 23 2022, 2:34 PM
ardumont added a reviewer for D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump: anlambert.
Nov 23 2022, 2:20 PM
ardumont updated the test plan for D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.
Nov 23 2022, 2:19 PM
ardumont updated the diff for D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.

Hardcode the path to rsvndump which got emptied when using a variable (for some reason)

Nov 23 2022, 12:09 PM
ardumont requested review of D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.
Nov 23 2022, 11:53 AM
ardumont updated the diff for D8874: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.

Rebase and add comment

Nov 23 2022, 11:41 AM
ardumont committed rDDOCa73683535d84: upgrade-swh-service: Fix mistyped label (authored by ardumont).
upgrade-swh-service: Fix mistyped label
Nov 23 2022, 11:07 AM
ardumont added inline comments to D8872: loader: Add logs displaying path differences after revision replay.
Nov 23 2022, 10:55 AM
ardumont requested review of D8874: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.
Nov 23 2022, 10:50 AM
ardumont accepted D8865: luigi: Add LocalExport task.

lgtm but fix the typo in the docstring cli parameter ;)

Nov 23 2022, 10:23 AM
ardumont added a comment to D8873: storage: Insert from temporary tables in consistent order.

lgtm but this is missing the migration script update first (and the bump in the schema version somewhere?).

Nov 23 2022, 10:18 AM

Nov 22 2022

ardumont accepted D8872: loader: Add logs displaying path differences after revision replay.

one non blocking suggestion inline

Nov 22 2022, 6:08 PM
ardumont closed D8871: sysadm/upgrade-swh-services: Update the build deps step.
Nov 22 2022, 5:09 PM
ardumont committed rDDOCb085723a041a: upgrade-swh-services: Update the build deps step (authored by ardumont).
upgrade-swh-services: Update the build deps step
Nov 22 2022, 5:09 PM
ardumont accepted D8863: ExtrinsicMetadataIndexer: Add support for metadata with origin in context.
Nov 22 2022, 5:07 PM
ardumont accepted D8864: luigi: Remove copies of stamp files to/from S3.
Nov 22 2022, 5:05 PM
ardumont updated the diff for D8871: sysadm/upgrade-swh-services: Update the build deps step.

Adapt according to remark

Nov 22 2022, 5:00 PM
ardumont added a comment to D8871: sysadm/upgrade-swh-services: Update the build deps step.

Just an inline remark but otherwise it's ok.

Nov 22 2022, 4:59 PM
ardumont requested review of D8871: sysadm/upgrade-swh-services: Update the build deps step.
Nov 22 2022, 4:53 PM
ardumont added inline comments to D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 22 2022, 4:52 PM
ardumont committed rDDOC999e6d68d9d7: Upgrade services: Add elastic deployment chapter (authored by ardumont).
Upgrade services: Add elastic deployment chapter
Nov 22 2022, 9:33 AM
ardumont closed D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 22 2022, 9:33 AM
ardumont committed rDDOCd8b2c7c1e504: Upgrade services: Rewrote part to prepare the elastic deployment part (authored by ardumont).
Upgrade services: Rewrote part to prepare the elastic deployment part
Nov 22 2022, 9:33 AM

Nov 21 2022

ardumont added inline comments to D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 21 2022, 6:22 PM
ardumont added a comment to D8856: deployment/upgrade-swh-services: Update with elastic deployment part.

The second part looks good to me. :)

Nov 21 2022, 6:08 PM
ardumont accepted D8866: luigi: Add swh-dataset version to export/meta.json.
Nov 21 2022, 4:44 PM
ardumont updated the summary of D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 21 2022, 2:49 PM
ardumont accepted D8861: origin_head: Do not fetch complete snapshots for non-FTP visits.
Nov 21 2022, 2:47 PM
ardumont updated the diff for D8856: deployment/upgrade-swh-services: Update with elastic deployment part.

Fix build

Nov 21 2022, 2:41 PM
ardumont added inline comments to D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 21 2022, 1:51 PM
ardumont updated the diff for D8856: deployment/upgrade-swh-services: Update with elastic deployment part.

Adapt according to first round of review

Nov 21 2022, 1:51 PM

Nov 18 2022

ardumont updated the summary of D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 18 2022, 6:33 PM
ardumont retitled D8856: deployment/upgrade-swh-services: Update with elastic deployment part from [wip] deployment/upgrade-swh-services: Update with elastic deployment part to deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 18 2022, 6:32 PM
ardumont requested review of D8856: deployment/upgrade-swh-services: Update with elastic deployment part.
Nov 18 2022, 6:30 PM
ardumont committed rDDOCe50484b0b746: sysadm/deployment: Update to proper inventory links (authored by ardumont).
sysadm/deployment: Update to proper inventory links
Nov 18 2022, 11:50 AM
ardumont committed rDDOC4fa038b4641a: sysadm/deployment: Add intended audience paragraph (authored by ardumont).
sysadm/deployment: Add intended audience paragraph
Nov 18 2022, 11:50 AM
ardumont closed D8854: sysadm/data-silos/kafka: Bootstrap topics management page.
Nov 18 2022, 11:39 AM
ardumont committed rDDOC85aac01298d9: sysadm/data-silos/kafka: Bootstrap topics management page (authored by ardumont).
sysadm/data-silos/kafka: Bootstrap topics management page
Nov 18 2022, 11:39 AM
ardumont updated the diff for D8854: sysadm/data-silos/kafka: Bootstrap topics management page.

Adapt according to review

Nov 18 2022, 11:25 AM
ardumont updated the diff for D8854: sysadm/data-silos/kafka: Bootstrap topics management page.

Rebase

Nov 18 2022, 10:25 AM

Nov 17 2022

ardumont requested review of D8854: sysadm/data-silos/kafka: Bootstrap topics management page.
Nov 17 2022, 6:14 PM
ardumont closed D8853: sysadm/getting-started: Add page regarding repositories bootstrap.
Nov 17 2022, 5:53 PM
ardumont committed rDDOC65edd83bf18d: sysadm/getting-started: Add page regarding repositories bootstrap (authored by ardumont).
sysadm/getting-started: Add page regarding repositories bootstrap
Nov 17 2022, 5:53 PM
ardumont updated the diff for D8853: sysadm/getting-started: Add page regarding repositories bootstrap.

Reword some sentences

Nov 17 2022, 4:58 PM
ardumont requested review of D8853: sysadm/getting-started: Add page regarding repositories bootstrap.
Nov 17 2022, 4:40 PM
ardumont committed rDDOCeed8f11f2261: sysadm/howto-provision-new-vm: Migrate forge.s.o url to gitlab.s.o (authored by ardumont).
sysadm/howto-provision-new-vm: Migrate forge.s.o url to gitlab.s.o
Nov 17 2022, 3:53 PM
ardumont closed D8852: Migrate forge.s.o url to gitlab.s.o.
Nov 17 2022, 3:53 PM
ardumont committed rDDOC280074fb4ca3: deployment/argocd: Migrate forge.s.o url to gitlab.s.o (authored by ardumont).
deployment/argocd: Migrate forge.s.o url to gitlab.s.o
Nov 17 2022, 3:53 PM
ardumont requested review of D8852: Migrate forge.s.o url to gitlab.s.o.
Nov 17 2022, 3:48 PM
ardumont committed rDDOCc345bf6b2145: sysadm: Migrate forge.s.o url to gitlab.s.o (authored by ardumont).
sysadm: Migrate forge.s.o url to gitlab.s.o
Nov 17 2022, 3:14 PM
ardumont committed rDDOCdcae6c16211e: sysadm/third-party: Update links and mention deprecated script (authored by ardumont).
sysadm/third-party: Update links and mention deprecated script
Nov 17 2022, 3:14 PM
ardumont committed rDDOC6dc30f752f63: sysadm/onboarding: Reference new gitlab registration step (authored by ardumont).
sysadm/onboarding: Reference new gitlab registration step
Nov 17 2022, 3:14 PM
ardumont closed D8851: sysadm: Migrate forge.s.o url to gitlab.s.o.
Nov 17 2022, 3:14 PM
ardumont committed rDDOCad4b1f45bef8: sysadm: Migrate forge.s.o url to gitlab.s.o (authored by ardumont).
sysadm: Migrate forge.s.o url to gitlab.s.o
Nov 17 2022, 3:14 PM
ardumont retitled D8851: sysadm: Migrate forge.s.o url to gitlab.s.o from [wip] sysadm: Migrate forge.s.o url to gitlab.s.o to sysadm: Migrate forge.s.o url to gitlab.s.o.
Nov 17 2022, 3:12 PM
ardumont requested review of D8851: sysadm: Migrate forge.s.o url to gitlab.s.o.
Nov 17 2022, 12:14 PM
ardumont accepted D8848: fedora: Update versions in packages dict provided as loader argument.

lgtm, one question inline.

Nov 17 2022, 9:57 AM
ardumont abandoned D8850: swh-loader-svn: Build rsvndump dependency.
Nov 17 2022, 9:36 AM
ardumont added a comment to D8850: swh-loader-svn: Build rsvndump dependency.

Well, wrong forge to push diff.
Fixing that in our gitlab instance [1].

Nov 17 2022, 9:36 AM

Nov 16 2022

ardumont added a reviewer for D8850: swh-loader-svn: Build rsvndump dependency: System administrators.
Nov 16 2022, 4:50 PM
ardumont requested review of D8850: swh-loader-svn: Build rsvndump dependency.
Nov 16 2022, 4:29 PM
ardumont accepted D8841: save_code_now: Allow request creation if previous for origin is running.
Nov 16 2022, 2:56 PM

Nov 15 2022

ardumont updated the diff for D6380: Allow partial snapshot creation during ingestion.

Amend impacted docstrings

Nov 15 2022, 2:25 PM
ardumont accepted D8847: browse: Display branches names in snapshot releases view.
Nov 15 2022, 2:01 PM
ardumont updated the diff for D6380: Allow partial snapshot creation during ingestion.

Adapt according to discussion

Nov 15 2022, 1:59 PM
ardumont closed D8845: Drop unused core.loader.DVCSLoader class.
Nov 15 2022, 12:12 PM
ardumont committed rDLDBASE31ab1aa69e5b: Drop unused core.loader.DVCSLoader class (authored by ardumont).
Drop unused core.loader.DVCSLoader class
Nov 15 2022, 12:12 PM
ardumont requested review of D8845: Drop unused core.loader.DVCSLoader class.
Nov 15 2022, 12:09 PM
ardumont added inline comments to D8842: metadata-search: Return swh-search even when missing from idx_storage.origin_intrinsic_metadata.
Nov 15 2022, 11:08 AM
ardumont accepted D8832: luigi: Add DownloadFromS3 task.
Nov 15 2022, 11:06 AM
ardumont accepted D8843: metadata-search: Skip query to swh-indexer when its results would be discarded.
Nov 15 2022, 11:04 AM
ardumont added inline comments to D8832: luigi: Add DownloadFromS3 task.
Nov 15 2022, 11:01 AM
ardumont accepted D8842: metadata-search: Return swh-search even when missing from idx_storage.origin_intrinsic_metadata.
Nov 15 2022, 11:00 AM

Nov 14 2022

ardumont accepted D8839: maven: Simplify tests with requests_mock_datadir fixture.
Nov 14 2022, 5:44 PM
ardumont accepted D8840: maven: Add support for md5 checkums to check download integrity.
Nov 14 2022, 5:43 PM
ardumont updated the diff for D6380: Allow partial snapshot creation during ingestion.

Fix mistyped signature

Nov 14 2022, 5:39 PM
ardumont updated the diff for D6380: Allow partial snapshot creation during ingestion.

Add coverage (which is a bit convoluted but we are in loader-core so no real loader to
check that actual behavior beyond what i propose).

Nov 14 2022, 5:22 PM
ardumont retitled D6380: Allow partial snapshot creation during ingestion from Improve store_data implem to allow multiple calls with partial visit to Allow partial snapshot creation during ingestion.
Nov 14 2022, 3:51 PM
ardumont added a comment to D6380: Allow partial snapshot creation during ingestion.

Only, more_data_to_fetch/create_snapshot is renamed create_partial_visit though as
that makes more sense now.

Nov 14 2022, 3:50 PM
ardumont updated the diff for D6380: Allow partial snapshot creation during ingestion.
  • Rebase
  • reword commit and diff description
  • adapt parameter according to review suggestion from @vlorentz
Nov 14 2022, 3:48 PM
ardumont accepted D8832: luigi: Add DownloadFromS3 task.

one question inline.

Nov 14 2022, 2:02 PM
ardumont accepted D8834: roadmap-2022: Replace seirl with vlorentz as lead on dataset/graph tasks.
Nov 14 2022, 11:38 AM

Nov 10 2022

ardumont added a comment to D8825: Configure gitlab projects declaratively.

I wonder whether we should merge this config file and that of the other script, so that we get all settings in one place.

What do you think?

Yes, i think so too. But which script, to be sure, manage_user_groups right?

I just started it that way to simplify the reading.
I think that i'll adapt according to what you proposed here then update the diff then we land.

Nov 10 2022, 4:41 PM
ardumont updated the test plan for D8831: Merge gitlab tools to manage groups and projects into a unified cli.
Nov 10 2022, 4:23 PM
ardumont updated the diff for D8831: Merge gitlab tools to manage groups and projects into a unified cli.

Add cli.py

Nov 10 2022, 4:22 PM
ardumont requested review of D8831: Merge gitlab tools to manage groups and projects into a unified cli.
Nov 10 2022, 4:20 PM
ardumont closed D8825: Configure gitlab projects declaratively.
Nov 10 2022, 3:45 PM
ardumont committed rDSNIPecab8f25d50c: Configure gitlab projects declaratively (authored by ardumont).
Configure gitlab projects declaratively
Nov 10 2022, 3:45 PM
ardumont accepted D8828: cli: Move the main code of export_graph to its own function.
Nov 10 2022, 3:44 PM
ardumont accepted D8829: Add luigi tasks.
Nov 10 2022, 3:43 PM
ardumont added a comment to D8829: Add luigi tasks.

one typo inline.

Nov 10 2022, 3:43 PM
ardumont accepted D8827: athena: Fix create_table to work with restricted permissions.
Nov 10 2022, 3:27 PM
ardumont retitled D8825: Configure gitlab projects declaratively from Allow gitlab projects configuration declaratively to Configure gitlab projects declaratively.
Nov 10 2022, 3:26 PM
ardumont accepted D8830: Stop scheduling mirror tests while building Docker images.
Nov 10 2022, 3:24 PM
ardumont updated the summary of D8830: Stop scheduling mirror tests while building Docker images.
Nov 10 2022, 3:24 PM
ardumont updated the diff for D8825: Configure gitlab projects declaratively.

Adapt according to last remark, dump partial json updated project.

Nov 10 2022, 3:23 PM
ardumont updated the test plan for D8825: Configure gitlab projects declaratively.
Nov 10 2022, 3:19 PM
ardumont added a comment to P1526 manage project run in staging.

And fix some staging issues (after that first run):

Nov 10 2022, 3:19 PM
ardumont updated the title for P1526 manage project run in staging from give it a run to manage project run in staging.
Nov 10 2022, 3:12 PM
ardumont created P1526 manage project run in staging.
Nov 10 2022, 2:59 PM