Page MenuHomeSoftware Heritage
Feed All Stories

Nov 24 2022

anlambert committed rDLDSVNbcd1e753c60b: svn: Also escape hash signs in URLs to avoid libsvn assertion (authored by anlambert).
svn: Also escape hash signs in URLs to avoid libsvn assertion
Nov 24 2022, 11:38 AM
anlambert requested changes to D8881: Document the need for higher vm.max_map_count.
Nov 24 2022, 11:35 AM
anlambert accepted D8880: Fix crash on null Release message.
Nov 24 2022, 11:34 AM
vlorentz moved T2202: Collect extrinsic metadata from Work in progress to Pending validation on the Roadmap 2022 board.
Nov 24 2022, 11:24 AM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata
vlorentz added a task to D8880: Fix crash on null Release message: T2220: swh-graph in production.
Nov 24 2022, 11:24 AM
vlorentz added a task to D8881: Document the need for higher vm.max_map_count: T2220: swh-graph in production.
Nov 24 2022, 11:24 AM
vlorentz added revisions to T2220: swh-graph in production: D8881: Document the need for higher vm.max_map_count, D8880: Fix crash on null Release message.
Nov 24 2022, 11:24 AM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service
vlorentz requested review of D8881: Document the need for higher vm.max_map_count.
Nov 24 2022, 11:21 AM
vlorentz requested review of D8880: Fix crash on null Release message.
Nov 24 2022, 11:20 AM
vlorentz accepted D8879: svn: Also escape hash signs in URLs to avoid libsvn assertion.
Nov 24 2022, 11:12 AM
anlambert added a comment to D8878: vault/assets: Fix cooking task creation when there is a pending one.

thanks!

Is it visible on the Downloads page even if someone else requested the cooking?

Nov 24 2022, 10:40 AM
anlambert added a comment to D8879: svn: Also escape hash signs in URLs to avoid libsvn assertion.

Why not urlencode? Couldn't this be an issue with other characters?

Nov 24 2022, 10:39 AM
vlorentz added a comment to D8878: vault/assets: Fix cooking task creation when there is a pending one.

Is it visible on the Downloads page even if someone else requested the cooking?

Nov 24 2022, 9:59 AM
vlorentz added a comment to D8879: svn: Also escape hash signs in URLs to avoid libsvn assertion.

Why not urlencode? Couldn't this be an issue with other characters?

Nov 24 2022, 9:58 AM

Nov 23 2022

swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build is green

Nov 23 2022, 5:41 PM
Harbormaster failed remote builds in B32940: Diff 32007 for D8875: cypress/origin-save: Fix flaky test!
Nov 23 2022, 5:21 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build was aborted

Nov 23 2022, 5:21 PM
anlambert requested review of D8879: svn: Also escape hash signs in URLs to avoid libsvn assertion.
Nov 23 2022, 5:09 PM
anlambert added a comment to T4698: Error when requesting vault cooking for a directory in pending state.

Nice catch, fixed in D8878.

Nov 23 2022, 5:06 PM · Web app
anlambert requested review of D8878: vault/assets: Fix cooking task creation when there is a pending one.
Nov 23 2022, 5:06 PM
anlambert closed D8872: loader: Add logs displaying path differences after revision replay.
Nov 23 2022, 4:55 PM
anlambert committed rDLDSVNa843858b0c2f: loader: Add logs displaying path differences after revision replay (authored by anlambert).
loader: Add logs displaying path differences after revision replay
Nov 23 2022, 4:55 PM
anlambert added a revision to T4698: Error when requesting vault cooking for a directory in pending state: D8878: vault/assets: Fix cooking task creation when there is a pending one.
Nov 23 2022, 4:50 PM · Web app
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build is green

Nov 23 2022, 4:47 PM
anlambert retitled D8875: cypress/origin-save: Fix flaky test from package.json: Bump cypress to 11.2.0 to cypress/origin-save: Fix flaky test.
Nov 23 2022, 4:37 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build is green

Nov 23 2022, 4:35 PM
Harbormaster failed remote builds in B32939: Diff 32006 for D8875: cypress/origin-save: Fix flaky test!
Nov 23 2022, 4:24 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build was aborted

Nov 23 2022, 4:24 PM
anlambert updated the diff for D8875: cypress/origin-save: Fix flaky test.

Remove cypress upgrade, the hanging bug appeared again after a couple of job executions (sigh)

Nov 23 2022, 4:24 PM
anlambert updated the diff for D8875: cypress/origin-save: Fix flaky test.

Trigger new build

Nov 23 2022, 4:14 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build was aborted

Nov 23 2022, 4:11 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build was aborted

Nov 23 2022, 3:49 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build was aborted

Nov 23 2022, 3:36 PM
Harbormaster failed remote builds in B32938: Diff 32005 for D8875: cypress/origin-save: Fix flaky test!
Nov 23 2022, 3:29 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build was aborted

Nov 23 2022, 3:29 PM
anlambert updated the diff for D8875: cypress/origin-save: Fix flaky test.

Add commit fixing a flaky cypress test

Nov 23 2022, 3:09 PM
Harbormaster failed remote builds in B32937: Diff 32004 for D8875: cypress/origin-save: Fix flaky test!
Nov 23 2022, 2:56 PM
swh-public-ci added a comment to D8875: cypress/origin-save: Fix flaky test.

Build has FAILED

Nov 23 2022, 2:56 PM
anlambert updated the diff for D8875: cypress/origin-save: Fix flaky test.

Update commit message

Nov 23 2022, 2:45 PM
ardumont updated the diff for D8874: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.

Update (not using a variable as this fails the build)

Nov 23 2022, 2:34 PM
anlambert requested review of D8875: cypress/origin-save: Fix flaky test.
Nov 23 2022, 2:32 PM
ardumont added a reviewer for D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump: anlambert.
Nov 23 2022, 2:20 PM
ardumont updated the test plan for D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.
Nov 23 2022, 2:19 PM
olasd committed rDPROV27cc3d08a3e8: kafka: bundle relation messages into a single write_additions (authored by olasd).
kafka: bundle relation messages into a single write_additions
Nov 23 2022, 2:17 PM
olasd committed rDPROVdf9678a55a03: test_cli: fix synthetic kafka messages for replay test (authored by olasd).
test_cli: fix synthetic kafka messages for replay test
Nov 23 2022, 2:17 PM
ardumont updated the diff for D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.

Hardcode the path to rsvndump which got emptied when using a variable (for some reason)

Nov 23 2022, 12:09 PM
Harbormaster failed to build B32927: rDPROV6730f2fdbda6: Fix typo (orign -> origin) for rDPROV6730f2fdbda6: Fix typo (orign -> origin)!
Nov 23 2022, 11:58 AM
Harbormaster failed to build B32928: rDPROV869f9f168255: kafka: improve the message schema for the journal writer for rDPROV869f9f168255: kafka: improve the message schema for the journal writer!
Nov 23 2022, 11:56 AM
ardumont requested review of D8876: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.
Nov 23 2022, 11:53 AM
douardda committed rDPROV869f9f168255: kafka: improve the message schema for the journal writer (authored by douardda).
kafka: improve the message schema for the journal writer
Nov 23 2022, 11:52 AM
douardda committed rDPROV6730f2fdbda6: Fix typo (orign -> origin) (authored by douardda).
Fix typo (orign -> origin)
Nov 23 2022, 11:52 AM
anlambert added inline comments to D8872: loader: Add logs displaying path differences after revision replay.
Nov 23 2022, 11:42 AM
ardumont updated the diff for D8874: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.

Rebase and add comment

Nov 23 2022, 11:41 AM
vlorentz committed rDSNIPcab1eeaba219: recheck_consistency: Fix special-casing of Linux (authored by vlorentz).
recheck_consistency: Fix special-casing of Linux
Nov 23 2022, 11:12 AM
vlorentz committed rDSNIP2197ddd78409: recheck_consistency: Fix lint issues (authored by vlorentz).
recheck_consistency: Fix lint issues
Nov 23 2022, 11:12 AM
vlorentz committed rDSNIP2f435c745c6a: recheck_consistency: Add copyright header (authored by vlorentz).
recheck_consistency: Add copyright header
Nov 23 2022, 11:12 AM
ardumont committed rDDOCa73683535d84: upgrade-swh-service: Fix mistyped label (authored by ardumont).
upgrade-swh-service: Fix mistyped label
Nov 23 2022, 11:07 AM
ardumont added inline comments to D8872: loader: Add logs displaying path differences after revision replay.
Nov 23 2022, 10:55 AM
ardumont requested review of D8874: Dockerfile: Reference the rsvndump binary in /usr/local/bin/rsvndump.
Nov 23 2022, 10:50 AM
anlambert added inline comments to D8872: loader: Add logs displaying path differences after revision replay.
Nov 23 2022, 10:45 AM
olasd committed rDPROV1da2e324ba50: Storage config checking in the rabbitmq storage backend isn't needed (authored by olasd).
Storage config checking in the rabbitmq storage backend isn't needed
Nov 23 2022, 10:28 AM
olasd committed rDPROVf1608599b50d: Lower logging level in the rabbitmq server backend for messages (authored by olasd).
Lower logging level in the rabbitmq server backend for messages
Nov 23 2022, 10:28 AM
ardumont accepted D8865: luigi: Add LocalExport task.

lgtm but fix the typo in the docstring cli parameter ;)

Nov 23 2022, 10:23 AM
ardumont added a comment to D8873: storage: Insert from temporary tables in consistent order.

lgtm but this is missing the migration script update first (and the bump in the schema version somewhere?).

Nov 23 2022, 10:18 AM
vlorentz triaged T4698: Error when requesting vault cooking for a directory in pending state as Normal priority.
Nov 23 2022, 9:35 AM · Web app
vlorentz renamed T4697: svn loader: FileNotFoundError while creating a directory from FileNotFoundError: [Errno 2] No such file or directory: '/tmp/swh.loader.svn.0g8bqfec-1539429/tmpxz9z024c/tmpo96ke7rq' to svn loader: FileNotFoundError while creating a directory.
Nov 23 2022, 9:30 AM · SVN Loader
vlorentz placed T4697: svn loader: FileNotFoundError while creating a directory up for grabs.
Nov 23 2022, 9:30 AM · SVN Loader
swh-sentry-integration assigned T4697: svn loader: FileNotFoundError while creating a directory to vlorentz.
Nov 23 2022, 9:30 AM · SVN Loader
vlorentz requested review of D8873: storage: Insert from temporary tables in consistent order.
Nov 23 2022, 9:26 AM
vlorentz added a revision to T4696: indexer storage: Deadlock in origin_extrinsic_metadata_add: D8873: storage: Insert from temporary tables in consistent order.
Nov 23 2022, 9:21 AM · Indexer
vlorentz triaged T4696: indexer storage: Deadlock in origin_extrinsic_metadata_add as Low priority.
Nov 23 2022, 9:19 AM · Indexer
swh-sentry-integration assigned T4696: indexer storage: Deadlock in origin_extrinsic_metadata_add to vlorentz.
Nov 23 2022, 9:19 AM · Indexer
vlorentz closed D8863: ExtrinsicMetadataIndexer: Add support for metadata with origin in context.
Nov 23 2022, 8:57 AM
vlorentz committed rDCIDX221d48e24252: ExtrinsicMetadataIndexer: Add support for metadata with origin in context (authored by vlorentz).
ExtrinsicMetadataIndexer: Add support for metadata with origin in context
Nov 23 2022, 8:57 AM
vlorentz closed D8861: origin_head: Do not fetch complete snapshots for non-FTP visits.
Nov 23 2022, 8:57 AM
vlorentz committed rDCIDX03b4bb002c87: origin_head: Do not fetch complete snapshots for non-FTP visits (authored by vlorentz).
origin_head: Do not fetch complete snapshots for non-FTP visits
Nov 23 2022, 8:57 AM

Nov 22 2022

ardumont accepted D8872: loader: Add logs displaying path differences after revision replay.

one non blocking suggestion inline

Nov 22 2022, 6:08 PM
anlambert requested review of D8872: loader: Add logs displaying path differences after revision replay.
Nov 22 2022, 5:43 PM
Harbormaster failed to build B32917: rDWAPPS8a35c0b688af: package.json: Revert cypress upgrade to 11.x again for rDWAPPS8a35c0b688af: package.json: Revert cypress upgrade to 11.x again!
Nov 22 2022, 5:26 PM
olasd added a comment to T4644: replayer crashes on invalid directory entry name (b'gitter/gitter.xml').

To force kafka compaction to run I've done the following:

Nov 22 2022, 5:19 PM · Archive integrity, Object storage, Data Model
anlambert committed rDWAPPSb04d5848c6d8: cypress: Increase sqlite3 busy timeout (authored by anlambert).
cypress: Increase sqlite3 busy timeout
Nov 22 2022, 5:12 PM
anlambert closed D8869: cypress: Increase sqlite3 busy timeout.
Nov 22 2022, 5:12 PM
anlambert committed rDWAPPS8a35c0b688af: package.json: Revert cypress upgrade to 11.x again (authored by anlambert).
package.json: Revert cypress upgrade to 11.x again
Nov 22 2022, 5:12 PM
swh-public-ci added a comment to D8869: cypress: Increase sqlite3 busy timeout.

Build is green

Nov 22 2022, 5:11 PM
ardumont closed D8871: sysadm/upgrade-swh-services: Update the build deps step.
Nov 22 2022, 5:09 PM
ardumont committed rDDOCb085723a041a: upgrade-swh-services: Update the build deps step (authored by ardumont).
upgrade-swh-services: Update the build deps step
Nov 22 2022, 5:09 PM
swh-public-ci added a comment to D8871: sysadm/upgrade-swh-services: Update the build deps step.

Build is green

Nov 22 2022, 5:07 PM
ardumont accepted D8863: ExtrinsicMetadataIndexer: Add support for metadata with origin in context.
Nov 22 2022, 5:07 PM
ardumont accepted D8864: luigi: Remove copies of stamp files to/from S3.
Nov 22 2022, 5:05 PM
anlambert updated the diff for D8869: cypress: Increase sqlite3 busy timeout.

Final update:

  • package.json: Revert cypress upgrade to 11.x again
  • cypress: Increase sqlite3 busy timeout
Nov 22 2022, 5:03 PM
Harbormaster failed remote builds in B32914: Diff 31986 for D8869: cypress: Increase sqlite3 busy timeout!
Nov 22 2022, 5:02 PM
swh-public-ci added a comment to D8869: cypress: Increase sqlite3 busy timeout.

Build has FAILED

Nov 22 2022, 5:02 PM
ardumont updated the diff for D8871: sysadm/upgrade-swh-services: Update the build deps step.

Adapt according to remark

Nov 22 2022, 5:00 PM
ardumont added a comment to D8871: sysadm/upgrade-swh-services: Update the build deps step.

Just an inline remark but otherwise it's ok.

Nov 22 2022, 4:59 PM
Harbormaster failed remote builds in B32912: Diff 31984 for D8869: cypress: Increase sqlite3 busy timeout!
Nov 22 2022, 4:55 PM
swh-public-ci added a comment to D8869: cypress: Increase sqlite3 busy timeout.

Build was aborted

Nov 22 2022, 4:55 PM
vsellier accepted D8871: sysadm/upgrade-swh-services: Update the build deps step.
Nov 22 2022, 4:55 PM
vsellier added a comment to D8871: sysadm/upgrade-swh-services: Update the build deps step.

Just an inline remark but otherwise it's ok.

Nov 22 2022, 4:54 PM
anlambert updated the diff for D8869: cypress: Increase sqlite3 busy timeout.

Update

Nov 22 2022, 4:54 PM
ardumont requested review of D8871: sysadm/upgrade-swh-services: Update the build deps step.
Nov 22 2022, 4:53 PM