Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 18 2021

anlambert updated the diff for D6658: loader: Optimize SvnLoaderFromRemoteDump use on stale repository.

Update: Skip redundant post_load check when revisions are identified as identical in prepare

Nov 18 2021, 6:52 PM
anlambert requested review of D6658: loader: Optimize SvnLoaderFromRemoteDump use on stale repository.
Nov 18 2021, 5:31 PM
anlambert added a revision to T3719: loader svn fails to clean up properly disk when it crashes: D6658: loader: Optimize SvnLoaderFromRemoteDump use on stale repository.
Nov 18 2021, 5:29 PM · SVN Loader
anlambert created P1219 SvnLoaderFromRemoteDump optimization.
Nov 18 2021, 4:54 PM
anlambert accepted D6647: changelog: Reference the opam coq repository ingestion.
Nov 18 2021, 3:08 PM
anlambert closed T3737: documentation sidebar: group swh.* module doc under a "API reference" heading as Resolved by committing rDDOC23b479e750d7: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 2:16 PM · Documentation
anlambert closed D6656: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 2:16 PM
anlambert committed rDDOC23b479e750d7: docs/index: Group swh.* entries under a top level "API reference" entry (authored by anlambert).
docs/index: Group swh.* entries under a top level "API reference" entry
Nov 18 2021, 2:16 PM
anlambert requested review of D6656: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 2:05 PM
anlambert added a revision to T3737: documentation sidebar: group swh.* module doc under a "API reference" heading: D6656: docs/index: Group swh.* entries under a top level "API reference" entry.
Nov 18 2021, 1:54 PM · Documentation
anlambert closed D6654: ra: Prevent erroneous removing of file state.
Nov 18 2021, 12:40 PM
anlambert committed rDLDSVN631a2b9d7f7e: ra: Prevent erroneous removing of file state (authored by anlambert).
ra: Prevent erroneous removing of file state
Nov 18 2021, 12:40 PM
anlambert requested review of D6654: ra: Prevent erroneous removing of file state.
Nov 18 2021, 12:00 PM
anlambert closed T3736: Add `,` separator in numbers on the archive's home as Resolved by committing rDWAPPS8722d9aa4d6d: misc/coverage: Fix some origin counts formatting.
Nov 18 2021, 11:05 AM · Web app
anlambert committed rDWAPPS8722d9aa4d6d: misc/coverage: Fix some origin counts formatting (authored by anlambert).
misc/coverage: Fix some origin counts formatting
Nov 18 2021, 11:05 AM
anlambert closed T3735: Add "you" in the Vault browsing page as Resolved by committing rDWAPPSadc197792243: templates/vault-ui: Fix introduction sentence.
Nov 18 2021, 11:05 AM · Web app, Easy hack
anlambert committed rDWAPPSadc197792243: templates/vault-ui: Fix introduction sentence (authored by anlambert).
templates/vault-ui: Fix introduction sentence
Nov 18 2021, 11:05 AM
anlambert closed D6649: pytest_plugin: Increase poll timeout in consume_messages.
Nov 18 2021, 10:32 AM
anlambert committed rDJNLbac6b474b229: pytest_plugin: Increase poll timeout in consume_messages (authored by anlambert).
pytest_plugin: Increase poll timeout in consume_messages
Nov 18 2021, 10:32 AM
anlambert closed T3724: Browsing snapshot with only releases does not show anything in the webapp as Resolved.

Fix is now deployed to production, closing this.

Nov 18 2021, 10:31 AM · Web app
anlambert updated the diff for D6649: pytest_plugin: Increase poll timeout in consume_messages.

Rebase

Nov 18 2021, 10:28 AM

Nov 17 2021

anlambert requested review of D6649: pytest_plugin: Increase poll timeout in consume_messages.
Nov 17 2021, 4:40 PM
anlambert closed D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 3:04 PM
anlambert committed rDLDSVNfdf526eceaea: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump (authored by anlambert).
loader: Create temp folder with pattern in SvnLoaderFromRemoteDump
Nov 17 2021, 3:04 PM
anlambert updated the diff for D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.

Update: Wrap temporary folder creation in a private method

Nov 17 2021, 2:58 PM
anlambert added inline comments to D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:40 PM
anlambert accepted D6615: Deprecate /origin/content route.

Bye bye duplicated code related to browsing contents, thanks a lot for that !

Nov 17 2021, 2:38 PM
anlambert requested review of D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:33 PM
anlambert added a revision to T3719: loader svn fails to clean up properly disk when it crashes: D6648: loader: Create temp folder with pattern in SvnLoaderFromRemoteDump.
Nov 17 2021, 2:32 PM · SVN Loader
anlambert added inline comments to D6615: Deprecate /origin/content route.
Nov 17 2021, 2:19 PM
anlambert requested changes to D6615: Deprecate /origin/content route.

Overall looks good to me ! I added a couple of nitpick comments to handle before landing this.

Nov 17 2021, 12:09 PM
anlambert accepted D6636: Add types to the svn module.

Cool, thanks !

Nov 17 2021, 10:57 AM

Nov 16 2021

anlambert closed D6641: browse/snapshot_context: Handle snapshot containing only releases.

Forgot to rebase, closed by rDWAPPScd747fd0e79be6e2cfe941c25479f4c2b30bd6bb.

Nov 16 2021, 7:26 PM
anlambert committed rDWAPPScd747fd0e79b: browse/snapshot_context: Handle snapshots containing only releases (authored by anlambert).
browse/snapshot_context: Handle snapshots containing only releases
Nov 16 2021, 7:24 PM
anlambert committed rDWAPPS9c874cd715bc: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
Nov 16 2021, 7:24 PM
anlambert added inline comments to D6641: browse/snapshot_context: Handle snapshot containing only releases.
Nov 16 2021, 4:25 PM
anlambert added inline comments to D6641: browse/snapshot_context: Handle snapshot containing only releases.
Nov 16 2021, 3:25 PM
anlambert accepted D6646: vault-ui: Show progress details when hovering the progress bar.
Nov 16 2021, 2:58 PM
anlambert accepted D6642: git_bare: Send progress updates while cooking.

Looks good to me.

Nov 16 2021, 2:57 PM
anlambert updated the summary of D6641: browse/snapshot_context: Handle snapshot containing only releases.
Nov 16 2021, 2:46 PM
anlambert updated the diff for D6641: browse/snapshot_context: Handle snapshot containing only releases.

Update:

  • handle @vlorentz comments
  • ensure all get_snapshot_context code is covered by tests
Nov 16 2021, 2:46 PM
anlambert accepted D6643: webpack: Remove .tox and .mypy from the files to watch.

Great, thanks !

Nov 16 2021, 2:42 PM
anlambert added inline comments to D6641: browse/snapshot_context: Handle snapshot containing only releases.
Nov 16 2021, 1:23 PM
anlambert requested review of D6641: browse/snapshot_context: Handle snapshot containing only releases.
Nov 16 2021, 11:56 AM
anlambert added a revision to T3724: Browsing snapshot with only releases does not show anything in the webapp: D6641: browse/snapshot_context: Handle snapshot containing only releases.
Nov 16 2021, 11:42 AM · Web app
anlambert added a comment to D6640: Add a button to the deposit admin UI to show deposit metadata.

@anlambert Can you take this diff from here?

Nov 16 2021, 11:36 AM

Nov 15 2021

anlambert changed the status of T3724: Browsing snapshot with only releases does not show anything in the webapp from Open to Work in Progress.
Nov 15 2021, 4:13 PM · Web app
anlambert added inline comments to D6620: ra: Remove global variables..
Nov 15 2021, 3:15 PM
anlambert accepted D6620: ra: Remove global variables..

Looks good to me, better indeed.

Nov 15 2021, 1:45 PM
anlambert accepted D6639: Add missing URL escape.
Nov 15 2021, 1:11 PM
anlambert added a comment to T3695: Investigate revision reconstruction discrepancy with subversion export.

Since D6608 got landed and deployed to production, revision reconstruction discrepancy is detected earlier and there is already a couple reported on sentry,
so keeping this opened.

Nov 15 2021, 10:55 AM · SVN Loader
anlambert added a comment to T3728: Display snapshots with only releases (or a release as HEAD branch).

Duplicate of T3724 I think

Nov 15 2021, 10:34 AM · Web app, Data Model
anlambert committed rDWAPPSfe8c3b38bb64: assets/xss-filtering: Ensure to use correct directory (authored by anlambert).
assets/xss-filtering: Ensure to use correct directory
Nov 15 2021, 10:29 AM
anlambert committed rDWAPPSe0f33695c7b3: assets/xss-filtering: Strip any query parameters from img src attribute (authored by anlambert).
assets/xss-filtering: Strip any query parameters from img src attribute
Nov 15 2021, 10:29 AM
anlambert closed D6614: assets/xss-filtering: Strip any query parameters from img src attribute.
Nov 15 2021, 10:29 AM
anlambert claimed T3724: Browsing snapshot with only releases does not show anything in the webapp.
Nov 15 2021, 10:19 AM · Web app

Nov 8 2021

anlambert closed D6611: loader: Perform a complete reloading when detecting altered history.
Nov 8 2021, 2:14 PM
anlambert committed rDLDSVN057e00bf93dc: loader: Perform a complete reloading when detecting altered history (authored by anlambert).
loader: Perform a complete reloading when detecting altered history
Nov 8 2021, 2:14 PM

Nov 5 2021

anlambert updated the diff for D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Update license header

Nov 5 2021, 1:53 PM
anlambert updated the diff for D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Update: Ensure to pass a valid url to URL constructor and encode path query parameter value

Nov 5 2021, 1:51 PM
anlambert added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Then when doing this:

directoryUrl += `?path=${path}`;

directoryUrl will end with ?path=/path&/foo and that's not good

Nov 5 2021, 1:45 PM
anlambert added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

What if there is a & character in the path?

Not an issue, URL object will correctly parse it as part of the path.

>>> s = "http://example.org/path&/foo?service=swh&query=bar"
"http://example.org/path&/foo?service=swh&query=bar"
>>> new URL(s)
URL { href: "http://example.org/path&/foo?service=swh&query=bar", origin: "http://example.org", protocol: "http:", username: "", password: "", host: "example.org", hostname: "example.org", port: "", pathname: "/path&/foo", search: "?service=swh&query=bar" }
Nov 5 2021, 1:11 PM
anlambert requested review of D6614: assets/xss-filtering: Strip any query parameters from img src attribute.
Nov 5 2021, 12:26 PM
anlambert accepted D6612: tests: Hide utilities from stack traces.

Cool, nice pytest trick to know !

Nov 5 2021, 11:22 AM
anlambert accepted D6613: tests: Remove duplicate checks.
Nov 5 2021, 11:20 AM

Nov 4 2021

anlambert accepted D6609: Missing tests for origin legacy routes.

Looks good to me.

Nov 4 2021, 5:16 PM
anlambert requested review of D6611: loader: Perform a complete reloading when detecting altered history.
Nov 4 2021, 4:50 PM
anlambert added a revision to T3694: Investigate svn loading failure: D6611: loader: Perform a complete reloading when detecting altered history.
Nov 4 2021, 4:48 PM · SVN Loader
anlambert requested review of D6608: loader: Implement post_load to check for revision divergence.
Nov 4 2021, 4:25 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6608: loader: Implement post_load to check for revision divergence.
Nov 4 2021, 4:23 PM · SVN Loader
anlambert closed D6604: ra: Handle invalid values for svn:eol-style property.
Nov 4 2021, 12:36 PM
anlambert committed rDLDSVN830482755fe6: ra: Handle invalid values for svn:eol-style property (authored by anlambert).
ra: Handle invalid values for svn:eol-style property
Nov 4 2021, 12:36 PM
anlambert added inline comments to D6604: ra: Handle invalid values for svn:eol-style property.
Nov 4 2021, 12:35 PM
anlambert added inline comments to D6604: ra: Handle invalid values for svn:eol-style property.
Nov 4 2021, 12:09 PM
anlambert requested review of D6604: ra: Handle invalid values for svn:eol-style property.
Nov 4 2021, 11:34 AM
anlambert updated the diff for D6601: ra: Fix export of non link file with svn:special property set.

Update: Address @vlorentz comments

Nov 4 2021, 11:09 AM
anlambert added inline comments to D6601: ra: Fix export of non link file with svn:special property set.
Nov 4 2021, 10:51 AM
anlambert added inline comments to D6601: ra: Fix export of non link file with svn:special property set.
Nov 4 2021, 10:50 AM
anlambert updated the diff for D6602: loader: Fix error when first revision number is not one.

Update: Simplify test implementation

Nov 4 2021, 10:46 AM

Nov 3 2021

anlambert updated the summary of D6601: ra: Fix export of non link file with svn:special property set.
Nov 3 2021, 7:55 PM
anlambert requested review of D6602: loader: Fix error when first revision number is not one.
Nov 3 2021, 6:08 PM
anlambert added a revision to T3701: loading some svn origins while ignoring history sometimes raises: D6602: loader: Fix error when first revision number is not one.
Nov 3 2021, 6:07 PM · SVN Loader
anlambert updated the diff for D6601: ra: Fix export of non link file with svn:special property set.

Update: Improve commit messages in test

Nov 3 2021, 5:36 PM
anlambert requested review of D6601: ra: Fix export of non link file with svn:special property set.
Nov 3 2021, 5:34 PM
anlambert added a revision to T3695: Investigate revision reconstruction discrepancy with subversion export: D6601: ra: Fix export of non link file with svn:special property set.
Nov 3 2021, 5:32 PM · SVN Loader
anlambert added a comment to T3701: loading some svn origins while ignoring history sometimes raises.

The issue is related to the difference of fetched revision data whether we use the swh.loader.svn.SvnLoader class (fetching revisions
one at a time through a ping pong with the svn server) or the swh.loader.svn.SvnLoaderFromRemoteDump class (fetching all revisions
to a dump file in one operation).

Nov 3 2021, 5:12 PM · SVN Loader
anlambert renamed T3695: Investigate revision reconstruction discrepancy with subversion export from loading some svn origin while ignoring history sometimes raises to Investigate revision reconstruction discrepancy with subversion export.
Nov 3 2021, 4:31 PM · SVN Loader
anlambert added a parent task for T3701: loading some svn origins while ignoring history sometimes raises: T3694: Investigate svn loading failure.
Nov 3 2021, 4:22 PM · SVN Loader
anlambert added a subtask for T3694: Investigate svn loading failure: T3701: loading some svn origins while ignoring history sometimes raises.
Nov 3 2021, 4:22 PM · SVN Loader
anlambert added a comment to T3701: loading some svn origins while ignoring history sometimes raises.

Original comment posted in T3695 by @ardumont

Nov 3 2021, 4:20 PM · SVN Loader
anlambert triaged T3701: loading some svn origins while ignoring history sometimes raises as Normal priority.
Nov 3 2021, 4:20 PM · SVN Loader
anlambert accepted D6600: deposit: Remove 'parent' deposit.
Nov 3 2021, 4:18 PM
anlambert accepted D6599: Revert "deposit: Remove 'parent' deposit".
Nov 3 2021, 4:01 PM
anlambert closed D6595: ra: Do not process end of lines for svn links.
Nov 3 2021, 3:38 PM
anlambert closed D6596: ra: Handle unsetting svn:special property on svn links.
Nov 3 2021, 3:38 PM
anlambert committed rDLDSVN4e50fd3cd2b3: ra: Do not process end of lines for svn links (authored by anlambert).
ra: Do not process end of lines for svn links
Nov 3 2021, 3:38 PM
anlambert committed rDLDSVNb326099c7348: ra: Handle unsetting svn:special property on svn links (authored by anlambert).
ra: Handle unsetting svn:special property on svn links
Nov 3 2021, 3:38 PM
anlambert closed D6589: ra: Fix edge case in svn:eol-style property handling.
Nov 3 2021, 3:38 PM
anlambert committed rDLDSVN3bde065e0b64: ra: Fix edge case in svn:eol-style property handling (authored by anlambert).
ra: Fix edge case in svn:eol-style property handling
Nov 3 2021, 3:38 PM
anlambert updated the diff for D6596: ra: Handle unsetting svn:special property on svn links.

Rebase

Nov 3 2021, 2:03 PM