Page MenuHomeSoftware Heritage
Feed Advanced Search

Jul 12 2022

anlambert requested review of D8112: django: Add support for Django 4.x.
Jul 12 2022, 12:03 PM

Jul 11 2022

anlambert accepted D8110: hypothesis_strategies: Add kwargs to composite strategies, to replace default sub-strategies.

Better like this indeed, looks good to me.

Jul 11 2022, 7:02 PM
anlambert accepted D8108: Add support for non-ASCII filenames in api_content_raw (option 1: use FileResponse).

Looks good to me, thanks !

Jul 11 2022, 6:46 PM
anlambert committed rDWAPPS27663adfa461: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
Jul 11 2022, 3:52 PM
anlambert closed D8107: misc: Add banner view to display swh hiring info in an iframe.
Jul 11 2022, 3:52 PM
anlambert committed rDWAPPS0ca76af6f6dd: misc: Add banner view to display swh hiring info in an iframe (authored by anlambert).
misc: Add banner view to display swh hiring info in an iframe
Jul 11 2022, 3:52 PM
anlambert requested review of D8107: misc: Add banner view to display swh hiring info in an iframe.
Jul 11 2022, 3:43 PM
anlambert closed D8103: rlog, cvs2gitdump: Fix handling of revision number greater than one.
Jul 11 2022, 3:29 PM
anlambert committed rDLDCVS386a68f1498f: rlog, cvs2gitdump: Fix handling of revision number greater than one (authored by anlambert).
rlog, cvs2gitdump: Fix handling of revision number greater than one
Jul 11 2022, 3:29 PM
anlambert updated the diff for D8103: rlog, cvs2gitdump: Fix handling of revision number greater than one.

Rebase

Jul 11 2022, 3:23 PM
anlambert closed D8104: loader: Use utf-8 instead of ascii to decode rsync output.
Jul 11 2022, 3:22 PM
anlambert committed rDLDCVS5a79a325a875: loader: Use utf-8 instead of ascii to decode rsync output (authored by anlambert).
loader: Use utf-8 instead of ascii to decode rsync output
Jul 11 2022, 3:22 PM
anlambert added inline comments to D8103: rlog, cvs2gitdump: Fix handling of revision number greater than one.
Jul 11 2022, 2:18 PM

Jul 8 2022

anlambert requested review of D8104: loader: Use utf-8 instead of ascii to decode rsync output.
Jul 8 2022, 6:35 PM
anlambert updated the diff for D8103: rlog, cvs2gitdump: Fix handling of revision number greater than one.

Simplify some code

Jul 8 2022, 6:26 PM
anlambert updated the diff for D8103: rlog, cvs2gitdump: Fix handling of revision number greater than one.

Fix indentation

Jul 8 2022, 6:24 PM
anlambert requested review of D8103: rlog, cvs2gitdump: Fix handling of revision number greater than one.
Jul 8 2022, 6:23 PM

Jul 7 2022

anlambert accepted D8073: Use compact URIs for ForgeFed and ActivityStreams.
Jul 7 2022, 4:43 PM
anlambert accepted D8084: github: Translate stargazers_count and watchers_count.
Jul 7 2022, 4:41 PM
anlambert accepted D8083: Simplify codemeta.make_absolute_uri().
Jul 7 2022, 4:39 PM
anlambert accepted D8085: docs: Update description of the metadata workflow.
Jul 7 2022, 4:38 PM
anlambert accepted D8087: docs: Explain the indexation workflow for extrinsic metadata.
Jul 7 2022, 4:36 PM
anlambert closed D8091: loader: Ensure to strip trailing slash from origin URL.
Jul 7 2022, 2:09 PM
anlambert committed rDLDCVSe5215cf1983c: loader: Ensure to strip trailing slash from origin URL (authored by anlambert).
loader: Ensure to strip trailing slash from origin URL
Jul 7 2022, 2:09 PM
anlambert accepted D8096: Fix assertion reporting for tests using the subtesthack.
Jul 7 2022, 2:04 PM
anlambert requested review of D8091: loader: Ensure to strip trailing slash from origin URL.
Jul 7 2022, 10:57 AM
anlambert closed D8086: Fix loading of CVS repositories with non valid UTF-8 paths.
Jul 7 2022, 10:42 AM
anlambert committed rDLDCVSd89f8d13e947: Fix loading of CVS repositories with non valid UTF-8 paths (authored by anlambert).
Fix loading of CVS repositories with non valid UTF-8 paths
Jul 7 2022, 10:42 AM
anlambert closed D8088: add_forge_now: Display pre in request history only for non empty text.
Jul 7 2022, 10:41 AM
anlambert committed rDWAPPS3d804357105d: add_forge_now: Display pre in request history only for non empty text (authored by anlambert).
add_forge_now: Display pre in request history only for non empty text
Jul 7 2022, 10:41 AM

Jul 6 2022

anlambert requested review of D8088: add_forge_now: Display pre in request history only for non empty text.
Jul 6 2022, 5:45 PM
anlambert added a comment to D8086: Fix loading of CVS repositories with non valid UTF-8 paths.

Its syntax is more convenient and it automatically deals with encoding. eg. wtpath = os.path.join(os.fsencode(self.tempdir_path), path) becomes wtpath = self.tempdir_path / path with pathlib

Jul 6 2022, 4:54 PM
anlambert added a comment to D8086: Fix loading of CVS repositories with non valid UTF-8 paths.

Have you considered using the opportunity to switch to pathlib?

Jul 6 2022, 4:35 PM
anlambert requested review of D8086: Fix loading of CVS repositories with non valid UTF-8 paths.
Jul 6 2022, 4:10 PM

Jul 1 2022

anlambert triaged T4369: canonicalize gitlab urls in origin API as Normal priority.
Jul 1 2022, 3:24 PM · Web app
anlambert added a comment to T4369: canonicalize gitlab urls in origin API.

For the record, we recently disabled any origin URL processing in the Web API part (we were checking an origin URL with and without
trailing slash, but this should only be performed in the Web UI as the Web API should be as dumb as possible, see D7988).

Jul 1 2022, 3:23 PM · Web app
anlambert accepted D8065: Add type annotations for base_connection.

Looks good to me.

Jul 1 2022, 2:58 PM
anlambert added inline comments to D8065: Add type annotations for base_connection.
Jul 1 2022, 2:13 PM

Jun 30 2022

anlambert accepted D8061: Re-add swh/graph/client.py for backward-compatibility.

Great, thanks !

Jun 30 2022, 4:47 PM
anlambert closed D7988: api/origin: Do not attempt to lookup similar origin URLs.
Jun 30 2022, 3:02 PM
anlambert committed rDWAPPS45b46e62adfc: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
Jun 30 2022, 3:02 PM
anlambert committed rDWAPPS75b37286fe99: api/origin: Do not attempt to lookup similar origin URLs (authored by anlambert).
api/origin: Do not attempt to lookup similar origin URLs
Jun 30 2022, 3:02 PM
anlambert closed D8056: requirements-test: Ensure pinned mypy version is used with tox.
Jun 30 2022, 3:02 PM
anlambert committed rDWAPPS70c242f2d98c: requirements-test: Ensure pinned mypy version is used with tox (authored by anlambert).
requirements-test: Ensure pinned mypy version is used with tox
Jun 30 2022, 3:02 PM
anlambert requested review of D8056: requirements-test: Ensure pinned mypy version is used with tox.
Jun 30 2022, 12:55 PM
anlambert updated the diff for D7988: api/origin: Do not attempt to lookup similar origin URLs.

Rebase

Jun 30 2022, 12:34 PM
anlambert updated the summary of D7988: api/origin: Do not attempt to lookup similar origin URLs.
Jun 30 2022, 12:34 PM
anlambert updated the diff for D7988: api/origin: Do not attempt to lookup similar origin URLs.

Rebase

Jun 30 2022, 11:27 AM

Jun 21 2022

anlambert added a project to T4346: Create SourceHut Lister: Lister.
Jun 21 2022, 4:13 PM · Archive coverage, Lister
anlambert added a comment to T4346: Create SourceHut Lister.

Currently, there is no REST API endpoint to list SourceHut public projects.

Jun 21 2022, 4:13 PM · Archive coverage, Lister

Jun 20 2022

anlambert committed rDWAPPS9e89db680baa: browse/content: Fix regression in diff-contents view URL regexp (authored by anlambert).
browse/content: Fix regression in diff-contents view URL regexp
Jun 20 2022, 4:50 PM
anlambert closed D8006: cvsclient: Retry pserver connection three times in case of failure.
Jun 20 2022, 3:44 PM
anlambert closed D8005: cvsclient: Fix pserver error: "protocol error: <path> is not absolute".
Jun 20 2022, 3:44 PM
anlambert committed rDLDCVSb35a9769a035: cvsclient: Retry pserver connection three times in case of failure (authored by anlambert).
cvsclient: Retry pserver connection three times in case of failure
Jun 20 2022, 3:44 PM
anlambert committed rDLDCVS089e2fd04523: cvsclient: Fix pserver error: "protocol error: <path> is not absolute" (authored by anlambert).
cvsclient: Fix pserver error: "protocol error: <path> is not absolute"
Jun 20 2022, 3:44 PM
anlambert closed D8004: cvsclient: Allow to connect to a pserver URL without password.
Jun 20 2022, 3:44 PM
anlambert committed rDLDCVSe382aeb05266: cvsclient: Allow to connect to a pserver URL without password (authored by anlambert).
cvsclient: Allow to connect to a pserver URL without password
Jun 20 2022, 3:44 PM
anlambert closed D8003: utils: Ensure to return correct revision in parse_external_definition.
Jun 20 2022, 3:43 PM
anlambert committed rDLDSVN651e2964eeb3: utils: Ensure to return correct revision in parse_external_definition (authored by anlambert).
utils: Ensure to return correct revision in parse_external_definition
Jun 20 2022, 3:43 PM
anlambert created P1388 (An Untitled Masterwork).
Jun 20 2022, 3:18 PM
anlambert added a comment to D8006: cvsclient: Retry pserver connection three times in case of failure.

wtf...

Jun 20 2022, 2:13 PM
anlambert updated subscribers of D8005: cvsclient: Fix pserver error: "protocol error: <path> is not absolute".

Did you check this does not cause issues with other servers?

Jun 20 2022, 2:10 PM

Jun 17 2022

anlambert requested review of D8006: cvsclient: Retry pserver connection three times in case of failure.
Jun 17 2022, 5:37 PM
anlambert updated the diff for D8005: cvsclient: Fix pserver error: "protocol error: <path> is not absolute".

Rebase

Jun 17 2022, 5:25 PM
anlambert updated the diff for D8004: cvsclient: Allow to connect to a pserver URL without password.

Remove use of urllib3.util.parse_url and prefer to use urllib.parse.urlparse from standard library instead.

Jun 17 2022, 5:24 PM
anlambert requested review of D8005: cvsclient: Fix pserver error: "protocol error: <path> is not absolute".
Jun 17 2022, 5:04 PM
anlambert requested review of D8004: cvsclient: Allow to connect to a pserver URL without password.
Jun 17 2022, 4:43 PM
anlambert requested review of D8003: utils: Ensure to return correct revision in parse_external_definition.
Jun 17 2022, 12:09 PM

Jun 16 2022

anlambert edited P1383 (An Untitled Masterwork).
Jun 16 2022, 5:12 PM
anlambert created P1383 (An Untitled Masterwork).
Jun 16 2022, 5:11 PM
anlambert triaged T4331: Fix internal links in mardown readme rendering to HTML as Normal priority.
Jun 16 2022, 3:31 PM · Web app
anlambert updated the diff for D7988: api/origin: Do not attempt to lookup similar origin URLs.

Rebase and centralize similar URLs processing in common/archive.py module.

Jun 16 2022, 3:10 PM
anlambert committed rDWAPPSd5f020c02bb4: cypress: Override type command to remove key press delay (authored by anlambert).
cypress: Override type command to remove key press delay
Jun 16 2022, 2:28 PM
anlambert closed D7997: cypress: Override type command to remove key press delay.
Jun 16 2022, 2:28 PM
anlambert committed rDWAPPSf8c7ca101e6a: cypress/persistent-identifiers: Workaround tests hang issue (authored by anlambert).
cypress/persistent-identifiers: Workaround tests hang issue
Jun 16 2022, 2:28 PM
anlambert added a comment to D7997: cypress: Override type command to remove key press delay.

On Jenkins , we gain more than one minute in overall cypress tests execution, see build log before that change and build log after that change.

Jun 16 2022, 2:24 PM
anlambert requested review of D7997: cypress: Override type command to remove key press delay.
Jun 16 2022, 2:18 PM
anlambert closed D7996: loader: Bump dulwich and remove no longer valid comments.
Jun 16 2022, 2:02 PM
anlambert committed rDLDG38537e49d37a: loader: Bump dulwich and remove no longer valid comments (authored by anlambert).
loader: Bump dulwich and remove no longer valid comments
Jun 16 2022, 2:02 PM
anlambert requested review of D7996: loader: Bump dulwich and remove no longer valid comments.
Jun 16 2022, 1:50 PM
anlambert added a revision to T4311: Package and deploy dulwich 0.20.43 in production: D7996: loader: Bump dulwich and remove no longer valid comments.
Jun 16 2022, 1:47 PM · System administration, Git loader

Jun 15 2022

anlambert added a comment to T4326: Archive the pom file additionally to the source folder.

So in the end, the conclusion is that the loader already does the right thing so it's a noop, right?

Jun 15 2022, 4:26 PM · Maven loader, Maven lister, System administration, Archive coverage
anlambert added a comment to D7988: api/origin: Do not attempt to lookup similar origin URLs.

Also, this will "break the API". I am not opposed to this change, but some care should be taken when changing public's API behavior like this. (attempt to check if there are users of the behavior to be modified, document the new behavior, display/return a warning or something, etc)

Jun 15 2022, 1:59 PM
anlambert added a comment to T4326: Archive the pom file additionally to the source folder.

I think the simplest way to get the pom file associated to a specific release of a maven package is to download it from the folder where we can find the source jar.

Jun 15 2022, 1:48 PM · Maven loader, Maven lister, System administration, Archive coverage

Jun 14 2022

anlambert accepted D7991: Use query variables instead of f-strings in functional tests.
Jun 14 2022, 4:13 PM
anlambert requested review of D7988: api/origin: Do not attempt to lookup similar origin URLs.
Jun 14 2022, 3:28 PM
anlambert edited P1382 (An Untitled Masterwork).
Jun 14 2022, 3:14 PM
anlambert created P1382 (An Untitled Masterwork).
Jun 14 2022, 3:11 PM
anlambert added inline comments to D7980: Return origin object for analogues URLs.
Jun 14 2022, 2:56 PM
anlambert added a comment to D7980: Return origin object for analogues URLs.

Ack, I will make the change to the /api/1/origin/ endpoint to remove the URL processing then.

Well that was not he intention of this discussion, this is only about the new graphql API :-)

It make sense to discuss this also for the current API, but it should be a dedicated task; this would change the behavior of the currently published public API, so let's discuss it in a dedicated task.

Jun 14 2022, 2:55 PM
anlambert added a comment to D7980: Return origin object for analogues URLs.

Why should this be implemented by the API (as opposed to UIs)?

This is part of our current REST APIs.

which is not a good enough argument to keep it. Let's not reproduce (potential) mistakes, if we can.

I think it makes sense to return
data with or without a slash in both UI and API.

I also agree, extra trailing slash or missing trailing slash in origin URL is a common source of errors when searching for an origin,
better handle that case API side.

I disagree; one expect the API to behave as dumb/simple as possible: you ask for an origin URL, the API should return data on that very specific URL only. Imagine we do have stored both versions of the origin URL (for historical reasons), with and without a trailing /, we want the API to allow the user query one or the other.

If need be, provide an dedicated API endpoint to search for known similar origins, but make it a dedicated one, not part of the main get_origin endpoint.

As @vlorentz suggested, this "smart" behavior is indeed an UI concern, not an API one.

Jun 14 2022, 1:23 PM
anlambert accepted D7986: Remove unnecessary base exception.

That's better like this indeed, the caught of the base Exception was confusing to me.

Jun 14 2022, 12:39 PM
anlambert added inline comments to D7984: Add error handling for pagination input arguments.
Jun 14 2022, 11:33 AM
anlambert closed D7979: assets/readme-rendering: Use showdown github flavor for github origins.
Jun 14 2022, 10:54 AM
anlambert committed rDWAPPS662ce6eafc3d: assets/readme-rendering: Use showdown github flavor for github origins (authored by anlambert).
assets/readme-rendering: Use showdown github flavor for github origins
Jun 14 2022, 10:54 AM
anlambert accepted D7984: Add error handling for pagination input arguments.

Looks good to me. I added some nitpick comments to handle.

Jun 14 2022, 10:51 AM
anlambert accepted D7983: Deploy add-forge-now functionality in production.
Jun 14 2022, 10:40 AM

Jun 13 2022

anlambert updated the diff for D7979: assets/readme-rendering: Use showdown github flavor for github origins.

Extract origin URL from current browsed one as it is more reliable.

Jun 13 2022, 5:13 PM
anlambert added a comment to D7980: Return origin object for analogues URLs.

But I don't think adding this logic to that layer (archive layer) is a good idea at least in this case. What
I'm trying to do is to make a utility function to identify all the analogous URLs

Jun 13 2022, 4:03 PM
anlambert added a comment to D7980: Return origin object for analogues URLs.

Why should this be implemented by the API (as opposed to UIs)?

This is part of our current REST APIs. I think it makes sense to return
data with or without a slash in both UI and API.

Jun 13 2022, 3:59 PM