Page MenuHomeSoftware Heritage
Feed Advanced Search

May 6 2021

Alphare updated the diff for D5659: Make the SourceForge lister incremental.

Postfix the type aliases with "T"

May 6 2021, 10:30 AM
Alphare updated the diff for D5687: Make the Mercurial loader incremental.

Rebase

May 6 2021, 10:09 AM
Alphare updated the diff for D5691: Remove `os.environ` manipulation in tests.

Refactor test detection in a function

May 6 2021, 10:08 AM

May 5 2021

Alphare abandoned D4649: HgLoaderFromDisk: Only load new commits.

Abandoned in favor of D5687

May 5 2021, 10:45 PM
Alphare commandeered D4649: HgLoaderFromDisk: Only load new commits.
May 5 2021, 10:45 PM
Alphare requested review of D5691: Remove `os.environ` manipulation in tests.
May 5 2021, 10:43 PM
Alphare requested review of D5687: Make the Mercurial loader incremental.
May 5 2021, 10:37 PM
Alphare closed D5688: requirements-test: don't install pytest-postgresql 3.0+.
May 5 2021, 9:28 PM
Alphare committed rDDEP144a6e76aa6a: requirements-test: don't install pytest-postgresql 3.0+ (authored by Alphare).
requirements-test: don't install pytest-postgresql 3.0+
May 5 2021, 9:28 PM
Alphare requested review of D5688: requirements-test: don't install pytest-postgresql 3.0+.
May 5 2021, 6:55 PM

May 4 2021

Alphare added inline comments to D5659: Make the SourceForge lister incremental.
May 4 2021, 5:40 PM

May 1 2021

Alphare updated the diff for D5659: Make the SourceForge lister incremental.

Cover "noop" project case

May 1 2021, 12:06 PM
Alphare added a comment to D5659: Make the SourceForge lister incremental.

Jenkins/Phabricator reports most of the new code in listed_origins and _get_pages_for_project is not covered by tests, could you check? (It's sometimes wrong, we don't understand why)

May 1 2021, 11:41 AM
Alphare updated the diff for D5659: Make the SourceForge lister incremental.

Fix incremental testing + incorporate suggestions

May 1 2021, 11:38 AM

Apr 30 2021

Alphare requested review of D5659: Make the SourceForge lister incremental.
Apr 30 2021, 11:13 PM
Alphare added a comment to D5294: Improve correctness of sourceforge-ls.

Mhh it would appear I don't have the rights to push this.

Apr 30 2021, 11:16 AM
Alphare updated the diff for D5628: Replace old loader with the new one.

Rebase

Apr 30 2021, 11:05 AM
Alphare closed D5627: Handle more cases of corruption.
Apr 30 2021, 11:04 AM
Alphare committed rDLDHG888471483a7b: Handle more cases of corruption (authored by Alphare).
Handle more cases of corruption
Apr 30 2021, 11:04 AM
Alphare closed D5625: Also use minimal env in the new Mercurial loader.
Apr 30 2021, 11:04 AM
Alphare closed D5626: Ignore the repository's config.
Apr 30 2021, 11:04 AM
Alphare committed rDLDHGf73d960b0d6c: Ignore the repository's config (authored by Alphare).
Ignore the repository's config
Apr 30 2021, 11:04 AM
Alphare committed rDLDHGaa80a360e236: Also use minimal env in the new Mercurial loader (authored by Alphare).
Also use minimal env in the new Mercurial loader
Apr 30 2021, 11:04 AM
Alphare closed D5623: Use billiard instead of stdlib multiprocessing.
Apr 30 2021, 11:04 AM
Alphare committed rDLDHG232602777009: Use billiard instead of stdlib multiprocessing (authored by Alphare).
Use billiard instead of stdlib multiprocessing
Apr 30 2021, 11:04 AM
Alphare updated the diff for D5627: Handle more cases of corruption.

Rebase

Apr 30 2021, 11:02 AM
Alphare updated the diff for D5626: Ignore the repository's config.

... push the right one

Apr 30 2021, 11:02 AM
Alphare updated the diff for D5626: Ignore the repository's config.

Rebase

Apr 30 2021, 11:01 AM
Alphare updated the diff for D5626: Ignore the repository's config.

Rebase

Apr 30 2021, 11:00 AM
Alphare updated the diff for D5625: Also use minimal env in the new Mercurial loader.

Rebase

Apr 30 2021, 11:00 AM
Alphare updated the diff for D5623: Use billiard instead of stdlib multiprocessing.

Rebase

Apr 30 2021, 10:58 AM

Apr 29 2021

Alphare updated the diff for D5623: Use billiard instead of stdlib multiprocessing.

Actually send the right changes...

Apr 29 2021, 11:29 AM
Alphare updated the diff for D5623: Use billiard instead of stdlib multiprocessing.

Actually incorporate the proposed changes + improve commit message

Apr 29 2021, 11:23 AM

Apr 28 2021

Alphare updated the diff for D5623: Use billiard instead of stdlib multiprocessing.

Integrate suggestion to spend less time sleeping

Apr 28 2021, 3:02 PM
Alphare added 1 blocking reviewer(s) for D5628: Replace old loader with the new one: Reviewers.
Apr 28 2021, 2:42 PM
Alphare added a comment to D5628: Replace old loader with the new one.

LGTM, but let's wait for a second opinion

Apr 28 2021, 12:27 PM
Alphare requested review of D5628: Replace old loader with the new one.
Apr 28 2021, 12:07 PM
Alphare requested review of D5627: Handle more cases of corruption.
Apr 28 2021, 12:05 PM
Alphare requested review of D5626: Ignore the repository's config.
Apr 28 2021, 12:04 PM
Alphare requested review of D5625: Also use minimal env in the new Mercurial loader.
Apr 28 2021, 12:02 PM
Alphare requested review of D5623: Use billiard instead of stdlib multiprocessing.
Apr 28 2021, 12:00 PM

Mar 29 2021

Alphare accepted D5373: HgLoaderFromDisk: Simplify store_content using model.Content.from_data().
Mar 29 2021, 6:19 PM
Alphare accepted D5371: HgLoaderFromDisk: Read and write ExtIDs to find revisions already loaded.

One small nit, but the logic (and test) looks good. Thanks!

Mar 29 2021, 6:16 PM
Alphare accepted D5370: HgLoaderFromDisk: Fix type annotation.
Mar 29 2021, 5:53 PM
Alphare accepted D5369: HgLoaderFromDisk: Don't query revision_get with release ids.
Mar 29 2021, 5:52 PM

Mar 23 2021

Alphare closed D5293: Add a non-incremental sourceforge lister.
Mar 23 2021, 6:41 PM
Alphare committed rDLSf7b27c693022: Add a non-incremental sourceforge lister (authored by Alphare).
Add a non-incremental sourceforge lister
Mar 23 2021, 6:41 PM
Alphare updated the diff for D5293: Add a non-incremental sourceforge lister.

Rebase

Mar 23 2021, 6:41 PM
Alphare updated the diff for D5293: Add a non-incremental sourceforge lister.

Simplify date tests (sorry for the update spam)

Mar 23 2021, 12:08 PM
Alphare updated the diff for D5293: Add a non-incremental sourceforge lister.

Record lastmod for origins

Mar 23 2021, 12:03 PM
Alphare updated the diff for D5293: Add a non-incremental sourceforge lister.

Update typing and add retry tests + check other fatal errors

Mar 23 2021, 10:16 AM

Mar 19 2021

Alphare requested review of D5293: Add a non-incremental sourceforge lister.
Mar 19 2021, 10:51 PM
Alphare requested review of D5294: Improve correctness of sourceforge-ls.
Mar 19 2021, 6:13 PM

Mar 17 2021

Alphare added a comment to T735: SourceForge lister.

It looks like there are projects outside of the /p/ namespace. Just looking at the very first sitemap, I got an /adobe/ namespace (https://sourceforge.net/rest/adobe/manjobi), which implies that we should also consider namespaces outside of /p/ when listing.

Mar 17 2021, 4:36 PM · Origin-SourceForge

Feb 26 2021

Alphare closed D4688: HgLoaderFromDisk supports corrupted revisions.
Feb 26 2021, 7:12 PM
Alphare committed rDLDHG1b4780030eb2: HgLoaderFromDisk supports corrupted revisions (authored by acezar).
HgLoaderFromDisk supports corrupted revisions
Feb 26 2021, 7:12 PM
Alphare updated the diff for D4688: HgLoaderFromDisk supports corrupted revisions.

Rebase

Feb 26 2021, 7:11 PM
Alphare updated the diff for D4688: HgLoaderFromDisk supports corrupted revisions.

Fix and test visit status, improve error message

Feb 26 2021, 6:33 PM
Alphare added inline comments to D4688: HgLoaderFromDisk supports corrupted revisions.
Feb 26 2021, 5:16 PM
Alphare closed D5146: Use minimal environment in Mercurial loader.
Feb 26 2021, 4:51 PM
Alphare committed rDLDHGc74e5791b93e: Use minimal environment in Mercurial loader (authored by Alphare).
Use minimal environment in Mercurial loader
Feb 26 2021, 4:51 PM
Alphare updated the diff for D5146: Use minimal environment in Mercurial loader.

Rebase

Feb 26 2021, 4:49 PM
Alphare added a comment to D5146: Use minimal environment in Mercurial loader.

meh

Feb 26 2021, 4:43 PM
Alphare updated the diff for D4688: HgLoaderFromDisk supports corrupted revisions.

Fix flake8 errors

Feb 26 2021, 4:35 PM
Alphare added a comment to D4688: HgLoaderFromDisk supports corrupted revisions.

Prior to update the diff, you might want to either use tox directly, which does among other thing trigger that check ^

Feb 26 2021, 4:30 PM
Alphare updated the diff for D4688: HgLoaderFromDisk supports corrupted revisions.

Rebase and address some comments

Feb 26 2021, 4:02 PM
Alphare commandeered D4688: HgLoaderFromDisk supports corrupted revisions.
Feb 26 2021, 4:00 PM
Alphare updated the diff for D5146: Use minimal environment in Mercurial loader.

Rebase

Feb 26 2021, 12:19 PM
Alphare closed D4643: HgLoaderFromDisk: uneventful load when unchanged.
Feb 26 2021, 12:18 PM
Alphare committed rDLDHG04a1213f3679: HgLoaderFromDisk: uneventful load when unchanged (authored by acezar).
HgLoaderFromDisk: uneventful load when unchanged
Feb 26 2021, 12:18 PM
Alphare updated the diff for D4643: HgLoaderFromDisk: uneventful load when unchanged.

Add suggested assertion and fix comment typo

Feb 26 2021, 12:07 PM
Alphare updated the diff for D5146: Use minimal environment in Mercurial loader.

Rebase

Feb 26 2021, 11:26 AM
Alphare updated the diff for D4643: HgLoaderFromDisk: uneventful load when unchanged.

Rebase

Feb 26 2021, 11:20 AM
Alphare closed D5141: Don't update Mercurial repositories after cloning.
Feb 26 2021, 11:16 AM
Alphare committed rDLDHG1dbb8474ad0a: Don't update Mercurial repositories after cloning (authored by Alphare).
Don't update Mercurial repositories after cloning
Feb 26 2021, 11:16 AM
Alphare updated the diff for D5141: Don't update Mercurial repositories after cloning.

Rebase

Feb 26 2021, 11:14 AM
Alphare added inline comments to D4643: HgLoaderFromDisk: uneventful load when unchanged.
Feb 26 2021, 11:08 AM
Alphare updated the diff for D4643: HgLoaderFromDisk: uneventful load when unchanged.

Improve heads handling + remove useless fixture call

Feb 26 2021, 11:07 AM
Alphare added a comment to D5146: Use minimal environment in Mercurial loader.

hmm actually, modifying this global may interact with other parts of the code in surprising way.

Could you only use the env argument of subprocess functions instead of changing os.environ?

Feb 26 2021, 11:00 AM
Alphare commandeered D4643: HgLoaderFromDisk: uneventful load when unchanged.
Feb 26 2021, 10:45 AM
Alphare updated the diff for D4643: HgLoaderFromDisk: uneventful load when unchanged.

Fix flake8

Feb 26 2021, 10:43 AM

Feb 25 2021

Alphare updated the diff for D4643: HgLoaderFromDisk: uneventful load when unchanged.

Fix broken test + rebase (taking over from Antoine's work)

Feb 25 2021, 6:21 PM
Alphare requested review of D5146: Use minimal environment in Mercurial loader.
Feb 25 2021, 4:05 PM
Alphare updated the diff for D5141: Don't update Mercurial repositories after cloning.

Update copyright notices

Feb 25 2021, 3:59 PM
Alphare requested review of D5141: Don't update Mercurial repositories after cloning.
Feb 25 2021, 12:27 PM

Feb 23 2021

Alphare added inline comments to D5132: mercurial: README: Update to a minimum.
Feb 23 2021, 6:19 PM
Alphare closed D5125: Fix `cli` module by passing the expected argument.
Feb 23 2021, 5:09 PM
Alphare committed rDLDHG9f1243f6529f: Fix `cli` module by passing the expected argument (authored by Alphare).
Fix `cli` module by passing the expected argument
Feb 23 2021, 5:09 PM
Alphare updated the diff for D5125: Fix `cli` module by passing the expected argument.

Rebase

Feb 23 2021, 5:09 PM
Alphare committed rDLDHGef3a2ba79ea9: Make Mercurial's behavior predictable for scripts (authored by Alphare).
Make Mercurial's behavior predictable for scripts
Feb 23 2021, 4:48 PM
Alphare committed rDLDHG09b3c6daa7dd: Filter `hg` subprocess environment to the minimum (authored by Alphare).
Filter `hg` subprocess environment to the minimum
Feb 23 2021, 4:48 PM
Alphare committed rDLDHG70dcbb67e6f5: Sort imports according to `isort` rules (authored by Alphare).
Sort imports according to `isort` rules
Feb 23 2021, 4:47 PM
Alphare closed D5124: Disable user customization in Mercurial tests.
Feb 23 2021, 4:47 PM
Alphare committed rDLDHG8c81de02c9b3: Disable user customization in Mercurial tests (authored by Alphare).
Disable user customization in Mercurial tests
Feb 23 2021, 4:47 PM
Alphare updated the diff for D5124: Disable user customization in Mercurial tests.
  • Disable user customization in Mercurial tests
  • Sort imports according to isort rules
  • Filter hg subprocess environment to the minimum
  • Make Mercurial's behavior predictable for scripts
Feb 23 2021, 4:41 PM
Alphare updated the diff for D5124: Disable user customization in Mercurial tests.
  • Disable user customization in Mercurial tests
  • Sort imports according to isort rules
  • Filter hg subprocess environment to the minimum
  • Make Mercurial's behavior predictable for scripts
Feb 23 2021, 4:04 PM

Feb 22 2021

Alphare added a comment to D5124: Disable user customization in Mercurial tests.

Possibly this should be scope="session"? Since this trickles down to all subprocesses. That's a minor optimization, but might as well not be wasteful for no reason.

Feb 22 2021, 5:40 PM
Alphare added a comment to D5124: Disable user customization in Mercurial tests.

Shouldn't it also happen outside tests?

Feb 22 2021, 3:56 PM
Alphare added a comment to D4688: HgLoaderFromDisk supports corrupted revisions.

@Alphare will you continue on this work as well?

Feb 22 2021, 3:38 PM
Alphare added a comment to D5125: Fix `cli` module by passing the expected argument.

I have no issue with deprecating this module if there is a more canonical way of doing the same thing, the mercurial-specific README will have to be adjusted, I simply tried the first example and got a traceback. :)

Feb 22 2021, 3:14 PM