Page MenuHomeSoftware Heritage

Alphare (Raphaël Gomès)
User

Projects

User does not belong to any projects.

User Details

User Since
Feb 22 2021, 11:30 AM (29 w, 6 d)

Recent Activity

Jun 15 2021

Alphare closed D5816: loader: add an hg-specific mapping for branching.
Jun 15 2021, 11:30 AM
Alphare committed rDLDHG2877eb3c4ec3: loader: add an hg-specific mapping for branching (authored by Alphare).
loader: add an hg-specific mapping for branching
Jun 15 2021, 11:30 AM
Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

HEAD is not required anymore

Jun 15 2021, 11:29 AM
Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

Update default branch mechanism

Jun 15 2021, 11:22 AM

Jun 9 2021

Alphare added inline comments to D5816: loader: add an hg-specific mapping for branching.
Jun 9 2021, 6:07 PM
Alphare added inline comments to D5816: loader: add an hg-specific mapping for branching.
Jun 9 2021, 5:58 PM
Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

Does this work yet?

Jun 9 2021, 11:24 AM
Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

Incorporate latest suggestions

Jun 9 2021, 10:58 AM

Jun 7 2021

Alphare added inline comments to D5816: loader: add an hg-specific mapping for branching.
Jun 7 2021, 12:19 PM
Alphare added inline comments to D5816: loader: add an hg-specific mapping for branching.
Jun 7 2021, 11:11 AM
Alphare added inline comments to D5816: loader: add an hg-specific mapping for branching.
Jun 7 2021, 11:02 AM
Alphare added inline comments to D5816: loader: add an hg-specific mapping for branching.
Jun 7 2021, 10:58 AM

Jun 4 2021

Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

Incorporate suggestions by olasd

Jun 4 2021, 1:45 PM
Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

Add documentation and sort heads

Jun 4 2021, 12:03 PM
Alphare updated the diff for D5816: loader: add an hg-specific mapping for branching.

Rebase and adjust the naming scheme

Jun 4 2021, 11:36 AM
Alphare closed D5815: Fix data build script.
Jun 4 2021, 11:33 AM
Alphare committed rDLDHGf9fa0dd39df5: Fix data build script (authored by Alphare).
Fix data build script
Jun 4 2021, 11:33 AM
Alphare closed D5820: sourceforge: use http:// for Mercurial.
Jun 4 2021, 11:12 AM
Alphare committed rDLSe8f966de5962: sourceforge: use http:// for Mercurial (authored by Alphare).
sourceforge: use http:// for Mercurial
Jun 4 2021, 11:12 AM
Alphare requested review of D5820: sourceforge: use http:// for Mercurial.
Jun 4 2021, 10:56 AM

Jun 3 2021

Alphare added a comment to T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip).

I think @marmoute's intention was to more closely convey the semantics of Mercurial's branching system. A branch tip or head are not a branches themselves, so it would be "wrong" to put them under branches/. Thus, since the plural of "a branch head" is "branch heads" I don't feel like the second change would be appropriate either.

Jun 3 2021, 2:26 PM · Mercurial loader
Alphare updated the task description for T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip).
Jun 3 2021, 2:03 PM · Mercurial loader
Alphare added a comment to T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip).

Here's what I gather to be the most up-to-date version:

Jun 3 2021, 2:01 PM · Mercurial loader
Alphare added a comment to D5815: Fix data build script.
In D5815#148012, @olasd wrote:

Hum, looks like you squashed the changes related to the new branch structure with this the change described in the commit message. Would it be possible to split them off? If not, then the commit message needs to actually describe the change in branch structure, rather than the incidental change to the data generation script.

Jun 3 2021, 10:29 AM
Alphare updated the diff for D5815: Fix data build script.

Remove unrelated changes

Jun 3 2021, 10:28 AM
Alphare closed D5817: sourceforge: set the protocol for origin urls.
Jun 3 2021, 10:08 AM
Alphare committed rDLS2e0c951be097: sourceforge: set the protocol for origin urls (authored by Alphare).
sourceforge: set the protocol for origin urls
Jun 3 2021, 10:08 AM
Alphare requested review of D5817: sourceforge: set the protocol for origin urls.
Jun 3 2021, 10:06 AM

Jun 2 2021

Alphare requested review of D5816: loader: add an hg-specific mapping for branching.
Jun 2 2021, 7:20 PM
Alphare added a comment to T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip).

I have implemented @marmoute's version of the mapping at D5816. Since the exact naming scheme is just one search-and-replace away, we can still change it easily. Implementing this has highlighted a flaw in the handling of multiple open heads, which is now fixed.

Jun 2 2021, 7:20 PM · Mercurial loader
Alphare requested review of D5815: Fix data build script.
Jun 2 2021, 7:14 PM

May 31 2021

Alphare updated subscribers of T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip).

Agreed! That would look like:

May 31 2021, 4:38 PM · Mercurial loader
Alphare updated the task description for T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip).
May 31 2021, 3:53 PM · Mercurial loader
Alphare triaged T3352: Define a ref mapping naming scheme for all Mercurial "pointers" (heads, closed heads, bookmarks, tip) as High priority.
May 31 2021, 3:40 PM · Mercurial loader
Alphare added a comment to T3338: Load the archived bitbucket mercurial repositories.

The run from this week-end, detailed in T3336, appears to have worked fine. (just making sure it's obvious from this task also)

May 31 2021, 10:37 AM · System administration, Mercurial loader
Alphare added a comment to T3336: Deploy swh.loader.mercurial 2.1 in staging.

Great news! Let me know if I can help in any way.

May 31 2021, 10:16 AM · System administration, Mercurial loader

May 28 2021

Alphare added a comment to T3338: Load the archived bitbucket mercurial repositories.

For posterity, I have tested that all corrupted and "verify failed" repositories in the archive load correctly, as well as the humongous Mozilla-unified, PyPy and about a few thousand random other ones from the archive. Aside from the incremental loading issues detailed in T3336 (that should be fixed in today's run), everything seems fine.

May 28 2021, 11:53 AM · System administration, Mercurial loader
Alphare closed D5793: new-loader: fix incremental load of multiple heads.
May 28 2021, 11:08 AM
Alphare committed rDLDHG0f19c32fc0a5: new-loader: fix incremental load of multiple heads (authored by Alphare).
new-loader: fix incremental load of multiple heads
May 28 2021, 11:08 AM
Alphare added inline comments to D5793: new-loader: fix incremental load of multiple heads.
May 28 2021, 11:00 AM
Alphare updated the diff for D5793: new-loader: fix incremental load of multiple heads.

Batch RPC calls

May 28 2021, 11:00 AM

May 27 2021

Alphare updated subscribers of T3336: Deploy swh.loader.mercurial 2.1 in staging.

D5793 should fix the remaining issue. We had a discussion with @marmoute about whether considering closed branches (done in D5790) is *actually* a good idea in terms of presentation, but D5793 fixes the underlying issue, so we'll see about this issue next week.

May 27 2021, 10:58 PM · System administration, Mercurial loader
Alphare requested review of D5793: new-loader: fix incremental load of multiple heads.
May 27 2021, 6:27 PM
Alphare closed D5790: loader: don't ignore closed branches.
May 27 2021, 2:51 PM
Alphare committed rDLDHG44fc0133da71: loader: don't ignore closed branches (authored by Alphare).
loader: don't ignore closed branches
May 27 2021, 2:51 PM
Alphare updated the diff for D5790: loader: don't ignore closed branches.

Refactor expected stats in new test

May 27 2021, 2:44 PM
Alphare added a comment to D5790: loader: don't ignore closed branches.

I guess it's some kind of read-only branch. Once marked
closed by the hg commit cli, we can't push any more
on it, right?

May 27 2021, 2:44 PM
Alphare requested review of D5790: loader: don't ignore closed branches.
May 27 2021, 12:58 PM

May 26 2021

Alphare closed D5785: sourceforge: retry for all retryable exceptions.
May 26 2021, 12:39 PM
Alphare committed rDLS9ca5295a408b: sourceforge: retry for all retryable exceptions (authored by Alphare).
sourceforge: retry for all retryable exceptions
May 26 2021, 12:39 PM
Alphare added a comment to T3310: Deploy sourceforge lister on staging.

(Hopefully) Addressed in D5785

May 26 2021, 12:15 PM · System administration, Origin-SourceForge
Alphare requested review of D5785: sourceforge: retry for all retryable exceptions.
May 26 2021, 12:14 PM
Alphare added a comment to T3310: Deploy sourceforge lister on staging.

Sorry for the delayed response. I'm assuming we'd like it better if the lister continued anyway in case of a "fatal" connection error, with maybe some sort of retry?

May 26 2021, 10:13 AM · System administration, Origin-SourceForge

May 21 2021

Alphare closed D5767: new-loader: don't cleanup repo if source is local.
May 21 2021, 6:17 PM
Alphare committed rDLDHGcce9ec940ef2: new-loader: don't cleanup repo if source is local (authored by Alphare).
new-loader: don't cleanup repo if source is local
May 21 2021, 6:17 PM
Alphare closed D5766: new-loader: save ExtID for each revision.
May 21 2021, 6:17 PM
Alphare committed rDLDHGdbb12fdb944d: new-loader: save ExtID for each revision (authored by Alphare).
new-loader: save ExtID for each revision
May 21 2021, 6:17 PM
Alphare requested review of D5767: new-loader: don't cleanup repo if source is local.
May 21 2021, 6:14 PM
Alphare requested review of D5766: new-loader: save ExtID for each revision.
May 21 2021, 6:10 PM
Alphare added a comment to T3338: Load the archived bitbucket mercurial repositories.

The mapping file is located (on the boatbucket machine) at /srv/boatbucket/mapping-to-repos.txt. It does *not* contain the (very few) outright corrupted repositories, I might have to do some digging and even bother the BB team again to get the URL for those.

May 21 2021, 11:34 AM · System administration, Mercurial loader

May 19 2021

Alphare closed D5628: Replace old loader with the new one.
May 19 2021, 2:53 PM
Alphare committed rDLDHG92441e90110b: Replace old loader with the new one (authored by Alphare).
Replace old loader with the new one
May 19 2021, 2:53 PM
Alphare updated the diff for D5628: Replace old loader with the new one.

Rebase

May 19 2021, 2:49 PM
Alphare triaged T3335: Integrate the new Mercurial loader into the tasks system as High priority.
May 19 2021, 2:48 PM · Mercurial loader

May 18 2021

Alphare closed D5687: Make the Mercurial loader incremental.
May 18 2021, 11:18 AM
Alphare committed rDLDHG4630de8a500d: Make the Mercurial loader incremental (authored by Alphare).
Make the Mercurial loader incremental
May 18 2021, 11:18 AM
Alphare closed D5740: sourceforge: don't abort on error for project.
May 18 2021, 11:16 AM
Alphare committed rDLS8f3bbacd5eee: sourceforge: don't abort on error for project (authored by Alphare).
sourceforge: don't abort on error for project
May 18 2021, 11:16 AM

May 12 2021

Alphare added a comment to D5740: sourceforge: don't abort on error for project.

When this happens, will the page be visited again by the incremental lister?

May 12 2021, 3:55 PM
Alphare updated the diff for D5740: sourceforge: don't abort on error for project.

More thorough testing

May 12 2021, 3:55 PM
Alphare requested review of D5740: sourceforge: don't abort on error for project.
May 12 2021, 11:14 AM

May 7 2021

Alphare updated the diff for D5687: Make the Mercurial loader incremental.

Include suggestions

May 7 2021, 2:13 PM
Alphare closed D5691: Remove `os.environ` manipulation in tests.
May 7 2021, 1:33 PM
Alphare committed rDLDHG773d872a8164: Move `os.environ` manipulation to pre_cleanup (authored by Alphare).
Move `os.environ` manipulation to pre_cleanup
May 7 2021, 1:33 PM
Alphare planned changes to D5687: Make the Mercurial loader incremental.

I haven't gotten around to doing the changes yet, will do so shortly.

May 7 2021, 1:33 PM
Alphare updated the diff for D5687: Make the Mercurial loader incremental.

Rebase

May 7 2021, 1:27 PM
Alphare updated the diff for D5691: Remove `os.environ` manipulation in tests.

Remove pytest-postgresql hotfix

May 7 2021, 1:26 PM
Alphare updated the diff for D5687: Make the Mercurial loader incremental.

Rebase + remove useless loader call in test

May 7 2021, 11:58 AM
Alphare added inline comments to D5691: Remove `os.environ` manipulation in tests.
May 7 2021, 11:58 AM
Alphare updated the diff for D5691: Remove `os.environ` manipulation in tests.

Better fix for environment manipulation

May 7 2021, 11:58 AM

May 6 2021

Alphare closed D5706: Initial commit.
May 6 2021, 5:31 PM
Alphare committed rDLDBZR8352a4454af5: Initial commit (authored by Alphare).
Initial commit
May 6 2021, 5:31 PM
Alphare requested review of D5706: Initial commit.
May 6 2021, 5:26 PM
Alphare added inline comments to D5687: Make the Mercurial loader incremental.
May 6 2021, 11:38 AM
Alphare closed D5659: Make the SourceForge lister incremental.
May 6 2021, 10:32 AM
Alphare committed rDLS3baf1d099940: Make the SourceForge lister incremental (authored by Alphare).
Make the SourceForge lister incremental
May 6 2021, 10:32 AM
Alphare updated the diff for D5659: Make the SourceForge lister incremental.

Postfix the type aliases with "T"

May 6 2021, 10:30 AM
Alphare updated the diff for D5687: Make the Mercurial loader incremental.

Rebase

May 6 2021, 10:09 AM
Alphare updated the diff for D5691: Remove `os.environ` manipulation in tests.

Refactor test detection in a function

May 6 2021, 10:08 AM

May 5 2021

Alphare abandoned D4649: HgLoaderFromDisk: Only load new commits.

Abandoned in favor of D5687

May 5 2021, 10:45 PM
Alphare commandeered D4649: HgLoaderFromDisk: Only load new commits.
May 5 2021, 10:45 PM
Alphare requested review of D5691: Remove `os.environ` manipulation in tests.
May 5 2021, 10:43 PM
Alphare requested review of D5687: Make the Mercurial loader incremental.
May 5 2021, 10:37 PM
Alphare closed D5688: requirements-test: don't install pytest-postgresql 3.0+.
May 5 2021, 9:28 PM
Alphare committed rDDEP144a6e76aa6a: requirements-test: don't install pytest-postgresql 3.0+ (authored by Alphare).
requirements-test: don't install pytest-postgresql 3.0+
May 5 2021, 9:28 PM
Alphare requested review of D5688: requirements-test: don't install pytest-postgresql 3.0+.
May 5 2021, 6:55 PM

May 4 2021

Alphare added inline comments to D5659: Make the SourceForge lister incremental.
May 4 2021, 5:40 PM

May 1 2021

Alphare updated the diff for D5659: Make the SourceForge lister incremental.

Cover "noop" project case

May 1 2021, 12:06 PM
Alphare added a comment to D5659: Make the SourceForge lister incremental.

Jenkins/Phabricator reports most of the new code in listed_origins and _get_pages_for_project is not covered by tests, could you check? (It's sometimes wrong, we don't understand why)

May 1 2021, 11:41 AM
Alphare updated the diff for D5659: Make the SourceForge lister incremental.

Fix incremental testing + incorporate suggestions

May 1 2021, 11:38 AM