- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jan 8 2023
Jan 8 2023
gitlab-migration changed the status of T3418: Decide a consistent policy on having multiple archived objects for the same extid, a subtask of T3338: Load the archived bitbucket mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T3418: Decide a consistent policy on having multiple archived objects for the same extid from Resolved to Migrated.
gitlab-migration changed the status of T2486: Add missing coverage to the check-snapshot utility check function (and drop dead code), a subtask of T2481: Migrate dvcs loader tests code to pytest, from Resolved to Migrated.
gitlab-migration changed the status of T2488: Drop loader.core BaseLoaderTest and BaseLoaderStorageTest, a subtask of T2481: Migrate dvcs loader tests code to pytest, from Resolved to Migrated.
gitlab-migration changed the status of T2486: Add missing coverage to the check-snapshot utility check function (and drop dead code) from Resolved to Migrated.
gitlab-migration changed the status of T2488: Drop loader.core BaseLoaderTest and BaseLoaderStorageTest from Resolved to Migrated.
gitlab-migration changed the status of T2483: tests: Make check-snapshot utility test function recursively check targetted object exists, a subtask of T2481: Migrate dvcs loader tests code to pytest, from Resolved to Migrated.
gitlab-migration changed the status of T2484: Move sharable fixtures out of conftest into a dedicated pytest plugin from Resolved to Migrated.
gitlab-migration changed the status of T2483: tests: Make check-snapshot utility test function recursively check targetted object exists from Resolved to Migrated.
gitlab-migration changed the status of T2484: Move sharable fixtures out of conftest into a dedicated pytest plugin, a subtask of T2481: Migrate dvcs loader tests code to pytest, from Resolved to Migrated.
gitlab-migration changed the status of T2481: Migrate dvcs loader tests code to pytest from Resolved to Migrated.
gitlab-migration changed the status of T976: google import: Clean up wrong revisions, a subtask of T682: Ingest Google Code Mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T976: google import: Clean up wrong revisions from Resolved to Migrated.
gitlab-migration changed the status of T970: mercurial loader: What to do in case of .hgtags? from Resolved to Migrated.
gitlab-migration changed the status of T970: mercurial loader: What to do in case of .hgtags?, a subtask of T965: googlecode import: Analyze and fix errors, from Resolved to Migrated.
gitlab-migration changed the status of T965: googlecode import: Analyze and fix errors, a subtask of T682: Ingest Google Code Mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T965: googlecode import: Analyze and fix errors from Resolved to Migrated.
gitlab-migration changed the status of T957: googlecode import: Check for origin clashes and fix if any, a subtask of T682: Ingest Google Code Mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T956: googlecode import: Clean up visit wrongly targetting empty snapshot, a subtask of T682: Ingest Google Code Mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T957: googlecode import: Check for origin clashes and fix if any from Resolved to Migrated.
gitlab-migration changed the status of T956: googlecode import: Clean up visit wrongly targetting empty snapshot from Resolved to Migrated.
gitlab-migration changed the status of T955: googlecode import: hglib.error.CommandError during loading, a subtask of T682: Ingest Google Code Mercurial repositories, from Wontfix to Migrated.
gitlab-migration changed the status of T955: googlecode import: hglib.error.CommandError during loading from Wontfix to Migrated.
gitlab-migration closed T3647: CloneFailure on non-existent hg repo hosted on phabricator as Migrated.
gitlab-migration closed T1156: Fix release targets of already loaded mercurial type origins, a subtask of T682: Ingest Google Code Mercurial repositories, as Migrated.
gitlab-migration changed the status of T3612: Clean up mercurial loader code from Resolved to Migrated.
gitlab-migration changed the status of T3584: loader mercurial edge case about missing mapping from revision to hgnode-id from Resolved to Migrated.
gitlab-migration changed the status of T3571: mercurial loader: Fix snapshot creation from Resolved to Migrated.
gitlab-migration changed the status of T3335: Integrate the new Mercurial loader into the tasks system from Resolved to Migrated.
gitlab-migration changed the status of T2750: mercurial loader fails on save code now from Resolved to Migrated.
gitlab-migration changed the status of T2487: Migrate hg loader tests code to pytest from Resolved to Migrated.
gitlab-migration changed the status of T2482: Migrate git loader tests code to pytest, a subtask of T2481: Migrate dvcs loader tests code to pytest, from Resolved to Migrated.
gitlab-migration changed the status of T2462: svn loader: Refactor tests using pytest fixtures, a subtask of T2481: Migrate dvcs loader tests code to pytest, from Resolved to Migrated.
gitlab-migration changed the status of T1989: Mercurial visits are always eventful from Resolved to Migrated.
gitlab-migration changed the status of T1962: Mercurial loader sometimes hangs forever during hg clone from Resolved to Migrated.
gitlab-migration changed the status of T1729: Properly handle transplant_source entry in changeset extra from Resolved to Migrated.
gitlab-migration changed the status of T1189: Use mercurial tags as named pointer (referenced in the snapshot) from Invalid to Migrated.
gitlab-migration changed the status of T1155: Mercurial loader: release target is invalid from Resolved to Migrated.
gitlab-migration changed the status of T998: Mercurial loader sometimes creates snapshots that point to revisions that haven't been loaded from Resolved to Migrated.
gitlab-migration changed the status of T985: loader*: Make prepare method resilient to error and origin visit status compliant, a subtask of T964: 2018-02-16 worker disk full postmortem, from Resolved to Migrated.
gitlab-migration changed the status of T985: loader*: Make prepare method resilient to error and origin visit status compliant from Resolved to Migrated.
gitlab-migration changed the status of T982: failing worker consumes remaining tasks without processing them, a subtask of T964: 2018-02-16 worker disk full postmortem, from Resolved to Migrated.
gitlab-migration changed the status of T964: 2018-02-16 worker disk full postmortem, a subtask of T329: hg / mercurial loader, from Resolved to Migrated.
gitlab-migration changed the status of T964: 2018-02-16 worker disk full postmortem from Resolved to Migrated.
gitlab-migration changed the status of T954: Add tests to loader-mercurial from Resolved to Migrated.
gitlab-migration changed the status of T908: mercurial loader: Define scheduler task(s), a subtask of T329: hg / mercurial loader, from Resolved to Migrated.
gitlab-migration changed the status of T908: mercurial loader: Define scheduler task(s) from Resolved to Migrated.
gitlab-migration changed the status of T907: mercurial loader: Align mercurial loader with other loaders from Resolved to Migrated.
gitlab-migration changed the status of T907: mercurial loader: Align mercurial loader with other loaders, a subtask of T329: hg / mercurial loader, from Resolved to Migrated.
gitlab-migration changed the status of T682: Ingest Google Code Mercurial repositories from Resolved to Migrated.
gitlab-migration changed the status of T329: hg / mercurial loader, a subtask of T682: Ingest Google Code Mercurial repositories, from Resolved to Migrated.
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T3658: Reference bitbucket mercurial origins from Resolved to Migrated.
gitlab-migration changed the status of T3658: Reference bitbucket mercurial origins, a subtask of T3338: Load the archived bitbucket mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T3567: storage: Allow extid reading with filter on extid version from Resolved to Migrated.
gitlab-migration changed the status of T3567: storage: Allow extid reading with filter on extid version, a subtask of T3563: Analyze and make the bitbucket ingestion faster, from Resolved to Migrated.
gitlab-migration changed the status of T3563: Analyze and make the bitbucket ingestion faster, a subtask of T3338: Load the archived bitbucket mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T3563: Analyze and make the bitbucket ingestion faster from Resolved to Migrated.
gitlab-migration changed the status of T3455: Make bitbucket origins ingestion concurrent from Resolved to Migrated.
gitlab-migration changed the status of T3455: Make bitbucket origins ingestion concurrent, a subtask of T3338: Load the archived bitbucket mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T3448: production: Deploy swh.loader.mercurial v2.1.0 from Resolved to Migrated.
gitlab-migration changed the status of T3448: production: Deploy swh.loader.mercurial v2.1.0, a subtask of T3418: Decide a consistent policy on having multiple archived objects for the same extid, from Resolved to Migrated.
gitlab-migration changed the status of T3447: staging: Deploy swh.loader.mercurial v2.1.0, a subtask of T3418: Decide a consistent policy on having multiple archived objects for the same extid, from Resolved to Migrated.
gitlab-migration changed the status of T3447: staging: Deploy swh.loader.mercurial v2.1.0 from Resolved to Migrated.
gitlab-migration changed the status of T3338: Load the archived bitbucket mercurial repositories from Resolved to Migrated.
gitlab-migration changed the status of T3337: Smoke test ingestion of bitbucket repositories with latest loader mercurial from Resolved to Migrated.
gitlab-migration changed the status of T3337: Smoke test ingestion of bitbucket repositories with latest loader mercurial, a subtask of T3338: Load the archived bitbucket mercurial repositories, from Resolved to Migrated.
gitlab-migration changed the status of T3336: Deploy swh.loader.mercurial 2.1 in staging, a subtask of T3337: Smoke test ingestion of bitbucket repositories with latest loader mercurial, from Resolved to Migrated.
gitlab-migration changed the status of T3336: Deploy swh.loader.mercurial 2.1 in staging from Resolved to Migrated.
gitlab-migration closed T2549: Restore Mercurial visits deleted in august 2018 from backups as Migrated.
gitlab-migration changed the status of T906: mercurial loader: Debian package, a subtask of T329: hg / mercurial loader, from Resolved to Migrated.
gitlab-migration changed the status of T906: mercurial loader: Debian package from Resolved to Migrated.
gitlab-migration changed the status of T909: mercurial loader: Define puppet manifest for actual deployment, a subtask of T329: hg / mercurial loader, from Resolved to Migrated.
gitlab-migration changed the status of T909: mercurial loader: Define puppet manifest for actual deployment from Resolved to Migrated.
Nov 18 2021
Nov 18 2021
ardumont moved T3455: Make bitbucket origins ingestion concurrent from code-review/await-feedback/pause to done on the System administration board.
ardumont moved T3338: Load the archived bitbucket mercurial repositories from deployed/landed/monitoring to done on the System administration board.
Nov 10 2021
Nov 10 2021
Done now, closing.
Nov 8 2021
Nov 8 2021
Remains 1 origin still ongoing... almost there...
Oct 26 2021
Oct 26 2021
Remains 3 origins still ongoing...
Oct 20 2021
Oct 20 2021
Remains 6 origins still ongoing...
ardumont closed T3658: Reference bitbucket mercurial origins, a subtask of T3338: Load the archived bitbucket mercurial repositories, as Resolved.
I've opened T3674 to discuss how to properly reference origins that are not the output of listers.
ardumont moved T3658: Reference bitbucket mercurial origins from in-progress to deployed/landed/monitoring on the System administration board.
New webapp version deployed [1], we can see the mercurial origins referenced as a discontinued service there.
Oct 18 2021
Oct 18 2021
Oct 15 2021
Oct 15 2021
Right, that is not cloneable [1].
So we need to handle this more properly and raise a NotFound.
ardumont changed the status of T3658: Reference bitbucket mercurial origins, a subtask of T3338: Load the archived bitbucket mercurial repositories, from Open to Work in Progress.
ardumont changed the status of T3658: Reference bitbucket mercurial origins from Open to Work in Progress.
A first simple solution has been implemented in the webapp for now [1].
It's not deployed yet.
ardumont renamed T3658: Reference bitbucket mercurial origins from Reference bitbucket mercurial origins in scheduler metrics to Reference bitbucket mercurial origins.
Oct 14 2021
Oct 14 2021
Actual count on bitbucket origins:
14:23:32 softwareheritage@belvedere:5432=> select now(), count(distinct url) from origin o inner join origin_visit ov on o.id=ov.origin where o.url like 'https://bitbucket.org/%' and ov.type='hg'; +-------------------------------+--------+ | now | count | +-------------------------------+--------+ | 2021-10-14 12:23:33.901117+00 | 336795 | +-------------------------------+--------+ (1 row)
In T3658#72284, @olasd wrote:We could argue that adding a separate, "virtual" lister instance for these bulk archived origins would make sense, but I don't know if it's worth the bother.
I was thinking of something ad-hoc such as: