Page MenuHomeSoftware Heritage
Feed All Stories

Sep 16 2021

vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Sep 16 2021, 6:07 PM · System administration (Component upgrades)
vsellier updated the task description for T3579: Meta-task: upgrade infrastructure to Debian Bullseye.
Sep 16 2021, 6:06 PM · System administration (Component upgrades)
ardumont accepted D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 6:06 PM
vsellier updated subscribers of T3579: Meta-task: upgrade infrastructure to Debian Bullseye.

the content of this comment was moved to the task description

Sep 16 2021, 6:00 PM · System administration (Component upgrades)
vlorentz triaged T3582: cassandra: Use 'git ordering' for directory entries as Normal priority.
Sep 16 2021, 5:59 PM · Storage manager
ardumont updated the task description for T3581: List heptapod instance foss.heptapod.net.
Sep 16 2021, 5:53 PM · Archive coverage, System administration, Origin-GitLab
ardumont renamed T3581: List heptapod instance foss.heptapod.net from List "gitlab" instance foss.heptapod.net to List "gitlab-like" instance foss.heptapod.net.
Sep 16 2021, 5:52 PM · Archive coverage, System administration, Origin-GitLab
anlambert created P1168 (An Untitled Masterwork).
Sep 16 2021, 5:47 PM
swh-public-ci added a comment to D6284: Document how to write journal clients.

Build is green

Sep 16 2021, 5:45 PM
ardumont updated the task description for T3581: List heptapod instance foss.heptapod.net.
Sep 16 2021, 5:44 PM · Archive coverage, System administration, Origin-GitLab
ardumont added inline comments to D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 5:41 PM
vlorentz closed D6284: Document how to write journal clients.
Sep 16 2021, 5:41 PM
vlorentz committed rDJNL95d945e46efd: Document how to write journal clients (authored by vlorentz).
Document how to write journal clients
Sep 16 2021, 5:41 PM
vlorentz updated the diff for D6284: Document how to write journal clients.

fix typo

Sep 16 2021, 5:41 PM
ardumont updated the task description for T3581: List heptapod instance foss.heptapod.net.
Sep 16 2021, 5:39 PM · Archive coverage, System administration, Origin-GitLab
ardumont triaged T3581: List heptapod instance foss.heptapod.net as Normal priority.
Sep 16 2021, 5:38 PM · Archive coverage, System administration, Origin-GitLab
vlorentz added inline comments to D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 5:35 PM
douardda added inline comments to D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 5:26 PM
swh-public-ci added a comment to D6281: converters: Recompute hashes and check they match the originals.

Build is green

Sep 16 2021, 5:25 PM
swh-public-ci added a comment to D6281: converters: Recompute hashes and check they match the originals.

Build is green

Sep 16 2021, 5:25 PM
vlorentz requested review of D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 5:24 PM
vlorentz updated the diff for D6281: converters: Recompute hashes and check they match the originals.

remove dep on typing-extensions

Sep 16 2021, 5:23 PM
vlorentz updated the diff for D6281: converters: Recompute hashes and check they match the originals.

rewrite without the very readable annotation

Sep 16 2021, 5:23 PM
vlorentz added inline comments to D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 5:22 PM
ardumont accepted D6284: Document how to write journal clients.

Great doc. Thanks.

Sep 16 2021, 5:19 PM
ardumont added a comment to T3563: Analyze and make the bitbucket ingestion faster.

First round of checks validates the new diff to make the current loader mercurial faster.

Sep 16 2021, 5:15 PM · System administration, Mercurial loader
ardumont accepted D6281: converters: Recompute hashes and check they match the originals.

lgtm, a couple of questions/remarks inline.

Sep 16 2021, 5:09 PM
vlorentz requested review of D6284: Document how to write journal clients.
Sep 16 2021, 5:09 PM
ardumont edited P1167 small perf comparison on mercurial loader diffs.
Sep 16 2021, 4:40 PM
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 4:21 PM
vlorentz requested review of D6269: cassandra: Make _content_get_from_hashes run concurrently.
Sep 16 2021, 4:20 PM
ardumont edited P1167 small perf comparison on mercurial loader diffs.
Sep 16 2021, 4:16 PM
ardumont updated the title for P1167 small perf comparison on mercurial loader diffs from real small perf comparison on mercurial loader diffs to small perf comparison on mercurial loader diffs.
Sep 16 2021, 4:16 PM
douardda committed rDENV57ad032071ff: docker: document some useful kafka management commands in the README file (authored by douardda).
docker: document some useful kafka management commands in the README file
Sep 16 2021, 4:15 PM
douardda closed D6277: Improve docker/README a bit.
Sep 16 2021, 4:15 PM
douardda committed rDENVe24535cc0064: docker: wrap long cli command lines in the README file (authored by douardda).
docker: wrap long cli command lines in the README file
Sep 16 2021, 4:15 PM
ardumont edited P1167 small perf comparison on mercurial loader diffs.
Sep 16 2021, 4:13 PM
douardda updated the diff for D6277: Improve docker/README a bit.

fix indentation (tab->ws) and a few typos

Sep 16 2021, 4:10 PM
ardumont edited P1167 small perf comparison on mercurial loader diffs.
Sep 16 2021, 4:05 PM
ardumont created P1167 small perf comparison on mercurial loader diffs.
Sep 16 2021, 4:04 PM
ardumont accepted D6277: Improve docker/README a bit.

Careful, the indentation is mostly off on all your command samples.
I have no idea whether the sphinx rendering will be ok.

Sep 16 2021, 3:54 PM
ardumont added inline comments to D6277: Improve docker/README a bit.
Sep 16 2021, 3:52 PM
aeviso closed D6266: Add StatsD support to the main algorithms of the module.
Sep 16 2021, 3:40 PM
aeviso committed rDPROVd0a11a149983: Add StatsD support to the main algorithms of the module (authored by aeviso).
Add StatsD support to the main algorithms of the module
Sep 16 2021, 3:40 PM
aeviso closed D6256: Add StatsD support to `ArchiveInterface` implementations.
Sep 16 2021, 3:40 PM
aeviso committed rDPROVa8009be206dc: Add StatsD support to `ArchiveInterface` implementations (authored by aeviso).
Add StatsD support to `ArchiveInterface` implementations
Sep 16 2021, 3:40 PM
jayeshv accepted D6256: Add StatsD support to `ArchiveInterface` implementations.
Sep 16 2021, 3:21 PM
vlorentz accepted D6277: Improve docker/README a bit.
Sep 16 2021, 3:19 PM
vlorentz added a comment to D6277: Improve docker/README a bit.

thanks. you need to fix the indent in code blocks though

Sep 16 2021, 3:19 PM
anlambert closed D6283: postgresql: Fix get_snapshot_branches return value for empty search.
Sep 16 2021, 3:02 PM
anlambert committed rDSTO9465054ef003: postgresql: Fix get_snapshot_branches return value for empty search (authored by anlambert).
postgresql: Fix get_snapshot_branches return value for empty search
Sep 16 2021, 3:02 PM
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 2:59 PM
vlorentz accepted D6283: postgresql: Fix get_snapshot_branches return value for empty search.
Sep 16 2021, 2:59 PM
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 2:57 PM
vsellier closed T3408: Provide read-only access to production servers, a subtask of T1526: Install a new VPN endpoint at Rocquencourt, as Resolved.
Sep 16 2021, 2:40 PM · System administration
vsellier closed T3408: Provide read-only access to production servers as Resolved.
Sep 16 2021, 2:40 PM · System administration
vlorentz updated the test plan for D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 2:36 PM
swh-public-ci added a comment to D6281: converters: Recompute hashes and check they match the originals.

Build is green

Sep 16 2021, 2:31 PM
vlorentz updated the diff for D6281: converters: Recompute hashes and check they match the originals.

bump swh-model version

Sep 16 2021, 2:29 PM
swh-public-ci added a comment to D6281: converters: Recompute hashes and check they match the originals.

Build has FAILED

Sep 16 2021, 2:28 PM
anlambert requested review of D6283: postgresql: Fix get_snapshot_branches return value for empty search.
Sep 16 2021, 2:23 PM
vlorentz committed rDMODb6f5e30b53c8: HashableObject: Add type annotation for 'id' attribute (authored by vlorentz).
HashableObject: Add type annotation for 'id' attribute
Sep 16 2021, 2:21 PM
vlorentz closed D6282: HashableObject: Add type annotation for 'id' attribute.
Sep 16 2021, 2:21 PM
anlambert added a revision to T3413: Fix the inconsistency between snapshot_get_branches function in postgresql.storage and cassandra.storage: D6283: postgresql: Fix get_snapshot_branches return value for empty search.
Sep 16 2021, 2:15 PM · Storage manager
ardumont accepted D6282: HashableObject: Add type annotation for 'id' attribute.
Sep 16 2021, 2:15 PM
ardumont accepted D6280: converters: Add typing.

Interesting [1]

Sep 16 2021, 2:13 PM
vlorentz added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 2:13 PM
ardumont added a comment to T3468: staging: current opam loading issues.

@anlambert fixed plenty of issues including some from this ticket (thanks a bunch).

I'm planning on deploying those changes soon (around noon, i'm on something else currently).

And i'll trigger another run on staging after that ;)

Sep 16 2021, 2:13 PM · System administration, Opam
Harbormaster failed remote builds in B23681: Diff 22749 for D6281: converters: Recompute hashes and check they match the originals!
Sep 16 2021, 2:13 PM
swh-public-ci added a comment to D6281: converters: Recompute hashes and check they match the originals.

Build has FAILED

Sep 16 2021, 2:13 PM
vlorentz updated the diff for D6281: converters: Recompute hashes and check they match the originals.

fix typeann

Sep 16 2021, 2:12 PM
vlorentz requested review of D6282: HashableObject: Add type annotation for 'id' attribute.
Sep 16 2021, 2:11 PM
vlorentz requested review of D6281: converters: Recompute hashes and check they match the originals.
Sep 16 2021, 2:09 PM
vlorentz committed rDMODe8794971bdd8: Run Black (authored by vlorentz).
Run Black
Sep 16 2021, 2:07 PM
swh-public-ci added a comment to D6275: Adapt extid filtering so it happens server side.

Build is green

Sep 16 2021, 1:52 PM
swh-public-ci added a comment to D6268: mercurial: Build snapshot on visits.

Build is green

Sep 16 2021, 1:51 PM
swh-public-ci added a comment to D6240: Use extids to filter out already seen revisions across hg origins.

Build is green

Sep 16 2021, 1:50 PM
ardumont updated the diff for D6275: Adapt extid filtering so it happens server side.

Rebase

Sep 16 2021, 1:49 PM
ardumont updated the diff for D6268: mercurial: Build snapshot on visits.

Rebase

Sep 16 2021, 1:49 PM
ardumont updated the diff for D6240: Use extids to filter out already seen revisions across hg origins.

Adapt according to last comments

Sep 16 2021, 1:48 PM
vlorentz requested review of D6280: converters: Add typing.
Sep 16 2021, 1:45 PM
vlorentz closed D6279: Migrate to pytest-style tests.
Sep 16 2021, 1:37 PM
vlorentz committed rDLDG85eb54015c6b: Migrate to pytest-style tests (authored by vlorentz).
Migrate to pytest-style tests
Sep 16 2021, 1:37 PM
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 12:37 PM
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 12:34 PM
olasd added inline comments to D6279: Migrate to pytest-style tests.
Sep 16 2021, 12:34 PM
ardumont renamed T2581: Upgrade PostgreSQLs to 12.x / 13.x from Upgrade PostgreSQLs to 12.x to Upgrade PostgreSQLs to 12.x / 13.x.
Sep 16 2021, 12:25 PM · System administration
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 12:11 PM
ardumont added inline comments to D6240: Use extids to filter out already seen revisions across hg origins.
Sep 16 2021, 12:07 PM
ardumont accepted D6279: Migrate to pytest-style tests.

Awesome! Thanks.

Sep 16 2021, 12:04 PM
ardumont added a reviewer for D5988: initial CVS loader stub: Reviewers.
Sep 16 2021, 11:59 AM
stsp requested review of D5988: initial CVS loader stub.
Sep 16 2021, 11:59 AM
vlorentz requested review of D6279: Migrate to pytest-style tests.
Sep 16 2021, 11:56 AM
ardumont added a revision to T2845: Improve Subversion loader and develop CVS loader: D5988: initial CVS loader stub.
Sep 16 2021, 11:53 AM · Archive coverage
ardumont committed rCDFJe3ee83908d2b: Update container to install the cvs dependency (authored by ardumont).
Update container to install the cvs dependency
Sep 16 2021, 11:47 AM
ardumont closed D6278: Update container to install the cvs dependency.
Sep 16 2021, 11:47 AM
ardumont updated the test plan for D6278: Update container to install the cvs dependency.
Sep 16 2021, 11:37 AM
vsellier closed T3493: [cassandra] Git loader performance are very bad as Resolved.

changing the status to resolved as the main issues are solved.
Other tests with more parallel workers will be launched, if other problems will be detected, they will be tracked in new dedicated tickets.

Sep 16 2021, 11:31 AM · System administration, Storage manager
vsellier closed T3493: [cassandra] Git loader performance are very bad, a subtask of T3357: Perform some tests of the cassandra storage on Grid5000, as Resolved.
Sep 16 2021, 11:31 AM · System administration, Storage manager
vlorentz committed rDLDG8ad9799f2898: Fix pytest warning about undefined marker (authored by vlorentz).
Fix pytest warning about undefined marker
Sep 16 2021, 11:28 AM