Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 6 2022

ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 6 2022, 3:36 PM · Data Model, Nixguix loader
ardumont triaged T4608: nixpkgs manifests list "recursive" file which are missing information to recompute their hashes as Normal priority.
Oct 6 2022, 3:32 PM · Data Model, Nixguix loader
ardumont updated the summary of D8636: ContentLoader: Allow nar computation checks.
Oct 6 2022, 3:02 PM
ardumont retitled D8636: ContentLoader: Allow nar computation checks from wip: ContentLoader: Allow nar computation checks to ContentLoader: Allow nar computation checks.
Oct 6 2022, 3:01 PM
ardumont added a comment to P1490 File with "recursive" outputHashAlgo: cannot do anything about it (bit executable not propagated to manifest).

Another one [1] [2]

Oct 6 2022, 2:49 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 6 2022, 2:44 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

The actual nixpkgs manifests are either not built properly or not complete yet. They
sometimes are referencing hash we cannot compute back as only the derivation is
containing the information [1] [2].

Oct 6 2022, 2:37 PM · Data Model, Nixguix loader
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 6 2022, 2:31 PM · Data Model, Nixguix loader
ardumont edited P1490 File with "recursive" outputHashAlgo: cannot do anything about it (bit executable not propagated to manifest).
Oct 6 2022, 2:29 PM
ardumont created P1490 File with "recursive" outputHashAlgo: cannot do anything about it (bit executable not propagated to manifest).
Oct 6 2022, 2:27 PM
ardumont updated the title for P1489 File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation) from File with "recursive" outputHashAlgo to File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation).
Oct 6 2022, 2:26 PM
ardumont added a comment to P1489 File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation).

Nice catch! I did not realize the fs layout when reading this derivation.

Oct 6 2022, 2:20 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 6 2022, 2:08 PM · Data Model, Nixguix loader
ardumont requested review of D8636: ContentLoader: Allow nar computation checks.
Oct 6 2022, 1:07 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8636: ContentLoader: Allow nar computation checks.
Oct 6 2022, 1:03 PM · Data Model, Nixguix loader
ardumont added a comment to P1489 File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation).

Now remains for me to understand how to check that checksum though...

Oct 6 2022, 12:09 PM
ardumont accepted D8635: gitlab-staging: Add the configuration to install the gitlab operator.
Oct 6 2022, 11:59 AM
ardumont added a comment to P1489 File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation).

Awesome, thx. That means that in that case, the outputHash (base32) and the integrity field (base64) match!

Oct 6 2022, 11:44 AM
ardumont closed T4607: GraphQL: staging - Deploy version v0.0.6 as Resolved.
Oct 6 2022, 11:38 AM · System administration, GraphQL API
ardumont committed R260:f994ac8b25f6: staging/graphql: Release v0.0.6 (authored by ardumont).
staging/graphql: Release v0.0.6
Oct 6 2022, 11:18 AM
ardumont committed R259:bd7bb408c3a2: swh-graphql: Unpin swh-graphql and actually bump new release v0.0.6 (authored by ardumont).
swh-graphql: Unpin swh-graphql and actually bump new release v0.0.6
Oct 6 2022, 11:17 AM
ardumont moved T4607: GraphQL: staging - Deploy version v0.0.6 from in-progress to deployed/landed/monitoring on the System administration board.
Oct 6 2022, 11:08 AM · System administration, GraphQL API
ardumont updated the task description for T4607: GraphQL: staging - Deploy version v0.0.6.
Oct 6 2022, 11:08 AM · System administration, GraphQL API
ardumont committed R260:9e224dcae50d: staging/graphql: Release v0.0.6 (authored by ardumont).
staging/graphql: Release v0.0.6
Oct 6 2022, 11:01 AM
ardumont committed R259:df753d71c66e: swh-graphql: Bump new release v0.0.6 (authored by ardumont).
swh-graphql: Bump new release v0.0.6
Oct 6 2022, 11:00 AM
ardumont updated the task description for T4607: GraphQL: staging - Deploy version v0.0.6.
Oct 6 2022, 10:57 AM · System administration, GraphQL API
ardumont changed the status of T4607: GraphQL: staging - Deploy version v0.0.6 from Open to Work in Progress.
Oct 6 2022, 10:55 AM · System administration, GraphQL API
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 6 2022, 10:53 AM · Data Model, Nixguix loader
ardumont closed D8632: nixguix: Refactor by renaming success or failure the different datasets.
Oct 6 2022, 10:52 AM
ardumont committed rDLS5a53243bd3de: nixguix: Refactor by renaming success or failure the different datasets (authored by ardumont).
nixguix: Refactor by renaming success or failure the different datasets
Oct 6 2022, 10:52 AM
ardumont added a comment to P1489 File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation).
$ file emoji-zwj-sequences.txt
emoji-zwj-sequences.txt: UTF-8 Unicode text
Oct 6 2022, 10:48 AM
ardumont moved T4607: GraphQL: staging - Deploy version v0.0.6 from Backlog to Weekly backlog on the System administration board.
Oct 6 2022, 10:44 AM · System administration, GraphQL API
ardumont created P1489 File with "recursive" outputHashAlgo: cannot do anything about it (missing information in manifest, strange fs layout manipulation).
Oct 6 2022, 10:43 AM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Finally, more concentrated frequency dict:

Oct 6 2022, 9:17 AM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

It must be more interesting to read it with a frequency [1]:

Oct 6 2022, 9:10 AM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Out of the paste [1] (csv extract from swh-scheduler dev db after 3 lister runs on
docker), here is the state of detected files [2] so far (computed with [3]):

Oct 6 2022, 9:04 AM · Data Model, Nixguix loader
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 6 2022, 8:50 AM · Data Model, Nixguix loader
ardumont created P1488 lister-nixguix directories listed so far (all 3 manifests: guix, unstable-swh, unstable-full).
Oct 6 2022, 8:47 AM
ardumont created P1487 lister-nixguix contents listed so far (all 3 manifests: guix, unstable-swh, unstable-full).
Oct 6 2022, 8:46 AM

Oct 5 2022

ardumont updated the diff for D8632: nixguix: Refactor by renaming success or failure the different datasets.

Rebase

Oct 5 2022, 10:56 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 4:57 PM · Data Model, Nixguix loader
ardumont requested review of D8632: nixguix: Refactor by renaming success or failure the different datasets.
Oct 5 2022, 4:57 PM
ardumont created P1486 repo detected as urls (because misqualified in manifest) but they are repositories....
Oct 5 2022, 4:56 PM
ardumont added inline comments to D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:52 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8632: nixguix: Refactor by renaming success or failure the different datasets.
Oct 5 2022, 4:51 PM · Data Model, Nixguix loader
ardumont closed D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:51 PM
ardumont committed rDLS2e6e282d4464: nixguix: Deal with manifest entries without an integrity field (authored by ardumont).
nixguix: Deal with manifest entries without an integrity field
Oct 5 2022, 4:51 PM
ardumont added inline comments to D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:37 PM
ardumont closed D8630: {Cnt|Dir}Loader: Fix standard/nar hash mismatch behavior to fail loading.
Oct 5 2022, 4:35 PM
ardumont committed rDLDBASE8aa6dab72ad4: {Cnt|Dir}Loader: Fix standard/nar hash mismatch behavior to fail loading (authored by ardumont).
{Cnt|Dir}Loader: Fix standard/nar hash mismatch behavior to fail loading
Oct 5 2022, 4:35 PM
ardumont closed D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 4:35 PM
ardumont committed rDLDBASE4d51ad991d31: DirectoryLoader: Check nar hashes when provided (authored by ardumont).
DirectoryLoader: Check nar hashes when provided
Oct 5 2022, 4:35 PM
ardumont added inline comments to D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:23 PM
ardumont updated the test plan for D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:19 PM
ardumont created P1485 Prior run.
Oct 5 2022, 4:18 PM
ardumont added a comment to D8631: nixguix: Deal with manifest entries without an integrity field.

isn't this missing a new assertion in tests?

Oct 5 2022, 4:16 PM
ardumont updated the diff for D8631: nixguix: Deal with manifest entries without an integrity field.

Drop wrong assertion

Oct 5 2022, 4:12 PM
ardumont requested review of D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:06 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8631: nixguix: Deal with manifest entries without an integrity field.
Oct 5 2022, 4:01 PM · Data Model, Nixguix loader
ardumont created P1484 integrity missing, fallback to outputHash.
Oct 5 2022, 3:35 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 3:06 PM · Data Model, Nixguix loader
ardumont created P1483 DirectoryLoader run.
Oct 5 2022, 3:05 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 3:00 PM · Data Model, Nixguix loader
ardumont created P1482 ContentLoader run.
Oct 5 2022, 3:00 PM
ardumont requested review of D8630: {Cnt|Dir}Loader: Fix standard/nar hash mismatch behavior to fail loading.
Oct 5 2022, 2:53 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 2:53 PM · Data Model, Nixguix loader
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8630: {Cnt|Dir}Loader: Fix standard/nar hash mismatch behavior to fail loading.
Oct 5 2022, 2:48 PM · Data Model, Nixguix loader
ardumont added a comment to T4478: Deploy Gogs lister to staging.

Thanks to @anlambert, a possible gogs public instance [1] to check again.

Oct 5 2022, 2:26 PM · Gogs lister, Origin-Gitea/Gogs, System administration
ardumont accepted D8628: base-buster/Dockerfile: Use https scheme in all extra apt repositories.
Oct 5 2022, 1:33 PM
ardumont updated the diff for D8618: DirectoryLoader: Check nar hashes when provided.

Adapt according to review and add missing coverage

Oct 5 2022, 1:04 PM
ardumont retitled D8618: DirectoryLoader: Check nar hashes when provided from {Cnt|Dir}Loader: Check nar hashes when nix-store is available to DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 12:57 PM
ardumont added inline comments to D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 12:50 PM
ardumont added inline comments to D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 12:19 PM
ardumont closed D8626: nixguix: Improve is_tarball detection pattern.
Oct 5 2022, 12:12 PM
ardumont committed rDLSf2377c283ac5: nixguix: Improve is_tarball detection pattern (authored by ardumont).
nixguix: Improve is_tarball detection pattern
Oct 5 2022, 12:12 PM
ardumont added inline comments to D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 12:06 PM
ardumont updated subscribers of D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 12:06 PM
ardumont updated the summary of D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 12:04 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 12:04 PM · Data Model, Nixguix loader
ardumont updated the diff for D8626: nixguix: Improve is_tarball detection pattern.

really amend commit message ¯\_(ツ)_/¯

Oct 5 2022, 12:04 PM
ardumont updated the diff for D8626: nixguix: Improve is_tarball detection pattern.

Amend commit

Oct 5 2022, 12:02 PM
ardumont retitled D8626: nixguix: Improve is_tarball detection pattern from nixguix: Refactor is_tarball to simplify to nixguix: Improve is_tarball detection pattern.
Oct 5 2022, 12:02 PM
ardumont requested review of D8626: nixguix: Improve is_tarball detection pattern.
Oct 5 2022, 11:58 AM
ardumont accepted D8627: base-buster/Dockerfile: Install nix binaries in buster image.

Great, thx!

Oct 5 2022, 11:58 AM
ardumont updated the summary of D8627: base-buster/Dockerfile: Install nix binaries in buster image.
Oct 5 2022, 11:57 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8627: base-buster/Dockerfile: Install nix binaries in buster image.
Oct 5 2022, 11:57 AM · Data Model, Nixguix loader
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8626: nixguix: Improve is_tarball detection pattern.
Oct 5 2022, 11:53 AM · Data Model, Nixguix loader
ardumont accepted D8625: docker: Install nix binaries in swh/stack image.

Do you think we can do the same in the jenkins dockerfile?

Oct 5 2022, 11:30 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8625: docker: Install nix binaries in swh/stack image.
Oct 5 2022, 11:30 AM · Data Model, Nixguix loader
ardumont added a revision to T4538: Consider archiving NAR hashes: D8625: docker: Install nix binaries in swh/stack image.
Oct 5 2022, 11:30 AM · SVN Loader, Tarball loader, Nixguix loader
ardumont updated the summary of D8625: docker: Install nix binaries in swh/stack image.
Oct 5 2022, 11:30 AM
ardumont closed D8624: nixguix: Improve further tarball detection.
Oct 5 2022, 11:26 AM
ardumont committed rDLS2ee103e2bcbb: nixguix: Improve further tarball detection (authored by ardumont).
nixguix: Improve further tarball detection
Oct 5 2022, 11:26 AM
ardumont closed D8623: core.tarball: Add missing mimetype to the list.
Oct 5 2022, 11:25 AM
ardumont committed rDCOREbe9403c67696: core.tarball: Add missing mimetype to the list (authored by ardumont).
core.tarball: Add missing mimetype to the list
Oct 5 2022, 11:25 AM
ardumont abandoned D8621: wip: Add nixguix lister and loader.
Oct 5 2022, 11:25 AM
ardumont added a comment to D8621: wip: Add nixguix lister and loader.

Superseded by D8622

Oct 5 2022, 11:25 AM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 11:25 AM · Data Model, Nixguix loader
ardumont requested review of D8624: nixguix: Improve further tarball detection.
Oct 5 2022, 11:17 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8624: nixguix: Improve further tarball detection.
Oct 5 2022, 11:12 AM · Data Model, Nixguix loader