Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 5 2022

ardumont requested review of D8623: core.tarball: Add missing mimetype to the list.
Oct 5 2022, 11:11 AM
ardumont closed D8620: nixguix: Improve git origins detection.
Oct 5 2022, 11:11 AM
ardumont committed rDLSff80a91f0af8: nixguix: Improve git origins detection (authored by ardumont).
nixguix: Improve git origins detection
Oct 5 2022, 11:11 AM
ardumont closed D8619: nixguix: Improve tarball detection.
Oct 5 2022, 11:11 AM
ardumont committed rDLS2fbd66778f32: nixguix: Improve tarball detection (authored by ardumont).
nixguix: Improve tarball detection
Oct 5 2022, 11:11 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8623: core.tarball: Add missing mimetype to the list.
Oct 5 2022, 11:09 AM · Data Model, Nixguix loader
ardumont created P1479 (An Untitled Masterwork).
Oct 5 2022, 11:07 AM
ardumont accepted D8622: docker/conf: Declare task queues for new nixguix lister and loaders.

ack, i'll drop D8621 then.

Oct 5 2022, 11:01 AM
ardumont added inline comments to D8619: nixguix: Improve tarball detection.
Oct 5 2022, 10:56 AM
ardumont added inline comments to D8618: DirectoryLoader: Check nar hashes when provided.
Oct 5 2022, 10:54 AM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 10:34 AM · Data Model, Nixguix loader
ardumont requested review of D8621: wip: Add nixguix lister and loader.
Oct 5 2022, 10:34 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8621: wip: Add nixguix lister and loader.
Oct 5 2022, 10:34 AM · Data Model, Nixguix loader
ardumont accepted D8617: thanos: Declare archive-production thanos for live data querying.
Oct 5 2022, 10:31 AM
ardumont added a comment to D8619: nixguix: Improve tarball detection.

create a new exception class instead of IndexError, it's unclear that the rest of the function is not actually meant to raise that exception.

I can tell you it's not supposed to raise outside of this function.
Otherwise, i would have documented it in the main docstring of the function.

Oct 5 2022, 10:22 AM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 10:11 AM · Data Model, Nixguix loader
ardumont updated the diff for D8620: nixguix: Improve git origins detection.

Rebase

Oct 5 2022, 10:11 AM
ardumont updated the diff for D8619: nixguix: Improve tarball detection.

Adapt according to suggestion

Oct 5 2022, 10:10 AM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 5 2022, 10:06 AM · Data Model, Nixguix loader

Oct 4 2022

ardumont requested review of D8620: nixguix: Improve git origins detection.
Oct 4 2022, 11:37 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8620: nixguix: Improve git origins detection.
Oct 4 2022, 11:32 PM · Data Model, Nixguix loader
ardumont added a comment to D8619: nixguix: Improve tarball detection.

create a new exception class instead of IndexError, it's unclear that the rest of the function is not actually meant to raise that exception.

Oct 4 2022, 11:29 PM
ardumont requested review of D8619: nixguix: Improve tarball detection.
Oct 4 2022, 9:06 PM
ardumont added a comment to P1476 patch hash mismatch again.

So we must do something about the fetcher which does crazy things.
Either filter out those patch or simply integrate those without checking them... (i don't like much the latter).

Oct 4 2022, 8:52 PM
ardumont added a comment to P1476 patch hash mismatch again.

cat /var/tmp/sources-unstable-full.json | jq . | grep -C5 https://github.com/hunspell/hunspell/commit/ac938e2ecb48ab4dd21298126c7921689d60571b.patch

  "outputHash": "0bwfksz87iy7ikx3fb54zd5ww169qfm9kl076hsch3cs8p30s8az",
  "outputHashAlgo": "sha256",
  "outputHashMode": "flat",
  "type": "url",
  "urls": [
    "https://github.com/hunspell/hunspell/commit/ac938e2ecb48ab4dd21298126c7921689d60571b.patch"
  ],
  "integrity": "sha256-XyENxkWaDcg0NAfQmarDyQTOS/ukLDf6jMfHg76eji8=",
  "inferredFetcher": "fetchpatch"
},
{
Oct 4 2022, 8:48 PM
ardumont created P1476 patch hash mismatch again.
Oct 4 2022, 8:47 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8619: nixguix: Improve tarball detection.
Oct 4 2022, 8:44 PM · Data Model, Nixguix loader
ardumont created P1475 nixguix: misdetected tarballs as files....
Oct 4 2022, 8:44 PM
ardumont updated the title for P1474 computers says no from computes says no to computers says no.
Oct 4 2022, 7:50 PM
ardumont created P1474 computers says no.
Oct 4 2022, 7:47 PM
ardumont requested review of D8618: DirectoryLoader: Check nar hashes when provided.
Oct 4 2022, 7:37 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8618: DirectoryLoader: Check nar hashes when provided.
Oct 4 2022, 7:33 PM · Data Model, Nixguix loader
ardumont closed D8614: nixguix: Add support for listing origins with "recursive" integrity.
Oct 4 2022, 6:51 PM
ardumont committed rDLS944d4b5b60d0: nixguix: Add support for listing origins with "recursive" integrity (authored by ardumont).
nixguix: Add support for listing origins with "recursive" integrity
Oct 4 2022, 6:51 PM
ardumont added a comment to P1469 content loader checksum mismatched.

As this one is a "flat" output hash mode, it's actually a real mismatch computation.
This renders nothing to try and use nix-store --dump as [1] does.

Oct 4 2022, 6:16 PM
ardumont updated the diff for D8614: nixguix: Add support for listing origins with "recursive" integrity.

Improve intent implementation

Oct 4 2022, 5:59 PM
ardumont added a comment to D8614: nixguix: Add support for listing origins with "recursive" integrity.

by "not actionable", I means that being False tells the loaders the checksum cannot be
checked by hashing the tarball, but does not tell them how to check them.

Oct 4 2022, 5:48 PM
ardumont added a comment to D8614: nixguix: Add support for listing origins with "recursive" integrity.

is_integrity_about_artifact=False (which should be called are_checksums_about_artifact btw)

Oct 4 2022, 5:10 PM
ardumont added inline comments to D8614: nixguix: Add support for listing origins with "recursive" integrity.
Oct 4 2022, 5:06 PM
ardumont added inline comments to D8614: nixguix: Add support for listing origins with "recursive" integrity.
Oct 4 2022, 5:04 PM
ardumont requested review of D8614: nixguix: Add support for listing origins with "recursive" integrity.
Oct 4 2022, 4:56 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 4 2022, 4:53 PM · Data Model, Nixguix loader
ardumont added a revision to T3294: nixguix: Add support for pseudo-URLs with a missing schema: D8614: nixguix: Add support for listing origins with "recursive" integrity.
Oct 4 2022, 4:50 PM · Easy hack, Nixguix loader
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8614: nixguix: Add support for listing origins with "recursive" integrity.
Oct 4 2022, 4:50 PM · Data Model, Nixguix loader
ardumont closed D8612: nixguix: Add support for pseudo url with missing schema.
Oct 4 2022, 4:50 PM
ardumont committed rDLS5daead68adcb: nixguix: Add support for pseudo url with missing schema (authored by ardumont).
nixguix: Add support for pseudo url with missing schema
Oct 4 2022, 4:50 PM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Another data point about ^. It's not important for the guix manifest [1]. We can keep a
compatible behavior for it and slightly improve the listing behavior for nixpkgs as it's
important for those [2].

Oct 4 2022, 4:33 PM · Data Model, Nixguix loader
ardumont updated the diff for D8612: nixguix: Add support for pseudo url with missing schema.

Adapt according to suggestion

Oct 4 2022, 4:21 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 4 2022, 4:17 PM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

With the gazillion of new diffs on top of the origin lister code, we can now also list
the nixpkgs-unstable-full.json manifests [1]

Oct 4 2022, 4:17 PM · Data Model, Nixguix loader
ardumont accepted D8613: test: Deduplicate tests implementation for loader tasks creation.
Oct 4 2022, 4:14 PM
ardumont requested review of D8612: nixguix: Add support for pseudo url with missing schema.
Oct 4 2022, 4:07 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 4 2022, 4:05 PM · Data Model, Nixguix loader
ardumont closed D8611: nixguix: Deal with connection error with server.
Oct 4 2022, 4:02 PM
ardumont committed rDLS0f8f293f968e: nixguix: Deal with connection error with server (authored by ardumont).
nixguix: Deal with connection error with server
Oct 4 2022, 4:02 PM
ardumont added a revision to T3294: nixguix: Add support for pseudo-URLs with a missing schema: D8612: nixguix: Add support for pseudo url with missing schema.
Oct 4 2022, 4:01 PM · Easy hack, Nixguix loader
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8612: nixguix: Add support for pseudo url with missing schema.
Oct 4 2022, 4:01 PM · Data Model, Nixguix loader
ardumont requested review of D8611: nixguix: Deal with connection error with server.
Oct 4 2022, 3:02 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8611: nixguix: Deal with connection error with server.
Oct 4 2022, 2:57 PM · Data Model, Nixguix loader
ardumont closed D8610: nixguix: Refactor by cleaning up unneeded code.
Oct 4 2022, 2:49 PM
ardumont committed rDLSd92474bbda68: nixguix: Refactor by cleaning up unneeded code (authored by ardumont).
nixguix: Refactor by cleaning up unneeded code
Oct 4 2022, 2:49 PM
ardumont updated the diff for D8610: nixguix: Refactor by cleaning up unneeded code.

Drop no forgotten commit that could have been dropped early on.

Oct 4 2022, 2:49 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8610: nixguix: Refactor by cleaning up unneeded code.
Oct 4 2022, 2:40 PM · Data Model, Nixguix loader
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 4 2022, 2:37 PM · Data Model, Nixguix loader
ardumont closed D8605: nixguix: Randomize order of listed origins.
Oct 4 2022, 2:37 PM
ardumont closed D8607: nixguix: Deal with impossible communication with server.
Oct 4 2022, 2:37 PM
ardumont closed D8606: nixguix: Deal with mistyped origins.
Oct 4 2022, 2:37 PM
ardumont committed rDLSa94b75f366be: nixguix: Deal with mistyped origins (authored by ardumont).
nixguix: Deal with mistyped origins
Oct 4 2022, 2:37 PM
ardumont committed rDLS1b4fe51f62c7: nixguix: Randomize order of listed origins (authored by ardumont).
nixguix: Randomize order of listed origins
Oct 4 2022, 2:37 PM
ardumont committed rDLS06b11dd5f672: nixguix: Deal with impossible communication with server (authored by ardumont).
nixguix: Deal with impossible communication with server
Oct 4 2022, 2:37 PM
ardumont committed rDLS94b6dbea0a7f: nixguix: Document lister (authored by ardumont).
nixguix: Document lister
Oct 4 2022, 2:37 PM
ardumont committed rDLS6d2e7aa17808: nixguix: Register task (authored by ardumont).
nixguix: Register task
Oct 4 2022, 2:37 PM
ardumont closed D8341: Add nixguix lister.
Oct 4 2022, 2:36 PM
ardumont committed rDLSfbfdf88ea4fe: nixguix: Add lister (authored by ardumont).
nixguix: Add lister
Oct 4 2022, 2:36 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 4 2022, 2:19 PM · Data Model, Nixguix loader
ardumont added a comment to P1473 nix recursive hash computation.

Related to T3781
Related to T4538

Oct 4 2022, 2:15 PM
ardumont requested review of D8607: nixguix: Deal with impossible communication with server.
Oct 4 2022, 2:14 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8607: nixguix: Deal with impossible communication with server.
Oct 4 2022, 2:08 PM · Data Model, Nixguix loader
ardumont updated the diff for D8606: nixguix: Deal with mistyped origins.

what's been said before (with the right local commit inside this time...)

Oct 4 2022, 2:01 PM
ardumont updated the diff for D8606: nixguix: Deal with mistyped origins.

Deal with ftp targetting a file without extension which will trigger a head request and
fail. This will skip it as nothing simple can be done to detect the nature of the file
then.

Oct 4 2022, 2:00 PM
ardumont updated the summary of D8606: nixguix: Deal with mistyped origins.
Oct 4 2022, 1:59 PM
ardumont updated the diff for D8606: nixguix: Deal with mistyped origins.

Adapt according to review:

  • let ftp urls through
  • format log or exception message with <%s>
Oct 4 2022, 1:46 PM
ardumont added a comment to D8606: nixguix: Deal with mistyped origins.

Should we try asking Nixpkgs devs to fix their manifest instead?

Oct 4 2022, 1:26 PM
ardumont requested review of D8606: nixguix: Deal with mistyped origins.
Oct 4 2022, 1:07 PM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8606: nixguix: Deal with mistyped origins.
Oct 4 2022, 1:02 PM · Data Model, Nixguix loader
ardumont updated the diff for D8605: nixguix: Randomize order of listed origins.

Adapt according to review.
That makes sense plus i forgot i already had that import so fine!

Oct 4 2022, 11:54 AM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Another one bites the dust [1]

Oct 4 2022, 11:51 AM · Data Model, Nixguix loader
ardumont added a comment to P1470 sources-unstable-full.json still raises issue (current expected to work with sources-unstable.json but still...).

Wrong stuff again...:

Oct 4 2022, 11:50 AM
ardumont created P1470 sources-unstable-full.json still raises issue (current expected to work with sources-unstable.json but still...).
Oct 4 2022, 11:46 AM
ardumont added a comment to D8605: nixguix: Randomize order of listed origins.

and you don't need grouper() for that

Oct 4 2022, 11:40 AM
ardumont updated the diff for D8605: nixguix: Randomize order of listed origins.

Actually randomize and do it at the manifest reading step.

Oct 4 2022, 11:39 AM
ardumont retitled D8605: nixguix: Randomize order of listed origins from nixguix: Randomize listed origins to ingest sparsely origins to nixguix: Randomize order of listed origins.
Oct 4 2022, 11:30 AM
ardumont added a comment to D8605: nixguix: Randomize order of listed origins.

I forgot the main gist of it

Oct 4 2022, 11:17 AM
ardumont added inline comments to D8605: nixguix: Randomize order of listed origins.
Oct 4 2022, 11:06 AM
ardumont requested review of D8605: nixguix: Randomize order of listed origins.
Oct 4 2022, 11:05 AM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Oct 4 2022, 11:02 AM · Data Model, Nixguix loader
ardumont closed D8601: {Content|Directory}Loader: Register tasks.
Oct 4 2022, 11:00 AM
ardumont committed rDLDBASEa5255f106453: {Content|Directory}Loader: Register tasks (authored by ardumont).
{Content|Directory}Loader: Register tasks
Oct 4 2022, 11:00 AM
ardumont added a revision to T3781: Replace the Nixguix loader with a lister: D8605: nixguix: Randomize order of listed origins.
Oct 4 2022, 10:59 AM · Data Model, Nixguix loader
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

For the content loader i have mostly checksums mismatches [1].
It seems the integrity from the manifest is either wrong (or some in-place update occurred in the respective servers [2])

Oct 4 2022, 10:36 AM · Data Model, Nixguix loader