Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 12 2021

dachary updated the diff for D6424: Perfect hashmap C implementation.

working implementation, with tests

Oct 12 2021, 2:49 PM

Oct 11 2021

dachary updated the diff for D6424: Perfect hashmap C implementation.

compiles but crashes

Oct 11 2021, 10:33 PM
dachary added a comment to D6424: Perfect hashmap C implementation.

skeleton

Oct 11 2021, 4:17 PM
dachary updated the diff for D6424: Perfect hashmap C implementation.

skeleton

Oct 11 2021, 4:10 PM
dachary added a comment to D6424: Perfect hashmap C implementation.

@dachary It'd be nice if you could describe what this is about in the commit message and
the diff description (if you actually provide a commit description, then when you create
the diff, the commit message is used as a description bootstrap). I know it's more work
for you but it happens that:

  1. it helps the reviewers to have some context directly here (without having to follow

between a multitude of tasks. FYI, I've followed through the task but it's not enough,
i need to also dig in that arborescence of tasks).

  1. is also how we are doing that in every other modules ;)
  1. the curious could learn a thing or 2 even if they don't do a proper review.

Please and thanks in advance.

Cheers,

Oct 11 2021, 8:41 AM

Oct 8 2021

dachary added a comment to D6424: Perfect hashmap C implementation.

I'm curious to know where the libcmph-dev dependency was added?

Oct 8 2021, 2:24 PM

Oct 6 2021

dachary requested review of D6424: Perfect hashmap C implementation.
Oct 6 2021, 7:13 PM
dachary added a comment to T3634: Create swh-perfecthash module.

@olasd these are the failed dependencies you told me to expect, right? The missing package is ... libcmph-dev.

Oct 6 2021, 4:30 PM · Object storage
dachary added a revision to T3634: Create swh-perfecthash module: D6424: Perfect hashmap C implementation.
Oct 6 2021, 4:25 PM · Object storage
dachary added a comment to T3104: Persistent readonly perfect hash table.

I'd like to create a new package ( swh-objstorage-hash) and https://docs.softwareheritage.org/devel/tutorials/add-new-package.html is presumably the guide to do that. I however do not have the required permissions: would someone be so kind as to work with me on this?

Oct 6 2021, 3:32 PM · Object storage (RedHat collaboration)
dachary updated the diff for D6417: setup: fix 404 url to diffusion.

make it more readable as suggested

Oct 6 2021, 2:54 PM
dachary added a comment to D6417: setup: fix 404 url to diffusion.

I agree

Oct 6 2021, 2:51 PM
dachary added a task to D6417: setup: fix 404 url to diffusion: T3522: Add winery backend: learning the codebase.
Oct 6 2021, 12:12 PM
dachary added a revision to T3522: Add winery backend: learning the codebase: D6417: setup: fix 404 url to diffusion.
Oct 6 2021, 12:12 PM · Object storage
dachary added a comment to T3522: Add winery backend: learning the codebase.

Trvial bugfix https://forge.softwareheritage.org/D6417

Oct 6 2021, 12:10 PM · Object storage
dachary requested review of D6417: setup: fix 404 url to diffusion.
Oct 6 2021, 12:09 PM

Oct 4 2021

dachary added a comment to T3104: Persistent readonly perfect hash table.

it make sense to create a dedicated swh-perfecthash package.

Oct 4 2021, 3:06 PM · Object storage (RedHat collaboration)
dachary added a comment to T3104: Persistent readonly perfect hash table.

That I did not know, so indeed, if we need a specific wrapper for our needs, ...

Oct 4 2021, 3:04 PM · Object storage (RedHat collaboration)
dachary added a comment to T3104: Persistent readonly perfect hash table.
In addition to being unmaintained,

this could be addressed by asking authors to be in charge of the package

Oct 4 2021, 2:55 PM · Object storage (RedHat collaboration)
dachary added a comment to T3104: Persistent readonly perfect hash table.

SWH I guess: I don't see the difference whether it's embedded in swh-objstorage, winery or a dedicated package.

Oct 4 2021, 10:36 AM · Object storage (RedHat collaboration)
dachary abandoned D6398: test docker availability for integration tests.

That was just a test, trash it.

Oct 4 2021, 7:43 AM
dachary added a comment to D6398: test docker availability for integration tests.
07:38:12  py3 run-test: commands[0] | docker run debian:bullseye date
07:38:12  Unable to find image 'debian:bullseye' locally
07:38:12  bullseye: Pulling from library/debian
07:38:12  df5590a8898b: Already exists
07:38:12  Digest: sha256:86dddd82dddf445aea3d2ea26af46cebd727bf2f47ed810fa1450a0d79722d55
07:38:12  Status: Downloaded newer image for debian:bullseye
Oct 4 2021, 7:39 AM
dachary updated the diff for D6398: test docker availability for integration tests.

tox is called with explicit -e, adding a new environment is a noop unless the matching jenkins job is updated

Oct 4 2021, 7:36 AM
dachary requested review of D6398: test docker availability for integration tests.
Oct 4 2021, 7:31 AM
dachary added a revision to T3432: Add winery backend: D6398: test docker availability for integration tests.
Oct 4 2021, 7:30 AM · Object storage
dachary added a revision to T3104: Persistent readonly perfect hash table: D6397: add cmph dependency.
Oct 4 2021, 6:39 AM · Object storage (RedHat collaboration)

Oct 1 2021

dachary added a comment to T3104: Persistent readonly perfect hash table.

SWH I guess: I don't see the difference whether it's embedded in swh-objstorage, winery or a dedicated package.

Oct 1 2021, 5:47 PM · Object storage (RedHat collaboration)

Sep 29 2021

dachary added a comment to T3104: Persistent readonly perfect hash table.

Wouldn't it make sense to put the cffi-based cmph wrapper in a dedicated python module/project (not necessarily under the swh namespace)?

Sep 29 2021, 6:09 PM · Object storage (RedHat collaboration)

Sep 28 2021

dachary updated subscribers of T3104: Persistent readonly perfect hash table.
Sep 28 2021, 5:43 PM · Object storage (RedHat collaboration)
dachary updated subscribers of T3104: Persistent readonly perfect hash table.

@olasd @douardda @thomash05 : the following passes tox -e py3 therefore it is not complete nonsense. However it raises two questions:

Sep 28 2021, 5:34 PM · Object storage (RedHat collaboration)

Aug 30 2021

dachary updated the task description for T3054: Scale out object storage design.
Aug 30 2021, 12:53 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task

Aug 29 2021

dachary added a subtask for T3432: Add winery backend: T3533: Winery backend: basic implementation.
Aug 29 2021, 2:43 PM · Object storage
dachary added a parent task for T3533: Winery backend: basic implementation: T3432: Add winery backend.
Aug 29 2021, 2:43 PM · Object storage (RedHat collaboration)
dachary triaged T3533: Winery backend: basic implementation as Normal priority.
Aug 29 2021, 2:41 PM · Object storage (RedHat collaboration)
dachary removed a subtask for T3432: Add winery backend: T3530: IO throttling: implementation.
Aug 29 2021, 2:37 PM · Object storage
dachary edited parent tasks for T3530: IO throttling: implementation, added: T3532: IO throttling; removed: T3432: Add winery backend.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3532: IO throttling: T3530: IO throttling: implementation.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3531: IO throttling: benchmark: T3532: IO throttling.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3532: IO throttling: T3531: IO throttling: benchmark.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3532: IO throttling: T3432: Add winery backend.
Aug 29 2021, 2:36 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3532: IO throttling.
Aug 29 2021, 2:36 PM · Object storage
dachary triaged T3532: IO throttling as Normal priority.
Aug 29 2021, 2:36 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3530: IO throttling: implementation.
Aug 29 2021, 2:36 PM · Object storage (RedHat collaboration)
dachary triaged T3531: IO throttling: benchmark as Normal priority.
Aug 29 2021, 2:34 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3530: IO throttling: implementation.
Aug 29 2021, 2:31 PM · Object storage
dachary added a parent task for T3530: IO throttling: implementation: T3432: Add winery backend.
Aug 29 2021, 2:31 PM · Object storage (RedHat collaboration)
dachary triaged T3530: IO throttling: implementation as Normal priority.
Aug 29 2021, 2:30 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3529: Publish object storage benchmark results.
Aug 29 2021, 2:25 PM · Object storage
dachary added a parent task for T3529: Publish object storage benchmark results: T3432: Add winery backend.
Aug 29 2021, 2:25 PM · Object storage
dachary triaged T3529: Publish object storage benchmark results as Normal priority.
Aug 29 2021, 2:24 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3528: Add winery backend: grid5000 benchmark.
Aug 29 2021, 2:21 PM · Object storage
dachary added a parent task for T3528: Add winery backend: grid5000 benchmark: T3432: Add winery backend.
Aug 29 2021, 2:21 PM · Object storage
dachary triaged T3528: Add winery backend: grid5000 benchmark as Normal priority.
Aug 29 2021, 2:20 PM · Object storage
dachary added a parent task for T3527: Self-host Software Heritage on grid5000: T3432: Add winery backend.
Aug 29 2021, 2:15 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3527: Self-host Software Heritage on grid5000.
Aug 29 2021, 2:15 PM · Object storage
dachary triaged T3527: Self-host Software Heritage on grid5000 as Normal priority.
Aug 29 2021, 2:15 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3526: Add winery backend: learning the CI.
Aug 29 2021, 2:12 PM · Object storage
dachary added a parent task for T3526: Add winery backend: learning the CI: T3432: Add winery backend.
Aug 29 2021, 2:12 PM · Object storage
dachary triaged T3526: Add winery backend: learning the CI as Normal priority.
Aug 29 2021, 2:11 PM · Object storage
dachary renamed T3525: grid5000 tools and documentation from grid5000 tools to grid5000 tools and documentation.
Aug 29 2021, 2:05 PM · Object storage
dachary added a parent task for T3525: grid5000 tools and documentation: T3432: Add winery backend.
Aug 29 2021, 2:05 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3525: grid5000 tools and documentation.
Aug 29 2021, 2:05 PM · Object storage
dachary triaged T3525: grid5000 tools and documentation as Normal priority.
Aug 29 2021, 2:04 PM · Object storage
dachary updated the task description for T3524: Add winery backend: create the Ceph cluster.
Aug 29 2021, 1:59 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3524: Add winery backend: create the Ceph cluster.
Aug 29 2021, 1:58 PM · Object storage
dachary added a parent task for T3524: Add winery backend: create the Ceph cluster: T3432: Add winery backend.
Aug 29 2021, 1:58 PM · Object storage (RedHat collaboration)
dachary added a project to T3523: Add winery backend: create the PostgreSQL cluster: Object storage.
Aug 29 2021, 1:57 PM · Object storage
dachary triaged T3524: Add winery backend: create the Ceph cluster as Normal priority.
Aug 29 2021, 1:57 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3523: Add winery backend: create the PostgreSQL cluster.
Aug 29 2021, 1:56 PM · Object storage
dachary added a parent task for T3523: Add winery backend: create the PostgreSQL cluster: T3432: Add winery backend.
Aug 29 2021, 1:56 PM · Object storage
dachary triaged T3523: Add winery backend: create the PostgreSQL cluster as Normal priority.
Aug 29 2021, 1:56 PM · Object storage
dachary updated the task description for T3521: Persistent readonly perfect hash table: benchmarks.
Aug 29 2021, 1:44 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:42 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3519: Persistent readonly perfect hash table: CI and package.
Aug 29 2021, 1:41 PM · Object storage
dachary updated the task description for T3522: Add winery backend: learning the codebase.
Aug 29 2021, 1:39 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3522: Add winery backend: learning the codebase.
Aug 29 2021, 1:36 PM · Object storage
dachary added a parent task for T3522: Add winery backend: learning the codebase: T3432: Add winery backend.
Aug 29 2021, 1:36 PM · Object storage
dachary triaged T3522: Add winery backend: learning the codebase as Normal priority.
Aug 29 2021, 1:35 PM · Object storage
dachary added a parent task for T3521: Persistent readonly perfect hash table: benchmarks: T3104: Persistent readonly perfect hash table.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3104: Persistent readonly perfect hash table: T3521: Persistent readonly perfect hash table: benchmarks.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3521: Persistent readonly perfect hash table: benchmarks.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary triaged T3521: Persistent readonly perfect hash table: benchmarks as Normal priority.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3520: Persistent readonly perfect hash table: implementation: T3104: Persistent readonly perfect hash table.
Aug 29 2021, 1:22 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3104: Persistent readonly perfect hash table: T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:22 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:21 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:20 PM · Object storage (RedHat collaboration)
dachary triaged T3520: Persistent readonly perfect hash table: implementation as Normal priority.
Aug 29 2021, 1:20 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3104: Persistent readonly perfect hash table: T3519: Persistent readonly perfect hash table: CI and package.
Aug 29 2021, 1:14 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3519: Persistent readonly perfect hash table: CI and package: T3104: Persistent readonly perfect hash table.
Aug 29 2021, 1:14 PM · Object storage
dachary triaged T3519: Persistent readonly perfect hash table: CI and package as Normal priority.
Aug 29 2021, 1:14 PM · Object storage
dachary changed the status of T3104: Persistent readonly perfect hash table, a subtask of T3432: Add winery backend, from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage
dachary changed the status of T3104: Persistent readonly perfect hash table from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage (RedHat collaboration)
dachary changed the status of T3104: Persistent readonly perfect hash table, a subtask of T3054: Scale out object storage design, from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary changed the status of T3432: Add winery backend from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage
dachary changed the status of T3249: Deleting and erasing an object, a subtask of T3054: Scale out object storage design, from Work in Progress to Open.
Aug 29 2021, 1:05 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary changed the status of T3249: Deleting and erasing an object from Work in Progress to Open.
Aug 29 2021, 1:05 PM · Object storage (RedHat collaboration)

Aug 23 2021

dachary closed T3422: Running the benchmarks: August 6th, 2021, 9 days, a subtask of T3054: Scale out object storage design, as Resolved.
Aug 23 2021, 12:26 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary closed T3422: Running the benchmarks: August 6th, 2021, 9 days as Resolved.
Aug 23 2021, 12:26 PM · Object storage
dachary updated the task description for T3422: Running the benchmarks: August 6th, 2021, 9 days.
Aug 23 2021, 12:25 PM · Object storage

Aug 12 2021

dachary added a comment to T3422: Running the benchmarks: August 6th, 2021, 9 days.

Throttling writes to 120MBs to reduce the pressure:

Aug 12 2021, 1:26 PM · Object storage