Page MenuHomeSoftware Heritage

WIP: archive + meta directory sharding
AbandonedPublic

Authored by haltode on Oct 28 2020, 1:42 PM.

Details

Reviewers
None
Group Reviewers
Reviewers
Maniphest Tasks
T2694: FUSE: add sharding support for top-level dirs
Summary

Tested by hand.

Closes T2694.

TODO:

  • Update unit tests to use default sharding parameters
  • Update documentation/docstring
  • Code refactoring(?)/cleaning

Diff Detail

Repository
rDFUSE FUSE virtual file system
Branch
feature/archive-meta-sharding
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 16698
Build 25748: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 25747: arc lint + arc unit

Event Timeline

Build is green

Patch application report for D4371 (id=15472)

Rebasing onto f9de49aca7...

Current branch diff-target is up to date.
Changes applied before test
commit d04da6529e4990e08ef830459fa542fe69756d5b
Author: Thibault Allançon <haltode@gmail.com>
Date:   Wed Oct 28 13:30:25 2020 +0100

    WIP: sharding

See https://jenkins.softwareheritage.org/job/DFUSE/job/tests-on-diff/130/ for more details.

Build is green

Patch application report for D4371 (id=15473)

Rebasing onto f9de49aca7...

Current branch diff-target is up to date.
Changes applied before test
commit 2c8729dff1266c161af3d5e1c1cf4a730afc5927
Author: Thibault Allançon <haltode@gmail.com>
Date:   Wed Oct 28 13:30:25 2020 +0100

    WIP: sharding
    
    Closes T2694.

See https://jenkins.softwareheritage.org/job/DFUSE/job/tests-on-diff/131/ for more details.

Moved on to only sharding history/ directory instead of archive/ and meta/ (see D4416).