Page MenuHomeSoftware Heritage
Create Task
Maniphest T2694

FUSE: add sharding support for top-level dirs
Closed, MigratedEdits Locked
Actions

Description

The archive/ and meta/ subdir of the swh-fuse mountpoint might grow quite big.

We should add (optional?) sharding supports for them, so that entries there can be created according to a namespace like ab/cd/swh:1:XYZ:abcd.... The depth should be configurable, and 1 (i.e., /ab/ only) could be a good default.

Revisions and Commits

rDFUSE FUSE virtual file system
AbandonedD4371 WIP: archive + meta directory sharding

Related Objects

Event Timeline

zack triaged this task as Low priority.Oct 13 2020, 10:45 AM
zack created this task.
haltode changed the task status from Open to Work in Progress.Oct 27 2020, 4:12 PM
haltode moved this task from Backlog to In progress on the Software Heritage filesystem board.
haltode added a revision: D4371: WIP: archive + meta directory sharding.Oct 29 2020, 10:05 AM
zack closed this task as Wontfix.Nov 10 2020, 12:48 PM
zack claimed this task.

We have decided to go for a more radical approach and make archive/ and meta/ not ls-able.
Separate task and update to the design document to follow.

haltode changed the task status from Wontfix to Resolved.Nov 16 2020, 2:47 PM
haltode moved this task from In progress to Done on the Software Heritage filesystem board.
zack changed the task status from Resolved to Wontfix.Nov 16 2020, 3:15 PM
zack mentioned this in T2771: FUSE: rethink the visibility of files under archive/ and meta/, and possibly add a new cache/ entrypoint.Nov 17 2020, 9:16 PM
gitlab-migration changed the task status from Wontfix to Migrated.Jan 8 2023, 4:31 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal