Page MenuHomeSoftware Heritage
Create Task
Maniphest T2519

Rewrite the in-mem storage as a backend for the cassandra storage
Closed, MigratedEdits Locked
Actions

Description

There is a lot of duplicated logic between the two; and we can rewrite just the data access bits and share the logic between the two.

(work initially started at D3194 a few months ago, but I rewrote it as a bunch of smaller diffs, attached to this task)

Revisions and Commits

rDSTO Storage manager
D3781rDSTO291704d4edb0 in_memory: Remove InMemoryStorage.*metadata_* and implement InMemoryCqlRunner.
D3780rDSTOda35e56f64a0 in_memory: Remove InMemoryStorage.origin_visit_* and implement…
D3777rDSTOe1eb6cd18180 in_memory: Remove InMemoryStorage.origin_* and implement InMemoryCqlRunner.
D3776rDSTOf78c76f5b796 in_memory: Remove InMemoryStorage.snapshot_* and implement InMemoryCqlRunner.
D3775rDSTO66511303a8b1 Remove endpoint snapshot_get_by_origin_visit.
D3774rDSTO1104c53acaa6 in_memory: Remove InMemoryStorage.release_* and implement InMemoryCqlRunner.
D3773rDSTO237c400653c7 in_memory: Remove InMemoryStorage.revision_* and implement InMemoryCqlRunner.
D3771rDSTOd5f41f8b9652 in_memory: Remove InMemoryStorage.skipped_content_* and implement…
D3772rDSTO8e7eed4461d0 in_memory: Remove InMemoryStorage.directory_* and implement InMemoryCqlRunner.
D3770rDSTOb3af39a97bd5 in_memory: Remove InMemoryStorage.content_* and implement InMemoryCqlRunner.
D3769rDSTO397a645ebf1e in_memory: make object_find_by_sha1_git merge results from the CassandraStorage.
D3768rDSTOa96c253ab428 in_memory: Add InMemoryCqlRunner, a class that emulates cassandra.cql.CqlRunner…
D3767rDSTObc47283ddc8c Make InMemoryStorage inherit from CassandraStorage.
D3766rDSTO20971864bb16 in_memory: Add class Table, which emulates a Cassandra table.

Related Objects

Event Timeline

vlorentz triaged this task as Normal priority.Aug 12 2020, 6:06 PM
vlorentz created this task.
vlorentz added a project: Storage manager.
vlorentz added revisions: D3766: in_memory: Add class Table, which emulates a Cassandra table., D3767: Make InMemoryStorage inherit from CassandraStorage., D3768: in_memory: Add InMemoryCqlRunner, a class that emulates cassandra.cql.CqlRunner without Cassandra., D3769: in_memory: make object_find_by_sha1_git merge results from the CassandraStorage., D3770: in_memory: Remove InMemoryStorage.content_* and implement InMemoryCqlRunner.content_*, D3771: in_memory: Remove InMemoryStorage.skipped_content_* and implement InMemoryCqlRunner.skipped_content_*, D3772: in_memory: Remove InMemoryStorage.directory_* and implement InMemoryCqlRunner.directory_*, D3773: in_memory: Remove InMemoryStorage.revision_* and implement InMemoryCqlRunner.revision_*, D3774: in_memory: Remove InMemoryStorage.release_* and implement InMemoryCqlRunner.release_*, D3775: Remove endpoint snapshot_get_by_origin_visit., D3776: in_memory: Remove InMemoryStorage.snapshot_* and implement InMemoryCqlRunner.snapshot_*, D3777: in_memory: Remove InMemoryStorage.origin_* and implement InMemoryCqlRunner.origin_*, D3780: in_memory: Remove InMemoryStorage.origin_visit_* and implement InMemoryCqlRunner.origin_visit_*, D3781: in_memory: Remove InMemoryStorage.*metadata_* and implement InMemoryCqlRunner.*metadata_*.
vlorentz claimed this task.Aug 12 2020, 10:41 PM
vlorentz mentioned this in D3194: [WIP] Start rewriting the in-mem storage as a backend for cassandra..
vlorentz added a commit: rDSTO20971864bb16: in_memory: Add class Table, which emulates a Cassandra table..Aug 14 2020, 6:07 PM
vlorentz added a commit: rDSTObc47283ddc8c: Make InMemoryStorage inherit from CassandraStorage..
vlorentz added a commit: rDSTOa96c253ab428: in_memory: Add InMemoryCqlRunner, a class that emulates cassandra.cql.CqlRunner….
vlorentz added a commit: rDSTO397a645ebf1e: in_memory: make object_find_by_sha1_git merge results from the CassandraStorage..
vlorentz added a commit: rDSTOb3af39a97bd5: in_memory: Remove InMemoryStorage.content_* and implement InMemoryCqlRunner..
vlorentz added a commit: rDSTOd5f41f8b9652: in_memory: Remove InMemoryStorage.skipped_content_* and implement….
vlorentz added a commit: rDSTO8e7eed4461d0: in_memory: Remove InMemoryStorage.directory_* and implement InMemoryCqlRunner..
vlorentz added a commit: rDSTO237c400653c7: in_memory: Remove InMemoryStorage.revision_* and implement InMemoryCqlRunner..
vlorentz added a commit: rDSTO1104c53acaa6: in_memory: Remove InMemoryStorage.release_* and implement InMemoryCqlRunner..
vlorentz added a commit: rDSTO66511303a8b1: Remove endpoint snapshot_get_by_origin_visit..
vlorentz added a commit: rDSTOf78c76f5b796: in_memory: Remove InMemoryStorage.snapshot_* and implement InMemoryCqlRunner..
vlorentz added a commit: rDSTOe1eb6cd18180: in_memory: Remove InMemoryStorage.origin_* and implement InMemoryCqlRunner..
vlorentz added a commit: rDSTOda35e56f64a0: in_memory: Remove InMemoryStorage.origin_visit_* and implement….
vlorentz added a commit: rDSTO291704d4edb0: in_memory: Remove InMemoryStorage.*metadata_* and implement InMemoryCqlRunner..
vlorentz closed this task as Resolved.Aug 14 2020, 9:00 PM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:31 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal