Paths

Table of Contentst

Extract the object storage to its own package and do the required modifications on the imports
ClosedPublic
Actions

Authored by qcampos on Jun 23 2016, 2:30 PM.

Details

Reviewers

olasd
zack
ardumont

Group Reviewers

Reviewers

Maniphest Tasks

T460: Extract the objstorage component from storage module to an independent module

Commits

rDSTOC2cf3a5a3fe2f: Extract http servers common code to swh.objstorage for dependencies
rDSTOC92e6cd845775: Update debian packaging configuration files
rDSTOC3ab3d3dd27f1: Remove objstorage scripts
rDSTOC7a0369f3ddf9: Extract the object storage to its own package and do the required modifications…
R65:3ab3d3dd27f1: Remove objstorage scripts
R65:2cf3a5a3fe2f: Extract http servers common code to swh.objstorage for dependencies
R65:92e6cd845775: Update debian packaging configuration files
R65:7a0369f3ddf9: Extract the object storage to its own package and do the required modifications…
rDARC14bb2ee8cb6a: Extract the object storage to its own package and do the required modifications…
rDSTO92e6cd845775: Update debian packaging configuration files
rDSTO3ab3d3dd27f1: Remove objstorage scripts
rDSTO2cf3a5a3fe2f: Extract http servers common code to swh.objstorage for dependencies
rDSTO7a0369f3ddf9: Extract the object storage to its own package and do the required…

Summary

Also, remove the objstorage-related module swh.storage.checker to put in into swh.objstorage.checker.

Diff Detail

Repository

rDSTO Storage manager

Branch

master

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 257
Build 382: Software Heritage Python tests
Build 381: arc lint + arc unit

Event Timeline

qcampos updated this revision to Diff 208.Jun 23 2016, 2:30 PM

qcampos retitled this revision from to Extract the object storage to its own package and do the required modifications on the imports.

qcampos updated this object.

qcampos edited the test plan for this revision. (Show Details)

qcampos added reviewers: olasd, zack.

Herald added a reviewer: Reviewers. · View Herald TranscriptJun 23 2016, 2:30 PM

The tests doesn't works (although make test in swh.storage works in local) because of :

======================================================================
ERROR: Failure: ImportError (No module named 'swh.objstorage')
----------------------------------------------------------------------

I don't know where it's from. Did I miss something into a configuration?

qcampos added a parent revision: D63: Extract objstorage from swh.storage module and recreate its commit history..Jun 23 2016, 2:34 PM

qcampos added a task: T460: Extract the objstorage component from storage module to an independent module.

I don't know where it's from. Did I miss something into a configuration?

No, i don't think you missed anything.
It must be because we need to merge D63 first.
Otherwise, this module does not exist yet.

For information, this one is blocked by D63.
D63 is currently accepted, so it needs to be merged.

Then we can retrigger the tests to check everything is green.
Then if tests ok, we can merge.

Also, to be symmetric with D63, which includes the debian packaging, the packaging needs to be updated as well.

IIRC, the impacted files are:

requirements.txt (swh.objstorage)
debian/control (python-swh.objstorage)
setup.py (needs to remove some entries about swh.storage.objstorage...)

This revision now requires changes to proceed.Jun 24 2016, 10:10 AM

Extract http servers common code to swh.objstorage for dependencies
Remove objstorage scripts
Update debian packaging configuration files

ardumont added inline comments.Jun 27 2016, 1:31 PM

debian/control
24	I think we do not need this. This is supposed to be taken care of by the setup.py script if i understood correctly @olasd the first time.

qcampos added a child revision: D67: Recreate DOBJS commit history.Jun 27 2016, 1:38 PM

zack accepted this revision.Jun 27 2016, 1:44 PM

zack edited edge metadata.

qcampos removed a child revision: D67: Recreate DOBJS commit history.Jun 27 2016, 1:44 PM

qcampos added a parent revision: D67: Recreate DOBJS commit history.Jun 27 2016, 1:46 PM

Remove an unneeded dependency into the debian/control file

Update debian packaging configuration files

ardumont accepted this revision.Jun 27 2016, 2:55 PM

ardumont edited edge metadata.

This revision is now accepted and ready to land.Jun 27 2016, 2:55 PM

Closed by commit rDSTO7a0369f3ddf9: Extract the object storage to its own package and do the required… (authored by qcampos). · Explain WhyJun 27 2016, 2:57 PM

This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

Path

Size

bin/

swh-objstorage-add-dir

debian/

1 line

1 line

7 lines

swh/

storage/

api/

client.py

5 lines

common.py

server.py

6 lines

archiver/

copier.py

2 lines

checker/

__init__.py

checker.py

exc.py

12 lines

objstorage/

api/

multiplexer/

filter/

multiplexer_objstorage.py

objstorage.py

objstorage_pathslicing.py

storage.py

5 lines

tests/

objstorage_testing.py

test_archiver.py

6 lines

test_checker.py

test_multiplexer_filter.py

test_objstorage_api.py

test_objstorage_multiplexer.py

test_objstorage_pathslicing.py

Diff 228

View Options

bin/swh-objstorage-add-dir

View Options

bin/swh-objstorage-fsck

View Options

debian/control

View Options

requirements.txt

View Options

setup.py

View Options

swh/storage/api/client.py

View Options

swh/storage/api/common.py

View Options

swh/storage/api/server.py

View Options

swh/storage/archiver/copier.py

View Options

swh/storage/checker/init.py

View Options

swh/storage/checker/checker.py

View Options

swh/storage/exc.py

View Options

swh/storage/objstorage/init.py

View Options

swh/storage/objstorage/api/init.py

View Options

swh/storage/objstorage/api/client.py

View Options

swh/storage/objstorage/api/server.py

View Options

swh/storage/objstorage/multiplexer/init.py

View Options

swh/storage/objstorage/multiplexer/filter/init.py

View Options

swh/storage/objstorage/multiplexer/filter/filter.py

View Options

swh/storage/objstorage/multiplexer/filter/id_filter.py

View Options

swh/storage/objstorage/multiplexer/filter/read_write_filter.py

View Options

swh/storage/objstorage/multiplexer/multiplexer_objstorage.py

View Options

swh/storage/objstorage/objstorage.py

View Options

swh/storage/objstorage/objstorage_pathslicing.py

View Options

swh/storage/storage.py

View Options

swh/storage/tests/objstorage_testing.py

View Options

swh/storage/tests/test_archiver.py

View Options

swh/storage/tests/test_checker.py

View Options

swh/storage/tests/test_multiplexer_filter.py

View Options

swh/storage/tests/test_objstorage_api.py

View Options

swh/storage/tests/test_objstorage_multiplexer.py

View Options

swh/storage/tests/test_objstorage_pathslicing.py

Extract the object storage to its own package and do the required modifications on the importsClosedPublicActions

Details

Diff Detail

Event Timeline

Revision ContentsChangeset List

Diff 228

bin/swh-objstorage-add-dir

bin/swh-objstorage-fsck

debian/control

requirements.txt

setup.py

swh/storage/api/client.py

swh/storage/api/common.py

swh/storage/api/server.py

swh/storage/archiver/copier.py

swh/storage/checker/__init__.py

swh/storage/checker/checker.py

swh/storage/exc.py

swh/storage/objstorage/__init__.py

swh/storage/objstorage/api/__init__.py

swh/storage/objstorage/api/client.py

swh/storage/objstorage/api/server.py

swh/storage/objstorage/multiplexer/__init__.py

swh/storage/objstorage/multiplexer/filter/__init__.py

swh/storage/objstorage/multiplexer/filter/filter.py

swh/storage/objstorage/multiplexer/filter/id_filter.py

swh/storage/objstorage/multiplexer/filter/read_write_filter.py

swh/storage/objstorage/multiplexer/multiplexer_objstorage.py

swh/storage/objstorage/objstorage.py

swh/storage/objstorage/objstorage_pathslicing.py

swh/storage/storage.py

swh/storage/tests/objstorage_testing.py

swh/storage/tests/test_archiver.py

swh/storage/tests/test_checker.py

swh/storage/tests/test_multiplexer_filter.py

swh/storage/tests/test_objstorage_api.py

swh/storage/tests/test_objstorage_multiplexer.py

swh/storage/tests/test_objstorage_pathslicing.py

Extract the object storage to its own package and do the required modifications on the imports
ClosedPublic
Actions

Revision Contents
Changeset List

swh/storage/checker/init.py

swh/storage/objstorage/init.py

swh/storage/objstorage/api/init.py

swh/storage/objstorage/multiplexer/init.py

swh/storage/objstorage/multiplexer/filter/init.py