Paths

Table of Contentst

Extract objstorage from swh.storage module and recreate its commit history.
ClosedPublic
Actions

Authored by qcampos on Jun 23 2016, 12:44 PM.

Details

Reviewers

olasd
zack
ardumont

Group Reviewers

Reviewers

Maniphest Tasks

T460: Extract the objstorage component from storage module to an independent module

Commits

rDOBJS339e6b1ecfb2: Extract objstorage from swh.storage module and recreate its commit history.

Summary

Extract swh.storage.objstorage to swh.objstorage and repare the outdated import to make the module work correctly.

Diff Detail

Repository

rDOBJS Object storage

Branch

T460

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 246
Build 363: arc lint + arc unit

Event Timeline

qcampos updated this revision to Diff 206.Jun 23 2016, 12:44 PM

qcampos added a task: T460: Extract the objstorage component from storage module to an independent module.

qcampos retitled this revision from to Extract objstorage from swh.storage module and recreate its commit history..

qcampos updated this object.

qcampos added reviewers: olasd, zack.

Herald added a reviewer: Reviewers. · View Herald TranscriptJun 23 2016, 12:44 PM

qcampos added a child revision: D64: Extract the object storage to its own package and do the required modifications on the imports.Jun 23 2016, 2:34 PM

Move the swh.storage.checker module into swh.objstorage.checker as this module works with the object storage.

Herald edited edge metadata. · View Herald TranscriptJun 23 2016, 2:43 PM

ardumont mentioned this in D64: Extract the object storage to its own package and do the required modifications on the imports.Jun 23 2016, 2:56 PM

ardumont added a subscriber: ardumont.Jun 23 2016, 3:09 PM

ardumont added inline comments.

swh/objstorage/tests/test_checker.py
14	swh.objstorage?

Move the swh.storage.checker module into swh.objstorage.checker as this module works with the object storage.
Import scripts from swh.storage
api: Move the http api-related code from storage to objstorage to keep the dependancy from the first to the second

Herald edited edge metadata. · View Herald TranscriptJun 23 2016, 3:35 PM

Thus far, this seems ok.
Waiting as per our discussion for the debian packaging part you already started ^^

Update debian packaging config

Herald edited edge metadata. · View Herald TranscriptJun 23 2016, 3:48 PM

ardumont added inline comments.Jun 23 2016, 3:59 PM

debian/control
21	Our convention seems to indicate the upper case on the first letter `Object Storage`

Update debian packaging config

The packaging is tested and works fine.

Herald edited edge metadata. · View Herald TranscriptJun 23 2016, 4:29 PM

Awesome

This revision is now accepted and ready to land.Jun 23 2016, 4:38 PM

Need to update the diff for changes in the commits and debian packaging

This revision now requires review to proceed.Jun 27 2016, 12:19 PM

qcampos marked an inline comment as done.Jun 27 2016, 12:20 PM

ardumont accepted this revision.Jun 27 2016, 12:54 PM

ardumont edited edge metadata.

This revision is now accepted and ready to land.Jun 27 2016, 12:54 PM

Closed by commit rDOBJS339e6b1ecfb2: Extract objstorage from swh.storage module and recreate its commit history. (authored by qcampos). · Explain WhyJun 27 2016, 1:15 PM

This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

Path

Size

bin/

swh-objstorage-add-dir

37 lines

swh-objstorage-fsck

28 lines

debian/

2 lines

12 lines

2 lines

11 lines

18 lines

swh/

foo/

bar.py

objstorage/

__init__.py

4 lines

api/

103 lines

69 lines

97 lines

172 lines

25 lines

multiplexer/

__init__.py

4 lines

filter/

98 lines

48 lines

99 lines

17 lines

multiplexer_objstorage.py

194 lines

objstorage.py

119 lines

objstorage_pathslicing.py

347 lines

tests/

objstorage_testing.py

70 lines

server_testing.py

80 lines

test_checker.py

128 lines

test_multiplexer_filter.py

373 lines

test_objstorage.py

17 lines

test_objstorage_api.py

88 lines

test_objstorage_multiplexer.py

78 lines

test_objstorage_pathslicing.py

76 lines

Commit	Tree	Parents	Author	Summary	Date
78e4f662baf5	ba1ba4641fa7	3effd252a53d	Quentin Campos	Update debian packaging config	Jun 23 2016, 3:37 PM
3effd252a53d	19d3233ccaed	8e79ecc58f5f	Quentin Campos	api: Move the http api-related code from storage to objstorage to keep the… (Show More…)	Jun 23 2016, 3:09 PM
8e79ecc58f5f	6cf0425d2eeb	601d984e0568	Quentin Campos	Import scripts from swh.storage	Jun 23 2016, 2:58 PM
601d984e0568	085039f36bcd	89bf2a98d033	Quentin Campos	Move the swh.storage.checker module into swh.objstorage.checker as this module… (Show More…)	Jun 23 2016, 2:42 PM
89bf2a98d033	0a7843d933ee	3226739f3e9e	Quentin Campos	imports: correction due to the module extraction	Jun 23 2016, 12:36 PM
3226739f3e9e	a78625dad483	24993f350253	Quentin Campos	exc: Create a new exception type specific to the object storage. Also, add the… (Show More…)	Jun 23 2016, 12:37 PM
24993f350253	100234860741	3ed1894784b1	Quentin Campos	Move tests to the correct location (Show More…)	Jun 22 2016, 5:43 PM
3ed1894784b1	a0e8a2891846	3b808772841b	Quentin Campos	Move all files to the correct repository swh/objstorage (Show More…)	Jun 22 2016, 4:50 PM
3b808772841b	e136236d34d7	8501d47df55a	Quentin Campos	objstorage.multiplexer: add some use case example to the MultiplexerObjStorage… (Show More…)	Jun 21 2016, 3:48 PM
8501d47df55a	558380e0357b	af20300a3870	Antoine R. Dumont (@ardumont)	Open (and fix) swh.storage.storage.revision_log_by (Show More…)	Jun 21 2016, 10:42 AM
af20300a3870	6701afb7d725	a386b9d90ab8	Quentin Campos	objstorage.multiplexer.filter: add tests for the filters implementations	Jun 20 2016, 3:28 PM
a386b9d90ab8	62323441ed85	38eac8bb167c	Quentin Campos	objstorage: move the constant ID_HASH_ALGO to ObjStorage	Jun 16 2016, 11:35 AM
38eac8bb167c	a43be1d3724c	fce4177991af	Quentin Campos	objstorage.multiplexer: add tests for the multiplexer object storage	Jun 16 2016, 11:10 AM
fce4177991af	dcb26a8e98d1	5a145eeccda0	Quentin Campos	objstorage.multiplexer.filter: add a way to easily create filter chaining	Jun 15 2016, 6:00 PM
5a145eeccda0	18a39881e822	f99f8197a018	Quentin Campos	objstorage.multiplexer.filter: Implement the multiplexer filter mecanism (Show More…)	Jun 15 2016, 4:56 PM
f99f8197a018	9a5c762293ca	afc53da694eb	Quentin Campos	objstorage.multiplexer: Implement the object storage multiplexer	Jun 15 2016, 4:00 PM
afc53da694eb	72a4041a7c0e	639096443f98	Quentin Campos	archiver: change objstorage initialization into the archiver (Show More…)	Jun 14 2016, 5:33 PM
639096443f98	cba002085370	662fef2e7175	Quentin Campos	checker: change the objstorage initialization of the checker (Show More…)	Jun 14 2016, 5:31 PM
662fef2e7175	eff7744a580f	38f3b7eec82f	Nicolas Dandrimont	test_archiver: remove debug prints	Jun 14 2016, 5:21 PM
38f3b7eec82f	457c4d5c4e9a	46f6641ed963	Quentin Campos	objstorage.api: Change instantiation of the object storage (Show More…)	Jun 14 2016, 5:03 PM
46f6641ed963	f51a45682d16	8aa04719df7c	Quentin Campos	objstorage.api: Change instantiation of the object storage (Show More…)	Jun 14 2016, 5:03 PM
8aa04719df7c	11b585cc15fa	4f8327f43ccf	Quentin Campos	objstorage: PathslicingObjStorage now allow arbitrary slicing (Show More…)	Jun 14 2016, 5:01 PM
4f8327f43ccf	d63ee835defb	802832c36dba	Quentin Campos	objstorage: PathslicingObjStorage now allow arbitrary slicing (Show More…)	Jun 14 2016, 5:01 PM
802832c36dba	6d2be74af621	43c5cdb25afe	Jordi BERTRAN DE BALANDA (swhintern)	converters: update to reflect decoding logic moved to swh.core.utils	Jun 10 2016, 2:59 PM
43c5cdb25afe	0116c988708a	5f9bc2686a0a	Quentin Campos	Change the objstorage http server in order to follow the changes of the local… (Show More…)	Jun 6 2016, 4:31 PM
5f9bc2686a0a	aafe19b64482	a157a6d47970	Quentin Campos	Change the objstorage http server in order to follow the changes of the local… (Show More…)	Jun 6 2016, 4:31 PM
a157a6d47970	d44cedb40819	b86631ce7af0	Quentin Campos	Update the content integrity checker in order to follow objstorage changes	Jun 6 2016, 4:30 PM
b86631ce7af0	374532d326f2	3a05041faa2f	Quentin Campos	Add an implementation of the object storage api and a test class	Jun 6 2016, 2:33 PM
3a05041faa2f	9b55ca84cd69	9deabcbdd67b	Quentin Campos	Add an implementation of the object storage api and a test class	Jun 6 2016, 2:33 PM
9deabcbdd67b	ea7da7c47e5d	946073fc88e2	Quentin Campos	Create a base API that define the objstorage behavior (Show More…)	Jun 1 2016, 3:23 PM
946073fc88e2	e1c7c7c02835	f14c963076b2	Quentin Campos	Create a base API that define the objstorage behavior (Show More…)	Jun 1 2016, 3:23 PM
f14c963076b2	56e4bb201412	c3f12b0de6c3	Quentin Campos	Fix an object id encoding into a test of objstorage api (Show More…)	May 31 2016, 4:43 PM
c3f12b0de6c3	1106691146da	89a115c74098	Quentin Campos	Improve content integrity checker's test coverage (Show More…)	May 31 2016, 3:20 PM
89a115c74098	1343675ad254	d709d29614fc	Quentin Campos	The checker now have the possibility to have multiple backup servers (Show More…)	May 31 2016, 3:14 PM
d709d29614fc	691e8be8f7d5	e16060a701e9	Quentin Campos	Forgot to change the encoding into the tests. (Show More…)	May 27 2016, 4:30 PM
e16060a701e9	fa5fa8f63ec6	547c219872c1	Quentin Campos	Forgot to change the encoding into the tests. (Show More…)	May 27 2016, 4:30 PM
547c219872c1	5ba30723a97d	79ca04e1e05b	Quentin Campos	Also, add a get_random_contents access to the remote API	May 27 2016, 12:55 PM
79ca04e1e05b	f71b7faf3295	4156533a6193	Quentin Campos	Also, add a get_random_contents access to the remote API	May 27 2016, 12:55 PM
4156533a6193	260ffb10ff99	900e5d166ae3	Quentin Campos	Add some methods to the object storage in order to allow a content integrity… (Show More…)	May 26 2016, 12:11 PM
900e5d166ae3	e6f1621fe08d	1ec84256ea10	Quentin Campos	Add some methods to the object storage in order to allow a content integrity… (Show More…)	May 26 2016, 12:11 PM
1ec84256ea10	b3e0cc9c7c6b	e15367114f58	Quentin Campos	Add some tests for the content integrity checker (Show More…)	May 24 2016, 3:50 PM
e15367114f58	dd628a59321a	ab064e3f4c80	Antoine R. Dumont (@ardumont)	Add run_from_webserver function for objstorage api server (Show More…)	May 20 2016, 3:26 PM
ab064e3f4c80	5f104f15dff5	689dcf66197a	Antoine R. Dumont (@ardumont)	Add unique identifier message on default api server route endpoints	May 20 2016, 3:24 PM
689dcf66197a	e33f5c4fff08	6376a2aeffdc	Quentin Campos	Command line launch improvements (Show More…)	May 20 2016, 12:00 PM
6376a2aeffdc	76683d56a82d	1f7b9256bdec	Quentin Campos	Change test attribute in order to skip some tests	May 20 2016, 12:05 AM
1f7b9256bdec	c9c2bc4e5f06	e0667961d26e	Quentin Campos	Fix tests according to 37c8b88 (align extra_git_headers to extra_headers) (Show More…)	May 17 2016, 4:42 PM
e0667961d26e	0a61cf8584b1	9bd27d2c57a3	Quentin Campos	Improve test coverage of the archiver (Show More…)	May 13 2016, 4:40 PM
9bd27d2c57a3	c750d3b4837b	3d770cbfd523	Quentin Campos	Fixes and improvements for T401 (Show More…)	May 13 2016, 11:36 AM
3d770cbfd523	07c0cc8c105e	c11a89f44c23	Quentin Campos	Improve starting routines of storage & objstorage servers (Show More…)	May 12 2016, 3:08 PM
c11a89f44c23	0a662c19a146	ad486a6f2747	Quentin Campos	Make the worker asynchronous optional (Show More…)	May 12 2016, 12:43 PM
ad486a6f2747	117a77beb3a2	3e6c9817bd51	Quentin Campos	Change storage & objstorage server mains in order to change default port (Show More…)	May 11 2016, 5:30 PM
3e6c9817bd51	2094834559dc	553df58f2514	Quentin Campos	Change the server's imports to absolute ones (Show More…)	May 10 2016, 5:10 PM
553df58f2514	4923cc7eb989	f4f7709977aa	Quentin Campos	Add synchronous first implementation of the archiver (Show More…)	May 4 2016, 1:24 PM
f4f7709977aa	64299813caea	d744acd7cb7e	Quentin Campos	Add an http API for objstorage and refactor the shared code with storage.api (Show More…)	May 2 2016, 11:56 AM
d744acd7cb7e	2ef186ffd331	cc21d001c60d	Quentin Campos	Change the objstorage file to a module	May 2 2016, 11:52 AM
cc21d001c60d	8c7b6b948c5b	355e30dabdbd	Quentin Campos	Add tests for the remote objstorage API and share some code with storage.api… (Show More…)	Apr 29 2016, 3:52 PM
355e30dabdbd	df0a4b5498ca	3bb3c4d9097c	Nicolas Dandrimont	sql/swh-schema: add a fullname field to person (Show More…)	Apr 7 2016, 6:28 PM
3bb3c4d9097c	5df7cb51571c	d502912ed606	Nicolas Dandrimont	sql/swh-schema: rename entity{_history}.doap to metadata	Mar 9 2016, 4:49 PM
d502912ed606	771be01850c9	5605f85df596	Nicolas Dandrimont	swh-schema: fold the entity.lister column in entity.lister_metadata	Mar 8 2016, 5:02 PM
5605f85df596	58b6148021d2	21b7717ec6fa	Nicolas Dandrimont	storage: add entity_get_one to retrieve a single entity	Mar 4 2016, 4:30 PM
21b7717ec6fa	b01b944ec708	43e8918c74fa	Nicolas Dandrimont	sql/swh-func: drop temporary entity-related tables on commit	Mar 4 2016, 12:28 PM
43e8918c74fa	11027fcc8d85	23a48526e4d2	Nicolas Dandrimont	db: allow passing UUIDs back and forth with the database	Mar 4 2016, 12:05 PM
23a48526e4d2	2d8a5dc326c7	807d436a679f	Nicolas Dandrimont	storage: add new method object_find_by_sha1_git (Show More…)	Feb 25 2016, 3:19 PM
807d436a679f	220e80bcbe10	349d282882a9	Antoine R. Dumont (@ardumont)	Open content_missing_per_sha1	Feb 11 2016, 12:18 PM
349d282882a9	c5b092810e1f	c1f45f71f020	Nicolas Dandrimont	swh.storage: Allow storage of extra git headers in revisions (Show More…)	Feb 10 2016, 12:22 PM
c1f45f71f020	05a9023b58ff	42753cfc6c9b	Nicolas Dandrimont	sql/swh-schema: Handle negative UTC offsets in revision and release dates	Feb 5 2016, 11:08 AM
42753cfc6c9b	601b9d698fe4	728ddf49f266	Nicolas Dandrimont	storage.py: add a shortlog method only returning revision ids and parents	Feb 2 2016, 7:49 PM
728ddf49f266	6ede4c7029ea	6a333ea4d4be	Antoine R. Dumont (@ardumont)	Let the person's id flow (Show More…)	Jan 29 2016, 5:06 PM
6a333ea4d4be	b5cfdfab72d1	273cb6f0594f	Nicolas Dandrimont	test_storage: move backend-agnostic tests to the base class	Jan 27 2016, 5:51 PM
273cb6f0594f	514697bbe349	24a4163afadd	Nicolas Dandrimont	sql: Use a new schema for occurrences (Show More…)	Jan 27 2016, 5:50 PM
24a4163afadd	ccef0adca956	ce73d5f157ba	Antoine R. Dumont (@ardumont)	Deal with occurrence_history.branch, release.name as bytes (Show More…)	Jan 27 2016, 1:44 PM
ce73d5f157ba	0c323ad1fab0	f10c61f16897	Nicolas Dandrimont	sql: make occurrences and revisions use type agnostic targets (Show More…)	Jan 22 2016, 6:29 PM
f10c61f16897	f50de18929f5	7e1232514210	Antoine R. Dumont (@ardumont)	Wrap miscellaneous psycopg2 failures for client in StorageBackendError (Show More…)	Jan 20 2016, 3:13 PM
7e1232514210	66f4b6778911	59ca69809b00	Antoine R. Dumont (@ardumont)	Open occurrence_get(origin_id) to retrieve latest occurrences per origin (Show More…)	Jan 20 2016, 12:08 PM
59ca69809b00	62739557de48	7867dab133fd	Antoine R. Dumont (@ardumont)	revision_log from multiple root revisions (Show More…)	Jan 20 2016, 10:59 AM
7867dab133fd	5bef1e65a36f	4fd2682a1e46	Antoine R. Dumont (@ardumont)	Open release_get_by to retrieve a release by origin. (Show More…)	Jan 19 2016, 12:03 PM
4fd2682a1e46	2082c8063cc3	b818e0d6a837	Antoine R. Dumont (@ardumont)	revision_get_by: branch name filtering is optional (Show More…)	Jan 19 2016, 11:46 AM
b818e0d6a837	a8ce9b412352	f708c2504046	Antoine R. Dumont (@ardumont)	Open directory_get to retrieve information on directory by id (Show More…)	Jan 18 2016, 12:25 PM
f708c2504046	0d07041895c9	35a49a0b32a0	Antoine R. Dumont (@ardumont)	Rename directory_get to directory_ls (Show More…)	Jan 18 2016, 11:36 AM
35a49a0b32a0	a20d9f771b42	8dfe8a87ad56	Antoine R. Dumont (@ardumont)	Open entity_get api (Show More…)	Jan 15 2016, 3:45 PM
8dfe8a87ad56	f8105052c38d	6d7a50f91123	Antoine R. Dumont (@ardumont)	sql/upgrades/039: add 038→039 upgrade script (Show More…)	Jan 15 2016, 11:34 AM
6d7a50f91123	6d046d6680df	73043bc5e3fa	Nicolas Dandrimont	sql/swh-func: get_revision_by should only return one revision (Show More…)	Jan 15 2016, 10:21 AM
73043bc5e3fa	f347a5f034c2	b232df4ae41d	Antoine R. Dumont (@ardumont)	Open directory_entry_get_by_path api	Jan 14 2016, 12:59 PM
b232df4ae41d	819f007d92d9	35f2b0a65e08	Antoine R. Dumont (@ardumont)	Update validity timestamp filtering (Show More…)	Jan 12 2016, 4:00 PM
35f2b0a65e08	bfaa54fa6c99	835c05f494df	Antoine R. Dumont (@ardumont)	Open revision_get_by to retrieve a revision by occurrence criterion filtering (Show More…)	Jan 11 2016, 3:16 PM
835c05f494df	675c52910723	bea6691b008d	Nicolas Dandrimont	revision_log: Implement a limit on the number of revisions listed (Show More…)	Jan 6 2016, 2:56 PM
bea6691b008d	b251a70cecbf	7d7ad16ce76f	Antoine R. Dumont (@ardumont)	revision_log is now 'parents' aware (Show More…)	Jan 5 2016, 3:10 PM
7d7ad16ce76f	53eb6973579e	945abad6cb68	Antoine R. Dumont (@ardumont)	Revert "List direct parents and children sha1s from a given revision" (Show More…)	Jan 5 2016, 2:34 PM
945abad6cb68	68c700e16312	eb8cc20b9268	Antoine R. Dumont (@ardumont)	List direct parents and children sha1s from a given revision (Show More…)	Jan 4 2016, 4:42 PM
eb8cc20b9268	53eb6973579e	a6e11fed9ed4	Antoine R. Dumont (@ardumont)	Open revision_log api (Show More…)	Dec 4 2015, 4:32 PM
a6e11fed9ed4	6348ea8c1145	221b1db661e9	Nicolas Dandrimont	swh.storage: new release schema	Nov 30 2015, 6:13 PM
221b1db661e9	51c4863a6397	272df815b052	Nicolas Dandrimont	swh.storage: use new schema for revisions	Nov 30 2015, 5:38 PM
272df815b052	c1c7d56a225a	3755a19432c4	Antoine R. Dumont (@ardumont)	Unify content_find api to return dict instead of tuples (Show More…)	Nov 27 2015, 10:56 AM
3755a19432c4	eb70fbd767c1	6c11f3247ea9	Antoine R. Dumont (@ardumont)	Remove redundant content_exist and use content_find which returns None if not… (Show More…)	Nov 27 2015, 10:30 AM
6c11f3247ea9	99a164eb4bb2	126e1f3bfdcd	Antoine R. Dumont (@ardumont)	Fix [null...] parents list (Show More…)	Nov 23 2015, 4:09 PM
126e1f3bfdcd	eed330bfb218	c4f1f6e1e382	Antoine R. Dumont (@ardumont)	Open person_get api to retrieve person information (Show More…)	Nov 19 2015, 3:46 PM
c4f1f6e1e382	e5591b761f0b	b9b39bf57392	Antoine R. Dumont (@ardumont)	Simplify test	Nov 19 2015, 2:48 PM
b9b39bf57392	fa3f47b6f696	ad8cedbfcb10	Antoine R. Dumont (@ardumont)	Unify release_get's implementation with revision_get	Nov 19 2015, 2:13 PM
ad8cedbfcb10	b180eeb813b1	bde53fa5665e	Antoine R. Dumont (@ardumont)	Refactor - Simplify and add test	Nov 17 2015, 4:21 PM
bde53fa5665e	d662d3551abc	57ff8af10994	Antoine R. Dumont (@ardumont)	Fix db.origin_add returns tuple not dict	Nov 17 2015, 3:36 PM
57ff8af10994	4ed4be1a4a70	9f8531e487eb	Antoine R. Dumont (@ardumont)	Open release_get : [sha1] -> [Release] (Show More…)	Nov 16 2015, 12:16 PM
9f8531e487eb	4980e8bfd755	646eb1eae229	Antoine R. Dumont (@ardumont)	Add origin lookup per id	Nov 13 2015, 2:38 PM
646eb1eae229	7a7270342078	617884c8cfa8	Antoine R. Dumont (@ardumont)	Retrieve origin information	Nov 13 2015, 2:28 PM
617884c8cfa8	b354283047ab	53feebafa3b6	Antoine R. Dumont (@ardumont)	sql: Add contents to directory_walk_one	Nov 6 2015, 5:58 PM
53feebafa3b6	c342d2ba6b4d	1a65f77137d5	Antoine R. Dumont (@ardumont)	fix	Nov 6 2015, 5:23 PM
1a65f77137d5	5094a1999903	5f679c4a5545	Nicolas Dandrimont	Add endpoints to list entities from the lister metadata	Nov 3 2015, 3:56 PM
5f679c4a5545	b7b3521da945	4d1598d27528	Nicolas Dandrimont	Add endpoints to create entities	Nov 3 2015, 3:52 PM
4d1598d27528	9ad28ae52a5d	efe2dc312611	Antoine R. Dumont (@ardumont)	Add metadata field to revision table (Show More…)	Oct 28 2015, 10:40 AM
efe2dc312611	b71a2d22382a	a1795a9b8e9e	Nicolas Dandrimont	sql: update schema of organizations and projects (Show More…)	Oct 26 2015, 4:20 PM
a1795a9b8e9e	52265a93c49e	61bbbe1209ea	Nicolas Dandrimont	storage: Add entry points for fetch_history	Oct 26 2015, 2:28 PM
61bbbe1209ea	8cb06dcb99b1	80925cc93960	Nicolas Dandrimont	objstorage: add test for directory modes	Oct 23 2015, 5:31 PM
80925cc93960	90a840d3c7d9	8a9dec7a43ae	Antoine R. Dumont (@ardumont)	Write/read `synthetic` column in revision/release	Oct 16 2015, 10:33 AM
8a9dec7a43ae	8114669416d9	38197324d80a	Stefano Zacchiroli	new SQL function: swh_stat_counters() (Show More…)	Oct 14 2015, 10:47 AM
38197324d80a	2f0b29048832	550a19740b8c	Nicolas Dandrimont	objstorage: create files as mode 0o644	Oct 13 2015, 12:27 PM
550a19740b8c	459b41263b4a	4d82f9cbf56d	Nicolas Dandrimont	storage: add revision_get	Oct 7 2015, 6:42 PM
4d82f9cbf56d	7ab093bd3c54	fa2193f32c88	Nicolas Dandrimont	test_storage: use proper types for revisions	Oct 7 2015, 6:40 PM
fa2193f32c88	0c193d276296	da274930196a	Nicolas Dandrimont	tests: fix flake8	Oct 7 2015, 3:30 PM
da274930196a	98d577ef20a1	0847618cb425	Nicolas Dandrimont	swh-schema: person (name, email) -> bytea (Show More…)	Oct 6 2015, 1:54 PM
0847618cb425	f7948838c567	40ab1c42e208	Nicolas Dandrimont	swh.storage.storage: make occurrence_add support overlapping intervals (Show More…)	Oct 5 2015, 6:41 PM
40ab1c42e208	0d2e6af394df	35dd9fbabba0	Nicolas Dandrimont	sql/swh-func: add table aliases to "where not exists" queries	Oct 5 2015, 4:00 PM
35dd9fbabba0	b0a883f7d778	d250617427ad	Nicolas Dandrimont	swh.storage.tests: Actually check the error message	Oct 5 2015, 10:45 AM
d250617427ad	b37a935c59b1	af4005522d58	Nicolas Dandrimont	swh.storage.tests: clean the database on teardown	Oct 5 2015, 10:33 AM
af4005522d58	fce84c0eb0a9	730766edb587	Stefano Zacchiroli	storage.content_find: better testing	Oct 5 2015, 10:00 AM
730766edb587	09d482c36c45	ff2661c8e940	Stefano Zacchiroli	storage.content_find: refactor argument checking (Show More…)	Oct 4 2015, 8:39 PM
ff2661c8e940	5d1ab8952367	54134618a387	Nicolas Dandrimont	Remove atime, mtime, ctime from directory entries	Oct 1 2015, 7:02 PM
54134618a387	3063420f8486	a9c2454dd63d	Antoine R. Dumont	Improve output response for find occurrence api	Sep 30 2015, 10:39 AM
a9c2454dd63d	dc9a89c9d0ce	ff0c444c2e16	Stefano Zacchiroli	test_storage: add collision detection test	Sep 30 2015, 9:33 AM
ff0c444c2e16	296c5ba3184b	8dfb906e4926	Stefano Zacchiroli	test_api_client: use absolute import to allow rm __init__.py	Sep 30 2015, 9:25 AM
8dfb906e4926	7c84df769aef	08bbfa766ae3	Stefano Zacchiroli	db_testing.py: allow to customize DB restore	Sep 29 2015, 6:15 PM
08bbfa766ae3	ea73743c1518	2f969e885e40	Antoine R. Dumont	Implement content_find_occurrence up to the db	Sep 29 2015, 5:32 PM
2f969e885e40	be0ec4e0cc8a	d4a37d7c6b96	Stefano Zacchiroli	move db_test.py from swh-storage to swh-core	Sep 29 2015, 4:38 PM
d4a37d7c6b96	cb8034506d4e	d964f372a69a	Antoine R. Dumont	Refactor - Permit reuse of the content_find api	Sep 29 2015, 3:52 PM
d964f372a69a	a0c87245f743	fbdf7bf2ea65	Nicolas Dandrimont	swh.storage.api: Serialize/deserialize exceptions (Show More…)	Sep 29 2015, 3:04 PM
fbdf7bf2ea65	ea7736641bfb	59cd05e6be73	Nicolas Dandrimont	Move remote_storage and api to api.client and api.server (Show More…)	Sep 29 2015, 10:21 AM
59cd05e6be73	a4357ba0144d	ef7b096357b2	Antoine R. Dumont	Refactor - Migrate content_present to content_find (Show More…)	Sep 29 2015, 9:23 AM
ef7b096357b2	51cdd506fb7e	ea0ac366f30d	Nicolas Dandrimont	sql/swh-schema: unix_path to bytea	Sep 28 2015, 5:28 PM
ea0ac366f30d	2fc5c28e59a2	8b012b2cc280	Nicolas Dandrimont	swh.storage.storage: Allow storing "skipped" contents	Sep 28 2015, 2:49 PM
8b012b2cc280	d889eee835e5	a9102e766c0f	Antoine R. Dumont	Simplify the api content_present (Show More…)	Sep 24 2015, 3:02 PM
a9102e766c0f	c549d0d05d64	b0e2a6678554	Antoine R. Dumont	Implement the content_present api	Sep 23 2015, 11:15 AM
b0e2a6678554	9f6dcc6a936e	a2a2a65fdde3	Nicolas Dandrimont	swh.storage.api: Properly escape arbitrary byte sequences in arguments	Sep 22 2015, 5:02 PM
a2a2a65fdde3	742f160356cd	3079f675482f	Antoine R. Dumont	Open /content/present api	Sep 22 2015, 2:39 PM
3079f675482f	44762a91f03e	6d89128b9b8e	Nicolas Dandrimont	tests: add documentation for Test{,Remote}Storage	Sep 22 2015, 11:56 AM
6d89128b9b8e	06df4587f31c	6e5364e3d73b	Nicolas Dandrimont	tests: make both storage tests inherit from an abstract class (Show More…)	Sep 22 2015, 11:04 AM
6e5364e3d73b	0a31a0270d02	30fcc29356a5	Nicolas Dandrimont	test_remote_storage: Add code to run the server automatically	Sep 22 2015, 11:03 AM
30fcc29356a5	9018ef3498b5	41becead4548	Nicolas Dandrimont	Add a remote API server and a client for remote storage	Sep 21 2015, 6:09 PM
41becead4548	11aad9dc3d80	b48911d097a9	Nicolas Dandrimont	test_storage: don't break if the storage has no objstorage (Show More…)	Sep 21 2015, 6:07 PM
b48911d097a9	c200d270dc62	487e4a29ba38	Nicolas Dandrimont	swh.storage.storage: implement occurrence_add	Sep 17 2015, 5:10 PM
487e4a29ba38	607ed3f873f4	9d5da47dfdcd	Nicolas Dandrimont	swh.storage.storage: add origin_get and origin_add_one	Sep 17 2015, 4:49 PM
9d5da47dfdcd	b68dcd4c430f	1b5f80a80532	Nicolas Dandrimont	Add offsets to the dates that need them in the schema (Show More…)	Sep 16 2015, 3:06 PM
1b5f80a80532	caef09b99bd2	1811f5916880	Nicolas Dandrimont	Implement revision_add for swh.storage.Storage	Sep 16 2015, 12:53 PM
1811f5916880	1b06aee881fd	8c5aec2d794e	Stefano Zacchiroli	add back needed __init__.py to non-namespace packages	Sep 15 2015, 6:38 PM
8c5aec2d794e	2c3a314a6480	4d4633a1cbd0	Stefano Zacchiroli	get rid of __init__.py	Sep 15 2015, 6:08 PM
4d4633a1cbd0	1b06aee881fd	79b28a205057	Nicolas Dandrimont	swh.storage.db/storage: Allow listing one directory's contents	Sep 15 2015, 4:54 PM
79b28a205057	265519a23662	4aa636a5aa54	Nicolas Dandrimont	Commit first implementation of directory_add	Sep 14 2015, 8:47 PM
4aa636a5aa54	a0bd587da270	f02b1a0bc081	Stefano Zacchiroli	DB testing: update doc and tests to use swh-storage-testdata	Sep 14 2015, 7:01 PM
f02b1a0bc081	3defb36e1f92	c2a5a2d88206	Nicolas Dandrimont	swh.storage.storage: Add content_missing method to Storage	Sep 14 2015, 5:12 PM
c2a5a2d88206	c9cc026141ac	9f120b6b29cb	Nicolas Dandrimont	swh.storage.tests: refactor storage test	Sep 14 2015, 5:08 PM
9f120b6b29cb	a7466497a666	75a597cd45bb	Nicolas Dandrimont	Update swh.storage.db for the new hash API	Sep 14 2015, 3:48 PM
75a597cd45bb	6c4805fdffd7	375e2fda05b5	Nicolas Dandrimont	Update ObjStorage API for the new hashes (Show More…)	Sep 14 2015, 3:43 PM
375e2fda05b5	279c2c88c6c7	a05b79a3b210	Nicolas Dandrimont	Rename Storage.add_content to content_add	Sep 11 2015, 4:24 PM
a05b79a3b210	0620fefebec2	942a0fd6750d	Stefano Zacchiroli	db.Db: refactor copy_to() function to COPY to arbitrary tables (Show More…)	Sep 9 2015, 5:06 PM
942a0fd6750d	6ec533b3374e	a334ddd93523	Stefano Zacchiroli	stored proc: generalize mktemp function (Show More…)	Sep 9 2015, 3:54 PM
a334ddd93523	15efc4a6fdb1	48f11ca9c99d	Stefano Zacchiroli	db_testing: do not try to rollback closed connections	Sep 8 2015, 10:00 PM
48f11ca9c99d	b56fd59cfbfe	cf387f8b2d40	Stefano Zacchiroli	refactor db.Db to be a proxy with storage procedure wrappers (Show More…)	Sep 8 2015, 9:58 PM
cf387f8b2d40	a9b6ceded0fc	4d7ca904aeb3	Stefano Zacchiroli	db_testing: bug fix: call specific super() methods (Show More…)	Sep 8 2015, 3:17 PM
4d7ca904aeb3	c9b91e0b951d	8cb72d223c39	Stefano Zacchiroli	test_storage.py: test add_content()	Sep 8 2015, 1:34 PM
8cb72d223c39	4dd6cdae6891	000d2098afd0	Stefano Zacchiroli	test_objstorage.py: use assert(Not)In where possible (style)	Sep 8 2015, 1:33 PM
000d2098afd0	4a32d7869434	ad760ca40473	Stefano Zacchiroli	test_db.py: (trivial) tests for swh.storage.db	Sep 8 2015, 12:38 PM
ad760ca40473	784ee8ff2efa	8e416232bcf6	Stefano Zacchiroli	db_testing.py: fixture to ease testing using the DB	Sep 8 2015, 12:37 PM
8e416232bcf6	5c2ca4327f96	c6e50451862a	Stefano Zacchiroli	make swh.storage.tests a proper python module (Show More…)	Sep 8 2015, 10:27 AM
c6e50451862a	8c654303bcb7	9012042f9a68	Stefano Zacchiroli	objstorage: idempotent addition, ignore dups (Show More…)	Sep 7 2015, 3:55 PM
9012042f9a68	693a9db4a2e8	995efafc3885	Stefano Zacchiroli	objstorage: add support for len() and __iter__()	Sep 4 2015, 2:10 PM
995efafc3885	c81f71bde30d	ddd94f2301d0	Stefano Zacchiroli	objstorage: return object id upon add() (Show More…)	Sep 4 2015, 11:50 AM
ddd94f2301d0	2386a68363ba	09e1d5717352	Stefano Zacchiroli	objstorage: use __contains__ for membership test	Sep 4 2015, 9:45 AM
09e1d5717352	8c617d6e950e	75750b3b1907	Stefano Zacchiroli	objstorage: simplify exc hierarchy to have a top-level Error exc	Sep 3 2015, 1:51 PM
75750b3b1907	1d77a61b190f	99f01a2f9a7f	Stefano Zacchiroli	objstorage: switch to sha1 object ids (from sha1_git)	Sep 3 2015, 12:21 PM
99f01a2f9a7f	4ab52f680688	810bde68afe5	Stefano Zacchiroli	add get() method(s)	Sep 2 2015, 6:23 PM
810bde68afe5	a74389a5b65d	8cd1c7c88e10	Stefano Zacchiroli	tests: better organization for setUp values (Show More…)	Sep 2 2015, 6:22 PM
8cd1c7c88e10	a44d858ed2c9	7c183da88c37	Stefano Zacchiroli	tests: preseed obj_id on add wherever possible	Sep 2 2015, 6:13 PM
7c183da88c37	48b8a151775f	d3c33d6dbef7	Stefano Zacchiroli	ensure we can easily switch to sha1 algo (Show More…)	Sep 2 2015, 5:51 PM
d3c33d6dbef7	82ef3462367f	e8733fa77194	Stefano Zacchiroli	add check() method (Show More…)	Sep 2 2015, 5:24 PM
e8733fa77194	c3ab67f2c9e9	f17eaf8ad521	Stefano Zacchiroli	add has() method and clobbering support	Sep 2 2015, 4:25 PM
f17eaf8ad521	62ece6864776	ae1f67019537	Stefano Zacchiroli	add gzip compression	Sep 2 2015, 3:50 PM
ae1f67019537	28d559241df7	2fd112f17ae4	Stefano Zacchiroli	push tests down, inside swh.storage	Sep 2 2015, 3:32 PM