Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Jul 28 2016

qcampos committed rDOBJSbe055c9d125e: Correct ObjStorage filters initialization (authored by qcampos).
Correct ObjStorage filters initialization
Jul 28 2016, 3:52 PM
qcampos closed D83: Add new functionnality to the ObjStorage and align remote API to the local one by committing rDOBJSbe055c9d125e: Correct ObjStorage filters initialization.
Jul 28 2016, 3:52 PM
qcampos updated the diff for D83: Add new functionnality to the ObjStorage and align remote API to the local one.
  • Correct ObjStorage filters initialization
  • Update ObjStorages tests so they use the new initialization (this allow to test the initialization), and add specific tests for basic storage initialization.
Jul 28 2016, 2:19 PM

Jul 27 2016

qcampos abandoned D81: Refactor and optimize the archiver.

Previous modifications are no longer relevant due to Archiver specification's last evolutions.

Jul 27 2016, 4:10 PM
qcampos added a revision to T513: Add methods to easily instantiate ObjStorage of different types: D84: Update tests to follow RemoteObjStorage api fixes.
Jul 27 2016, 4:08 PM · Restricted Project, Storage manager
qcampos added a task to D84: Update tests to follow RemoteObjStorage api fixes: T513: Add methods to easily instantiate ObjStorage of different types.
Jul 27 2016, 4:08 PM
qcampos updated D83: Add new functionnality to the ObjStorage and align remote API to the local one.
Jul 27 2016, 3:46 PM
qcampos retitled D83: Add new functionnality to the ObjStorage and align remote API to the local one from Add new functionnality to the ObjStorage and align remote API to the local one. to Add new functionnality to the ObjStorage and align remote API to the local one.
Jul 27 2016, 3:46 PM
qcampos added a task to D83: Add new functionnality to the ObjStorage and align remote API to the local one: T513: Add methods to easily instantiate ObjStorage of different types.
Jul 27 2016, 3:45 PM
qcampos added a revision to T513: Add methods to easily instantiate ObjStorage of different types: D83: Add new functionnality to the ObjStorage and align remote API to the local one.
Jul 27 2016, 3:45 PM · Restricted Project, Storage manager
qcampos created T513: Add methods to easily instantiate ObjStorage of different types.
Jul 27 2016, 1:15 PM · Restricted Project, Storage manager
qcampos created T512: Make archiver have a more symmetrical behavior treating storages as potential sources & destinations at the same time.
Jul 27 2016, 1:11 PM · Storage manager
qcampos removed a subtask for T240: content archiver: T406: Make the archiver asynchronous mode optional.
Jul 27 2016, 1:09 PM · Storage manager
qcampos added a subtask for T401: Content archiver - Asynchronous version: T406: Make the archiver asynchronous mode optional.
Jul 27 2016, 1:09 PM · Restricted Project, Storage manager
qcampos edited parent tasks for T406: Make the archiver asynchronous mode optional, added: T401: Content archiver - Asynchronous version; removed: T240: content archiver.
Jul 27 2016, 1:09 PM · Restricted Project, Storage manager
qcampos edited parent tasks for T403: Improve content archiver testing coverage, added: T401: Content archiver - Asynchronous version; removed: T240: content archiver.
Jul 27 2016, 1:08 PM · Restricted Project, Storage manager
qcampos removed a subtask for T240: content archiver: T403: Improve content archiver testing coverage.
Jul 27 2016, 1:08 PM · Storage manager
qcampos added a subtask for T401: Content archiver - Asynchronous version: T403: Improve content archiver testing coverage.
Jul 27 2016, 1:08 PM · Restricted Project, Storage manager
qcampos removed a parent task for T402: Dev: Improve starting server routine: T240: content archiver.
Jul 27 2016, 1:08 PM · Restricted Project, Storage manager
qcampos removed a subtask for T240: content archiver: T402: Dev: Improve starting server routine.
Jul 27 2016, 1:08 PM · Storage manager
qcampos edited parent tasks for T405: Deploying objstorage API server, added: T381: HTTP client/server version of swh.storage.objstorage; removed: T240: content archiver.
Jul 27 2016, 1:07 PM · System administration, Language-Puppet, Storage manager
qcampos removed a subtask for T240: content archiver: T405: Deploying objstorage API server.
Jul 27 2016, 1:07 PM · Storage manager
qcampos added a subtask for T381: HTTP client/server version of swh.storage.objstorage: T405: Deploying objstorage API server.
Jul 27 2016, 1:07 PM · Storage manager
qcampos edited parent tasks for T404: Debian packaging update, added: T401: Content archiver - Asynchronous version; removed: T240: content archiver.
Jul 27 2016, 1:07 PM · Restricted Project, Storage manager
qcampos removed a subtask for T240: content archiver: T404: Debian packaging update.
Jul 27 2016, 1:07 PM · Storage manager
qcampos added a subtask for T401: Content archiver - Asynchronous version: T404: Debian packaging update.
Jul 27 2016, 1:07 PM · Restricted Project, Storage manager
qcampos added a parent task for T402: Dev: Improve starting server routine: T381: HTTP client/server version of swh.storage.objstorage.
Jul 27 2016, 1:06 PM · Restricted Project, Storage manager
qcampos added a subtask for T381: HTTP client/server version of swh.storage.objstorage: T402: Dev: Improve starting server routine.
Jul 27 2016, 1:06 PM · Storage manager
qcampos planned changes to D81: Refactor and optimize the archiver.

The archiver will evolve to a more symmetrical between storages & generic structure.

Jul 27 2016, 12:51 PM
qcampos updated the diff for D81: Refactor and optimize the archiver.

Update doctring to match the current implementation.

Jul 27 2016, 12:20 PM
qcampos added inline comments to D81: Refactor and optimize the archiver.
Jul 27 2016, 12:01 PM

Jul 26 2016

qcampos updated the diff for D81: Refactor and optimize the archiver.

Update Copyright date in licence header

Jul 26 2016, 4:52 PM
qcampos updated D81: Refactor and optimize the archiver.
Jul 26 2016, 4:44 PM
qcampos added a revision to T240: content archiver: D81: Refactor and optimize the archiver.
Jul 26 2016, 4:42 PM · Storage manager
qcampos added a task to D81: Refactor and optimize the archiver: T240: content archiver.
Jul 26 2016, 4:42 PM

Jul 22 2016

qcampos committed rDSTOf4ef5a5d9c1c: Archiver db's get of content_archive is now ordered by sha1 (authored by qcampos).
Archiver db's get of content_archive is now ordered by sha1
Jul 22 2016, 3:35 PM
qcampos closed D80: Order by sha1 the result of the content_archive_get in the archiver db by committing rDSTOf4ef5a5d9c1c: Archiver db's get of content_archive is now ordered by sha1.
Jul 22 2016, 3:35 PM
qcampos removed a subtask for T240: content archiver: T401: Content archiver - Asynchronous version.
Jul 22 2016, 12:30 PM · Storage manager
qcampos edited parent tasks for T401: Content archiver - Asynchronous version, added: T400: Content archiver synchronous version; removed: T240: content archiver.
Jul 22 2016, 12:30 PM · Restricted Project, Storage manager
qcampos added a subtask for T400: Content archiver synchronous version: T401: Content archiver - Asynchronous version.
Jul 22 2016, 12:30 PM · Restricted Project, Storage manager
qcampos removed a parent task for T412: Bootstrap archiver's database: T240: content archiver.
Jul 22 2016, 12:29 PM · Storage manager
qcampos removed a subtask for T240: content archiver: T412: Bootstrap archiver's database.
Jul 22 2016, 12:29 PM · Storage manager
qcampos retitled D80: Order by sha1 the result of the content_archive_get in the archiver db from Ordr by sha1 the result of the content_archive_get in the archiver db to Order by sha1 the result of the content_archive_get in the archiver db.
Jul 22 2016, 12:25 PM
qcampos retitled D80: Order by sha1 the result of the content_archive_get in the archiver db from Archiver db's get of content_archive is now ordered by sha1 to Ordr by sha1 the result of the content_archive_get in the archiver db.
Jul 22 2016, 12:25 PM
qcampos retitled D80: Order by sha1 the result of the content_archive_get in the archiver db from to Archiver db's get of content_archive is now ordered by sha1.
Jul 22 2016, 12:16 PM

Jul 21 2016

qcampos committed rDSTO9451c5f4b83f: Use postgres 9.5's functions for jsonb manipulation (authored by qcampos).
Use postgres 9.5's functions for jsonb manipulation
Jul 21 2016, 11:21 PM
qcampos committed rDSTO5c8085d1785b: Update the archiver for the new db shema (authored by qcampos).
Update the archiver for the new db shema
Jul 21 2016, 11:21 PM
qcampos closed D79: Update the archiver for the new db shema by committing rDSTO5c8085d1785b: Update the archiver for the new db shema.
Jul 21 2016, 11:21 PM
qcampos added inline comments to D79: Update the archiver for the new db shema.
Jul 21 2016, 6:14 PM
qcampos updated the diff for D79: Update the archiver for the new db shema.
  • Do some corrections on the archiver director
Jul 21 2016, 6:13 PM
qcampos updated the diff for D79: Update the archiver for the new db shema.
  • Correct the content_archive_update in order to follow properly its contract
Jul 21 2016, 5:08 PM
qcampos updated the diff for D79: Update the archiver for the new db shema.
In D79#1796, @ardumont wrote:

The jsonb access for the update?

Yes, I used the jsonb_set function to let postgres do the update.

Jul 21 2016, 4:52 PM
qcampos updated the diff for D79: Update the archiver for the new db shema.

Remove string interpolation when constructing the db query

Jul 21 2016, 4:06 PM
qcampos added a comment to D79: Update the archiver for the new db shema.

@ardumont : Submitted a first version for review, but there is still some work to do for the Jsonb access.

Jul 21 2016, 3:47 PM
qcampos retitled D79: Update the archiver for the new db shema from to Update the archiver for the new db shema.
Jul 21 2016, 3:47 PM

Jul 20 2016

qcampos added a revision to T499: Change the swh.storage of the archiver to a swh.objstorage: D78: archiver: change the master's storage to an object storage.
Jul 20 2016, 5:03 PM · Storage manager
qcampos added a task to D78: archiver: change the master's storage to an object storage: T499: Change the swh.storage of the archiver to a swh.objstorage.
Jul 20 2016, 5:03 PM
qcampos created T499: Change the swh.storage of the archiver to a swh.objstorage.
Jul 20 2016, 3:02 PM · Storage manager
qcampos renamed T494: swh-journal: archiver-client: Keep archiver table in sync with new contents from Content_archiver update to Add a way to update content_archive table when a new content is added.
Jul 20 2016, 11:52 AM · Journal, Restricted Project, Storage manager
qcampos renamed T494: swh-journal: archiver-client: Keep archiver table in sync with new contents from Improve storage.content_add function with a way to notify the archival db that a new content have been added to Content_archiver update.
Jul 20 2016, 11:51 AM · Journal, Restricted Project, Storage manager

Jul 19 2016

qcampos added a comment to T494: swh-journal: archiver-client: Keep archiver table in sync with new contents.

Yes, I think we need to split the archival task to separate the first run that ensure we have a copy of each content from the full archiver we will have more time to improve.

Jul 19 2016, 3:13 PM · Journal, Restricted Project, Storage manager

Jul 18 2016

qcampos created T494: swh-journal: archiver-client: Keep archiver table in sync with new contents.
Jul 18 2016, 4:11 PM · Journal, Restricted Project, Storage manager
qcampos abandoned D74: sql/archiver: add the initialization script for the archiver database.
Jul 18 2016, 2:56 PM

Jul 11 2016

qcampos added a comment to T412: Bootstrap archiver's database.
In T412#7853, @ardumont wrote:
  • status is also TEXT and could be replaced with an enum or something
Jul 11 2016, 12:04 PM · Storage manager

Jul 8 2016

qcampos retitled D74: sql/archiver: add the initialization script for the archiver database from to sql/archiver: add the initialization script for the archiver database.
Jul 8 2016, 3:48 PM

Jun 27 2016

qcampos committed rDSTO92e6cd845775: Update debian packaging configuration files (authored by qcampos).
Update debian packaging configuration files
Jun 27 2016, 2:57 PM
qcampos committed rDSTO2cf3a5a3fe2f: Extract http servers common code to swh.objstorage for dependencies (authored by qcampos).
Extract http servers common code to swh.objstorage for dependencies
Jun 27 2016, 2:57 PM
qcampos committed rDSTO3ab3d3dd27f1: Remove objstorage scripts (authored by qcampos).
Remove objstorage scripts
Jun 27 2016, 2:57 PM
qcampos committed rDSTO7a0369f3ddf9: Extract the object storage to its own package and do the required… (authored by qcampos).
Extract the object storage to its own package and do the required…
Jun 27 2016, 2:57 PM
qcampos closed T460: Extract the objstorage component from storage module to an independent module as Resolved by committing rDSTO92e6cd845775: Update debian packaging configuration files.
Jun 27 2016, 2:57 PM · Development environment, Object storage, Storage manager
qcampos closed D64: Extract the object storage to its own package and do the required modifications on the imports by committing rDSTO7a0369f3ddf9: Extract the object storage to its own package and do the required….
Jun 27 2016, 2:57 PM
qcampos updated the diff for D64: Extract the object storage to its own package and do the required modifications on the imports.

Remove an unneeded dependency into the debian/control file

Jun 27 2016, 2:04 PM
qcampos committed rDOBJS78e4f662baf5: Update debian packaging config (authored by qcampos).
Update debian packaging config
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS3effd252a53d: api: Move the http api-related code from storage to objstorage to keep the… (authored by qcampos).
api: Move the http api-related code from storage to objstorage to keep the…
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS601d984e0568: Move the swh.storage.checker module into swh.objstorage.checker as this… (authored by qcampos).
Move the swh.storage.checker module into swh.objstorage.checker as this…
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS89bf2a98d033: imports: correction due to the module extraction (authored by qcampos).
imports: correction due to the module extraction
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS3226739f3e9e: exc: Create a new exception type specific to the object storage. Also, add… (authored by qcampos).
exc: Create a new exception type specific to the object storage. Also, add…
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS8e79ecc58f5f: Import scripts from swh.storage (authored by qcampos).
Import scripts from swh.storage
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS5a145eeccda0: objstorage.multiplexer.filter: Implement the multiplexer filter mecanism (authored by qcampos).
objstorage.multiplexer.filter: Implement the multiplexer filter mecanism
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS38eac8bb167c: objstorage.multiplexer: add tests for the multiplexer object storage (authored by qcampos).
objstorage.multiplexer: add tests for the multiplexer object storage
Jun 27 2016, 1:46 PM
qcampos committed rDOBJSfce4177991af: objstorage.multiplexer.filter: add a way to easily create filter chaining (authored by qcampos).
objstorage.multiplexer.filter: add a way to easily create filter chaining
Jun 27 2016, 1:46 PM
qcampos committed rDOBJSaf20300a3870: objstorage.multiplexer.filter: add tests for the filters implementations (authored by qcampos).
objstorage.multiplexer.filter: add tests for the filters implementations
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS24993f350253: Move tests to the correct location (authored by qcampos).
Move tests to the correct location
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS3ed1894784b1: Move all files to the correct repository swh/objstorage (authored by qcampos).
Move all files to the correct repository swh/objstorage
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS8501d47df55a: Open (and fix) swh.storage.storage.revision_log_by (authored by ardumont).
Open (and fix) swh.storage.storage.revision_log_by
Jun 27 2016, 1:46 PM
qcampos committed rDOBJSa386b9d90ab8: objstorage: move the constant ID_HASH_ALGO to ObjStorage (authored by qcampos).
objstorage: move the constant ID_HASH_ALGO to ObjStorage
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS3b808772841b: objstorage.multiplexer: add some use case example to the… (authored by qcampos).
objstorage.multiplexer: add some use case example to the…
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS802832c36dba: converters: update to reflect decoding logic moved to swh.core.utils (authored by jbertran).
converters: update to reflect decoding logic moved to swh.core.utils
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS662fef2e7175: test_archiver: remove debug prints (authored by olasd).
test_archiver: remove debug prints
Jun 27 2016, 1:46 PM
qcampos committed rDOBJSf99f8197a018: objstorage.multiplexer: Implement the object storage multiplexer (authored by qcampos).
objstorage.multiplexer: Implement the object storage multiplexer
Jun 27 2016, 1:46 PM
qcampos committed rDOBJSafc53da694eb: archiver: change objstorage initialization into the archiver (authored by qcampos).
archiver: change objstorage initialization into the archiver
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS639096443f98: checker: change the objstorage initialization of the checker (authored by qcampos).
checker: change the objstorage initialization of the checker
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS38f3b7eec82f: objstorage.api: Change instantiation of the object storage (authored by qcampos).
objstorage.api: Change instantiation of the object storage
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS43c5cdb25afe: Change the objstorage http server in order to follow the changes of the local… (authored by qcampos).
Change the objstorage http server in order to follow the changes of the local…
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS8aa04719df7c: objstorage: PathslicingObjStorage now allow arbitrary slicing (authored by qcampos).
objstorage: PathslicingObjStorage now allow arbitrary slicing
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS4f8327f43ccf: objstorage: PathslicingObjStorage now allow arbitrary slicing (authored by qcampos).
objstorage: PathslicingObjStorage now allow arbitrary slicing
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS46f6641ed963: objstorage.api: Change instantiation of the object storage (authored by qcampos).
objstorage.api: Change instantiation of the object storage
Jun 27 2016, 1:46 PM
qcampos committed rDOBJSa157a6d47970: Update the content integrity checker in order to follow objstorage changes (authored by qcampos).
Update the content integrity checker in order to follow objstorage changes
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS5f9bc2686a0a: Change the objstorage http server in order to follow the changes of the local… (authored by qcampos).
Change the objstorage http server in order to follow the changes of the local…
Jun 27 2016, 1:46 PM
qcampos committed rDOBJS9deabcbdd67b: Create a base API that define the objstorage behavior (authored by qcampos).
Create a base API that define the objstorage behavior
Jun 27 2016, 1:46 PM
First
Prev
Next
About · Developer information · Legal