Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Mar 25 2019

douardda closed T1405: Make it easy to run a complete swh instance, a subtask of T1413: swh-docker-dev: Refactor/improve provisionning step, as Resolved.
Mar 25 2019, 10:52 AM · Development environment, System administration, Sprint 2018 12
douardda closed T1405: Make it easy to run a complete swh instance as Resolved.

Let's call it done, event if the small dataset part has not been addressed.

Mar 25 2019, 10:52 AM · Docker environment, Sprint 2018 12
douardda closed T1443: Make swh services run within docker and docker-compose, a subtask of T1405: Make it easy to run a complete swh instance, as Resolved.
Mar 25 2019, 10:51 AM · Docker environment, Sprint 2018 12
douardda closed T1443: Make swh services run within docker and docker-compose as Resolved.

Let's call it done, some minor parts may still need a bit of attention thou

Mar 25 2019, 10:51 AM · Docker environment, Sprint 2018 12
douardda updated the task description for T1443: Make swh services run within docker and docker-compose.
Mar 25 2019, 10:50 AM · Docker environment, Sprint 2018 12
douardda closed T1420: Identify easy tasks as Resolved.

Consider this done. Even if remains a background task.

Mar 25 2019, 10:49 AM · Documentation, Sprint 2018 12
douardda updated the task description for T1405: Make it easy to run a complete swh instance.
Mar 25 2019, 10:48 AM · Docker environment, Sprint 2018 12

Mar 22 2019

douardda added inline comments to D1274: api: implement a new /content endpoint that stream the whole content.
Mar 22 2019, 2:38 PM

Mar 21 2019

douardda triaged T1592: Activate gunicorn's statsd monitoring for objstorage services as High priority.
Mar 21 2019, 9:54 AM · System administration
douardda renamed T1592: Activate gunicorn's statsd monitoring for objstorage services from Actiave gunicorn's statsd monitoring for objstorage services to Activate gunicorn's statsd monitoring for objstorage services.
Mar 21 2019, 9:53 AM · System administration
douardda created T1592: Activate gunicorn's statsd monitoring for objstorage services.
Mar 21 2019, 9:53 AM · System administration

Mar 20 2019

douardda committed rDOBJS4c98f983cdeb: cloud: refactor the constructor method to be able to pass any kw to the driver (authored by douardda).
cloud: refactor the constructor method to be able to pass any kw to the driver
Mar 20 2019, 12:17 PM
douardda committed rDOBJS6ff791ce7952: register s3 and swift storage backends (authored by douardda).
register s3 and swift storage backends
Mar 20 2019, 12:17 PM
douardda closed D1271: cloud: refactor the constructor method to be able to pass any kw to the driver.
Mar 20 2019, 12:17 PM
douardda committed rDOBJS039434c41018: api/server: fix the add_stream endpoint (authored by douardda).
api/server: fix the add_stream endpoint
Mar 20 2019, 12:17 PM
douardda committed rDOBJSf8de5851560e: api/server: replace asyncio coroutines by native ones (authored by douardda).
api/server: replace asyncio coroutines by native ones
Mar 20 2019, 12:17 PM
douardda closed D1270: api/server: fix the add_stream endpoint.
Mar 20 2019, 12:17 PM
douardda added inline comments to D1272: tests: refactorings.
Mar 20 2019, 12:16 PM
douardda added a comment to D1275: cloud: add support for compression.

Note that this implementation is a bit naive on the get side: we do uncompress the whole object.

Mar 20 2019, 12:12 PM
douardda added inline comments to D1275: cloud: add support for compression.
Mar 20 2019, 12:08 PM
douardda updated the diff for D1279: Move all backends to a dedicated swh.objstorage.backends sub-package.

rebase

Mar 20 2019, 12:05 PM
douardda updated the diff for D1278: in_memory: implement the get_stream method.

rebase

Mar 20 2019, 12:04 PM
douardda updated the diff for D1277: api/server: insert statsd probes for every API endpoint.

Updated according to comments

Mar 20 2019, 12:04 PM
douardda added a comment to D1277: api/server: insert statsd probes for every API endpoint.
In D1277#27091, @ardumont wrote:

Where are stored those statsd information again?

Mar 20 2019, 12:01 PM
douardda added inline comments to D1277: api/server: insert statsd probes for every API endpoint.
Mar 20 2019, 11:59 AM
douardda added a comment to D1276: Add a seaweedfs backend.
In D1276#27180, @vlorentz wrote:

What happened to get_stream?

Mar 20 2019, 11:15 AM
douardda updated the diff for D1276: Add a seaweedfs backend.

Fix vlorentz's comments

Mar 20 2019, 10:20 AM

Mar 19 2019

douardda added inline comments to D1276: Add a seaweedfs backend.
Mar 19 2019, 3:40 PM
douardda added inline comments to D1276: Add a seaweedfs backend.
Mar 19 2019, 2:37 PM
douardda closed D1257: api/asynchronous: replace ayncio coroutines with native ones.
Mar 19 2019, 1:55 PM
douardda committed rDCORE682f803279c1: api/asynchronous: replace ayncio coroutines with native ones (authored by douardda).
api/asynchronous: replace ayncio coroutines with native ones
Mar 19 2019, 1:55 PM
Herald added a reviewer for D1279: Move all backends to a dedicated swh.objstorage.backends sub-package: Reviewers.
Mar 19 2019, 12:33 PM
Herald added a reviewer for D1278: in_memory: implement the get_stream method: Reviewers.
Mar 19 2019, 12:32 PM
Herald added a reviewer for D1277: api/server: insert statsd probes for every API endpoint: Reviewers.
Mar 19 2019, 12:32 PM
Herald added a reviewer for D1276: Add a seaweedfs backend: Reviewers.
Mar 19 2019, 12:31 PM
Herald added a reviewer for D1275: cloud: add support for compression: Reviewers.
Mar 19 2019, 12:31 PM
Herald added a reviewer for D1274: api: implement a new /content endpoint that stream the whole content: Reviewers.
Mar 19 2019, 12:30 PM
Herald added a reviewer for D1272: tests: refactorings: Reviewers.
Mar 19 2019, 12:13 PM
Herald added a reviewer for D1271: cloud: refactor the constructor method to be able to pass any kw to the driver: Reviewers.
Mar 19 2019, 11:45 AM
Herald added a reviewer for D1270: api/server: fix the add_stream endpoint: Reviewers.
Mar 19 2019, 11:44 AM
douardda committed rDSTO4ed7d0ae0dd6: API: refactor the /directory/ls endpoint (authored by douardda).
API: refactor the /directory/ls endpoint
Mar 19 2019, 11:41 AM
douardda committed rDSTO97981b2f2793: API: simplify a bit the RemoteStorage class (authored by douardda).
API: simplify a bit the RemoteStorage class
Mar 19 2019, 11:41 AM
douardda closed D1268: API: simplify a bit the RemoteStorage class and refactor the /directory/ls endpoint.
Mar 19 2019, 11:41 AM
douardda committed rDJNL3e13e9e6d895: publisher: improve logging (authored by douardda).
publisher: improve logging
Mar 19 2019, 10:51 AM
douardda closed D1264: publisher: improve logging.
Mar 19 2019, 10:51 AM
douardda committed rDCIDXf4af0bf1351e: API: simplify the RemoteStorage implementation (authored by douardda).
API: simplify the RemoteStorage implementation
Mar 19 2019, 10:30 AM
douardda committed rDCIDX762fee5e99d5: requirements: fix dependency name for file-magic (authored by douardda).
requirements: fix dependency name for file-magic
Mar 19 2019, 10:30 AM
douardda closed D1263: API: simplify the RemoteStorage implementation.
Mar 19 2019, 10:30 AM
douardda closed D1262: requirements: fix dependency name for file-magic.
Mar 19 2019, 10:30 AM
Herald added a reviewer for D1268: API: simplify a bit the RemoteStorage class and refactor the /directory/ls endpoint: Reviewers.
Mar 19 2019, 10:29 AM
douardda committed rDSCH4ee93d3a355f: API: use default's APIError exception instead of the SchedulerAPIError (authored by douardda).
API: use default's APIError exception instead of the SchedulerAPIError
Mar 19 2019, 10:20 AM
douardda closed D1265: API: use default's APIError exception instead of the SchedulerAPIError.
Mar 19 2019, 10:20 AM
douardda committed rDVAUb9bac7e86d21: API: use default's APIError exception instead of the VaultAPIError (authored by douardda).
API: use default's APIError exception instead of the VaultAPIError
Mar 19 2019, 10:14 AM
douardda closed D1266: API: use default's APIError exception instead of the VaultAPIError.
Mar 19 2019, 10:14 AM
douardda committed rDCORE8147cd7f54a6: api: kind of fix for the SWHRemoteAPI's contructor (authored by douardda).
api: kind of fix for the SWHRemoteAPI's contructor
Mar 19 2019, 10:13 AM
douardda closed D1261: api: refactor the SWHRemoteAPI's exception class handling.
Mar 19 2019, 10:13 AM
douardda committed rDCORE577e933e9d00: api: refactor the SWHRemoteAPI's exception class handling (authored by douardda).
api: refactor the SWHRemoteAPI's exception class handling
Mar 19 2019, 10:13 AM
douardda closed D1260: api: kind of fix for the SWHRemoteAPI's contructor.
Mar 19 2019, 10:13 AM
douardda committed rDCORE5299aa7514cb: api: factorize SWHRemoteAPI.(get|post)_stream methods (authored by douardda).
api: factorize SWHRemoteAPI.(get|post)_stream methods
Mar 19 2019, 10:13 AM
douardda committed rDCOREbd112a0ae36b: tests: ensure LC_ALL is set to C.UTF-8 for pytest (authored by douardda).
tests: ensure LC_ALL is set to C.UTF-8 for pytest
Mar 19 2019, 10:13 AM
douardda closed D1259: api: factorize SWHRemoteAPI.(get|post)_stream methods.
Mar 19 2019, 10:13 AM
douardda closed D1258: tests: ensure LC_ALL is set to C.UTF-8 for pytest.
Mar 19 2019, 10:13 AM
douardda updated the diff for D1257: api/asynchronous: replace ayncio coroutines with native ones.

rebased

Mar 19 2019, 10:12 AM
douardda updated the diff for D1261: api: refactor the SWHRemoteAPI's exception class handling.

rebased

Mar 19 2019, 10:12 AM
douardda updated the diff for D1260: api: kind of fix for the SWHRemoteAPI's contructor.

rebased

Mar 19 2019, 10:12 AM
douardda updated the diff for D1259: api: factorize SWHRemoteAPI.(get|post)_stream methods.

rebased

Mar 19 2019, 10:11 AM
douardda updated the diff for D1258: tests: ensure LC_ALL is set to C.UTF-8 for pytest.

rebased

Mar 19 2019, 10:11 AM
douardda requested changes to D1197: Deduplicate origin batch scheduling wrt the scheduler..

Just to clarify this options sorting pb. Otherwise ok.

Mar 19 2019, 10:05 AM
douardda accepted D1267: Guesstimate partition boundaries from extrema rather than using expensive offsets.

Should we be worried that tests are green after this diff?

Mar 19 2019, 9:59 AM

Mar 18 2019

Herald added a reviewer for D1266: API: use default's APIError exception instead of the VaultAPIError: Reviewers.
Mar 18 2019, 5:03 PM
Herald added a reviewer for D1265: API: use default's APIError exception instead of the SchedulerAPIError: Reviewers.
Mar 18 2019, 5:02 PM
Herald added a reviewer for D1264: publisher: improve logging: Reviewers.
Mar 18 2019, 4:55 PM
Herald added a reviewer for D1263: API: simplify the RemoteStorage implementation: Reviewers.
Mar 18 2019, 4:48 PM
Herald added a reviewer for D1262: requirements: fix dependency name for file-magic: Reviewers.
Mar 18 2019, 4:48 PM
douardda committed rDCORE45387b7f809e: api/server: fallback to application/json as best mimetype for content nego (authored by douardda).
api/server: fallback to application/json as best mimetype for content nego
Mar 18 2019, 1:51 PM
douardda closed D1256: api/server: fallback to application/json as best mimetype for content nego.
Mar 18 2019, 1:51 PM
douardda committed rDCORE9afcaddfedf9: api: add a SWHRemoteAPI.__repr__() method (authored by douardda).
api: add a SWHRemoteAPI.__repr__() method
Mar 18 2019, 1:51 PM
douardda closed D1255: api: add a SWHRemoteAPI.__repr__() method.
Mar 18 2019, 1:51 PM
Herald added a reviewer for D1261: api: refactor the SWHRemoteAPI's exception class handling: Reviewers.
Mar 18 2019, 10:55 AM
Herald added a reviewer for D1260: api: kind of fix for the SWHRemoteAPI's contructor: Reviewers.
Mar 18 2019, 10:54 AM
Herald added a reviewer for D1259: api: factorize SWHRemoteAPI.(get|post)_stream methods: Reviewers.
Mar 18 2019, 10:54 AM
Herald added a reviewer for D1258: tests: ensure LC_ALL is set to C.UTF-8 for pytest: Reviewers.
Mar 18 2019, 10:54 AM
douardda created D1257: api/asynchronous: replace ayncio coroutines with native ones.
Mar 18 2019, 10:54 AM
Herald added a reviewer for D1256: api/server: fallback to application/json as best mimetype for content nego: Reviewers.
Mar 18 2019, 10:53 AM
Herald added a reviewer for D1255: api: add a SWHRemoteAPI.__repr__() method: Reviewers.
Mar 18 2019, 10:53 AM
douardda committed rDCOREfe6a7c746e9a: gitignore: add .hypothesis (authored by douardda).
gitignore: add .hypothesis
Mar 18 2019, 10:52 AM

Mar 14 2019

douardda accepted D1196: Add an 'swh-scheduler task schedule_origins' command to run a task on all origins..
Mar 14 2019, 4:32 PM
douardda accepted D1236: deposit.cli: Align cli like other modules + update documentation.
Mar 14 2019, 4:32 PM
douardda requested changes to D1196: Add an 'swh-scheduler task schedule_origins' command to run a task on all origins..

typo + I really think this logging statements should not interfere with the test.

Mar 14 2019, 11:31 AM

Mar 12 2019

douardda accepted D1184: swh.deposit.cli: Transform create_user into a main cli (+ docs updates).

Ok to go incrementally like that, but ensure a task/diff making this cli more consistent with other swh commands exists.

Mar 12 2019, 2:30 PM
douardda triaged T1577: Compare/benchmark objstorage backends as Normal priority.
Mar 12 2019, 9:53 AM · Object storage
douardda closed T454: object storage backend that can read from/write to S3 as Resolved.

Unless I'm wrong, this task can be closed now. There is a libcloud-based backend.

Mar 12 2019, 9:48 AM · Storage manager
douardda added a comment to T1447: Add support for slices when getting objects from the objstorage..

Same here. Not that much an easy hack. And what is the real life use case that drive this feature request? YAGNI?

Mar 12 2019, 9:46 AM · Object storage
douardda added a comment to T967: Vault: put_bundle fails on big object sizes..

Is this still an issue?

Mar 12 2019, 9:41 AM · Vault

Mar 8 2019

douardda committed rCDFD6417e87e38e0: readme: make it compliant with phabricator's limited remarkup format (authored by douardda).
readme: make it compliant with phabricator's limited remarkup format
Mar 8 2019, 1:14 PM
douardda committed rCDFDc56678130229: readme: integrate the docker-based development setup from the main's doc (authored by douardda).
readme: integrate the docker-based development setup from the main's doc
Mar 8 2019, 12:53 PM
douardda committed rCDFD8871e9cd32eb: swh-scheduler: add SWH_CONFIG_FILENAME and SWH_SCHEDULER_CONFIG_FILE env vars (authored by douardda).
swh-scheduler: add SWH_CONFIG_FILENAME and SWH_SCHEDULER_CONFIG_FILE env vars
Mar 8 2019, 12:53 PM
douardda committed rCDFDd192c1cde3d7: docker-compose: move the swh-indexer-journal-client in the journal "section" (authored by douardda).
docker-compose: move the swh-indexer-journal-client in the journal "section"
Mar 8 2019, 12:53 PM
douardda closed D1221: readme: integrate the docker-based development setup from the main's doc.
Mar 8 2019, 12:53 PM
douardda updated the diff for D1221: readme: integrate the docker-based development setup from the main's doc.

use remarkup admonition syntax for the preliminary warning

Mar 8 2019, 12:53 PM
First
Prev
Next
About · Developer information · Legal