Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 10 2019

Herald added a reviewer for D1391: swh-web: enforce the database file to be created in either $HOME or /tmp: Reviewers.
Apr 10 2019, 12:23 PM
douardda committed rCDFD8a2458ee2bf0: compose: fix inconsistent dependency (authored by douardda).
compose: fix inconsistent dependency
Apr 10 2019, 12:17 PM

Apr 5 2019

douardda requested changes to D1346: docker-compose: Add journal-backfiller.

I'm not very fond adding this kind of service in the main docker-compose file.
I would prefer a dedicated docker-compose file to be used as an override, eg:

Apr 5 2019, 4:51 PM
douardda committed rCJSWHa8e0f23044e0: templates: increase unit tests timeout to 10mn (authored by douardda).
templates: increase unit tests timeout to 10mn
Apr 5 2019, 3:43 PM
douardda closed D1355: templates: raise unit tests timeout to 10mn.
Apr 5 2019, 3:43 PM
douardda updated the diff for D1355: templates: raise unit tests timeout to 10mn.

reword

Apr 5 2019, 3:24 PM
Herald added a reviewer for D1355: templates: raise unit tests timeout to 10mn: Reviewers.
Apr 5 2019, 3:22 PM
douardda accepted D1352: Fix test_direct_writer to work with the latest version of swh-storage..
Apr 5 2019, 2:50 PM

Apr 2 2019

douardda accepted D1330: Add a draft of 'StorageReplayer', a tool that fills a Storage from Kafka..
Apr 2 2019, 4:02 PM
douardda added inline comments to D1330: Add a draft of 'StorageReplayer', a tool that fills a Storage from Kafka..
Apr 2 2019, 3:53 PM
douardda accepted D1319: Require sphinx < 2, sphinxcontrib_images does not support sphinx 2..
Apr 2 2019, 3:47 PM
douardda added inline comments to D1319: Require sphinx < 2, sphinxcontrib_images does not support sphinx 2..
Apr 2 2019, 2:59 PM
douardda requested changes to D1330: Add a draft of 'StorageReplayer', a tool that fills a Storage from Kafka..
Apr 2 2019, 2:57 PM
douardda added inline comments to D1329: Make snapshot_add take an iterable of snapshot..
Apr 2 2019, 2:31 PM
douardda triaged T1622: Merge (or so) generic phabricator related stuff in a dedicated package between snippets/swh-team and pyarcanist as Wishlist priority.
Apr 2 2019, 2:12 PM · Development environment
douardda closed D1276: Add a seaweedfs backend.

closed by 167aabef25b10299dc2ebf82d0d4a1859b03683f

Apr 2 2019, 2:05 PM
douardda closed D1278: in_memory: implement the get_stream method.

closed by 646f908cdffd12e181faf9d6b94a99f55ff2fd58

Apr 2 2019, 2:05 PM
douardda closed D1279: Move all backends to a dedicated swh.objstorage.backends sub-package.

closed by 7d340ad8b514e95b7c6475fe2de090dd29633efc

Apr 2 2019, 2:04 PM
douardda closed D1277: api/server: insert statsd probes for every API endpoint.

closed by 31e221d5aecc0e259f8831059dfc17883ad44441

Apr 2 2019, 2:04 PM
douardda added inline comments to D1254: Implement a loader for npm.
Apr 2 2019, 12:06 PM · Npm loader, Origin-npm

Apr 1 2019

douardda added a comment to D1319: Require sphinx < 2, sphinxcontrib_images does not support sphinx 2..

Could you please add an issue on sphinxcontrib_images' github?

Apr 1 2019, 11:58 AM
douardda accepted D1283: swh-weekly-report: new helper to write weekly reports.
Apr 1 2019, 11:55 AM
douardda moved T1599: Analyze objstorage's Azure updateness from Backlog to in progress on the Sprint 2019 03 board.
Apr 1 2019, 11:54 AM · Sprint 2019 03

Mar 28 2019

douardda committed rDCOREae19bd9f88b0: statsd: make TimedContextManagerDecorator report errors (authored by douardda).
statsd: make TimedContextManagerDecorator report errors
Mar 28 2019, 11:43 AM
douardda committed rDCORE6da28f6d9b20: api: fix the SWHRemoteAPI.post_stream() method (authored by douardda).
api: fix the SWHRemoteAPI.post_stream() method
Mar 28 2019, 11:43 AM
douardda closed D1297: statsd: make TimedContextManagerDecorator report errors.
Mar 28 2019, 11:43 AM
douardda closed D1296: api: fix the SWHRemoteAPI.post_stream() method.
Mar 28 2019, 11:43 AM
douardda updated the diff for D1297: statsd: make TimedContextManagerDecorator report errors.

Add tests and follow vlorentz' advice

Mar 28 2019, 11:10 AM
douardda added inline comments to D1297: statsd: make TimedContextManagerDecorator report errors.
Mar 28 2019, 11:07 AM
douardda added inline comments to D1297: statsd: make TimedContextManagerDecorator report errors.
Mar 28 2019, 11:01 AM
douardda committed rDOBJS7abf181f5c11: Add a random content generator backend (authored by douardda).
Add a random content generator backend
Mar 28 2019, 10:57 AM
douardda closed D1303: Add a random content generator backend.
Mar 28 2019, 10:57 AM
douardda closed D1301: Move all backends in a dedicated swh.objstorage.backends sub-package.
Mar 28 2019, 10:57 AM
douardda committed rDOBJS7d340ad8b514: Move all backends in a dedicated swh.objstorage.backends sub-package (authored by douardda).
Move all backends in a dedicated swh.objstorage.backends sub-package
Mar 28 2019, 10:57 AM
douardda committed rDOBJS167aabef25b1: Add a seaweedfs backend (authored by douardda).
Add a seaweedfs backend
Mar 28 2019, 10:57 AM
douardda closed D1298: Add a seaweedfs backend.
Mar 28 2019, 10:57 AM
douardda updated the diff for D1303: Add a random content generator backend.

rebased

Mar 28 2019, 10:28 AM
douardda updated the diff for D1301: Move all backends in a dedicated swh.objstorage.backends sub-package.

rebased

Mar 28 2019, 10:28 AM
douardda updated the diff for D1298: Add a seaweedfs backend.

Add a big bad TODO

Mar 28 2019, 10:27 AM
douardda added a comment to D1298: Add a seaweedfs backend.
In D1298#27999, @olasd wrote:

Sorry for going for another loop, but that's still missing error checking on get/put/delete methods of the WeedFiler: these methods will return truthy values even when the server responds (properly) with an error condition and has failed to comply.

Mar 28 2019, 9:57 AM
douardda accepted D1311: storage: Add a timed decorator to count calls and time it.

Just remove the statsd.increment() and we should be good...

Mar 28 2019, 9:53 AM
douardda requested changes to D1283: swh-weekly-report: new helper to write weekly reports.

Why is the monthly-report script also in this diff?

Mar 28 2019, 9:47 AM
douardda accepted D1286: swh-monthly-report: helper script to draft monthly activity team reports.

I don't like those hard coded queryKey values, but as you said, it's a starting point.

Mar 28 2019, 9:34 AM
douardda accepted D1312: Dockerfile: Install ngrep in swh/base image.
Mar 28 2019, 9:30 AM
douardda accepted D1197: Deduplicate origin batch scheduling wrt the scheduler..
Mar 28 2019, 9:30 AM

Mar 27 2019

douardda added a comment to D1298: Add a seaweedfs backend.
In D1298#27999, @olasd wrote:

Sorry for going for another loop

Mar 27 2019, 4:37 PM
douardda updated the diff for D1303: Add a random content generator backend.

Forgot the comment about a min size

Mar 27 2019, 4:34 PM
douardda updated the diff for D1303: Add a random content generator backend.

refactor a bit according to vlorentz' comments and add a few tests

Mar 27 2019, 4:25 PM
douardda added inline comments to D1303: Add a random content generator backend.
Mar 27 2019, 3:54 PM
douardda committed rDOBJSb7e13a056c83: api: upgrade the server implementation to aiohttp 3 (authored by douardda).
api: upgrade the server implementation to aiohttp 3
Mar 27 2019, 3:11 PM
douardda closed D1302: api: upgrade the server implementation to aiohttp 3.
Mar 27 2019, 3:11 PM
douardda updated the diff for D1302: api: upgrade the server implementation to aiohttp 3.

rebased

Mar 27 2019, 3:11 PM
douardda committed rDOBJS646f908cdffd: in_memory: implement the get_stream method (authored by douardda).
in_memory: implement the get_stream method
Mar 27 2019, 3:09 PM
douardda closed D1300: in_memory: implement the get_stream method.
Mar 27 2019, 3:09 PM
douardda closed D1299: api/server: insert statsd probes for every API endpoint.
Mar 27 2019, 3:09 PM
douardda committed rDOBJS31e221d5aecc: api/server: insert statsd probes for every API endpoint (authored by douardda).
api/server: insert statsd probes for every API endpoint
Mar 27 2019, 3:09 PM
douardda updated the diff for D1298: Add a seaweedfs backend.

rebased

Mar 27 2019, 3:09 PM
douardda updated the diff for D1300: in_memory: implement the get_stream method.

rebased

Mar 27 2019, 3:08 PM
douardda updated the diff for D1299: api/server: insert statsd probes for every API endpoint.

rebased

Mar 27 2019, 3:07 PM
douardda added a comment to D1299: api/server: insert statsd probes for every API endpoint.

Duplicate of D1277

Mar 27 2019, 3:06 PM
douardda updated the diff for D1298: Add a seaweedfs backend.

fix path handling

Mar 27 2019, 3:03 PM
douardda updated the diff for D1298: Add a seaweedfs backend.

Add tests and (consequently) few fixes

Mar 27 2019, 2:53 PM
douardda committed rDOBJS0a3a712cf9a0: cloud: add support for compression (authored by douardda).
cloud: add support for compression
Mar 27 2019, 12:25 PM
douardda closed D1275: cloud: add support for compression.
Mar 27 2019, 12:25 PM
douardda committed rDOBJS45f21e54f978: pathslicer: implement a better list_content method (authored by douardda).
pathslicer: implement a better list_content method
Mar 27 2019, 12:25 PM
douardda committed rDOBJS4d9976e9a743: Add an ObjStorage.list_content() method (authored by douardda).
Add an ObjStorage.list_content() method
Mar 27 2019, 12:25 PM
douardda committed rDOBJSf909f4646c62: Add a DEFAULT_LIMIT global value for the limit argument of list_content() (authored by douardda).
Add a DEFAULT_LIMIT global value for the limit argument of list_content()
Mar 27 2019, 12:25 PM
douardda committed rDOBJS1bda79435c83: api: refactor the SWHRemoteClient so it does not inherit from ObjStorage nor… (authored by douardda).
api: refactor the SWHRemoteClient so it does not inherit from ObjStorage nor…
Mar 27 2019, 12:25 PM
douardda closed D1274: api: implement a new /content endpoint that stream the whole content.
Mar 27 2019, 12:25 PM
douardda updated the diff for D1275: cloud: add support for compression.

rebase

Mar 27 2019, 12:25 PM
douardda updated the diff for D1274: api: implement a new /content endpoint that stream the whole content.

rework the commit message

Mar 27 2019, 12:24 PM
douardda closed D1304: tests: use get_objstorage function instead of directly instanciating the class.

closed by 12012d6bb8783375073130d8b71d80c0ae3b69a5

Mar 27 2019, 12:21 PM
douardda committed rDCIDX12012d6bb878: tests: use get_objstorage function instead of directly instanciating the class (authored by douardda).
tests: use get_objstorage function instead of directly instanciating the class
Mar 27 2019, 12:19 PM
douardda updated the diff for D1304: tests: use get_objstorage function instead of directly instanciating the class.

forgot a part of the diff

Mar 27 2019, 11:57 AM
Herald added a reviewer for D1304: tests: use get_objstorage function instead of directly instanciating the class: Reviewers.
Mar 27 2019, 11:46 AM
Herald added a reviewer for D1303: Add a random content generator backend: Reviewers.
Mar 27 2019, 11:29 AM
Herald added a reviewer for D1302: api: upgrade the server implementation to aiohttp 3: Reviewers.
Mar 27 2019, 11:29 AM
Herald added a reviewer for D1301: Move all backends in a dedicated swh.objstorage.backends sub-package: Reviewers.
Mar 27 2019, 11:29 AM
Herald added a reviewer for D1300: in_memory: implement the get_stream method: Reviewers.
Mar 27 2019, 11:26 AM
Herald added a reviewer for D1299: api/server: insert statsd probes for every API endpoint: Reviewers.
Mar 27 2019, 11:25 AM
Herald added a reviewer for D1298: Add a seaweedfs backend: Reviewers.
Mar 27 2019, 11:25 AM
douardda updated the diff for D1275: cloud: add support for compression.

updated, remove smart stuff and add some tests

Mar 27 2019, 11:24 AM
douardda updated the diff for D1274: api: implement a new /content endpoint that stream the whole content.

Many fixes, folded several revisions

Mar 27 2019, 10:59 AM
douardda committed rDOBJS771152280352: tests: small refactorings (authored by douardda).
tests: small refactorings
Mar 27 2019, 10:57 AM
douardda committed rDOBJS9b29b475898e: tests: improve a bit the test_get_stream test (authored by douardda).
tests: improve a bit the test_get_stream test
Mar 27 2019, 10:57 AM
douardda committed rDOBJS584449c0971d: tests: skip deletion related tests for the remote api (authored by douardda).
tests: skip deletion related tests for the remote api
Mar 27 2019, 10:57 AM
douardda closed D1272: tests: refactorings.
Mar 27 2019, 10:57 AM
douardda updated the diff for D1272: tests: refactorings.

use pytest.mark.skip as suggested by vlorentz

Mar 27 2019, 10:56 AM
Herald added a reviewer for D1297: statsd: make TimedContextManagerDecorator report errors: Reviewers.
Mar 27 2019, 10:51 AM
Herald added a reviewer for D1296: api: fix the SWHRemoteAPI.post_stream() method: Reviewers.
Mar 27 2019, 10:50 AM

Mar 25 2019

douardda created T1604: Improve kafka deployment.
Mar 25 2019, 11:32 AM · System administration, Sprint 2019 03
douardda created T1603: kafka storage backfiller.
Mar 25 2019, 11:31 AM · Journal, Sprint 2019 03
douardda created T1602: Analyze kakfa storage requirements.
Mar 25 2019, 11:31 AM · Sprint 2019 03
douardda added a comment to T1601: Journal client of swh-storage mirrors.

conflict policy -> update

Mar 25 2019, 11:30 AM · Sprint 2019 03
douardda created T1601: Journal client of swh-storage mirrors.
Mar 25 2019, 11:29 AM · Sprint 2019 03
douardda created T1600: Write a storage backend that writes to kafka.
Mar 25 2019, 11:28 AM · Sprint 2019 03
douardda created T1599: Analyze objstorage's Azure updateness.
Mar 25 2019, 11:27 AM · Sprint 2019 03
douardda triaged T1598: Add stasd probes in swh-storage as Normal priority.
Mar 25 2019, 11:26 AM · Sprint 2019 03
douardda renamed Sprint 2019 03 from Spint 2019 03 to Sprint 2019 03.
Mar 25 2019, 11:25 AM
douardda changed the edit policy for Sprint 2019 03.
Mar 25 2019, 10:55 AM