Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 6 2019

douardda closed D1918: statsd: protect access to the statsd's socket.
Sep 6 2019, 11:18 AM
douardda updated the diff for D1918: statsd: protect access to the statsd's socket.

rebase

Sep 6 2019, 11:13 AM
douardda committed rDCORE11f07f271245: tests: add tests for swh.logger and swh.tarball modules (authored by douardda).
tests: add tests for swh.logger and swh.tarball modules
Sep 6 2019, 11:12 AM
douardda closed D1962: tests: add tests for swh.logger and swh.tarball modules.
Sep 6 2019, 11:12 AM

Sep 5 2019

douardda committed rDDEPc40f076851f6: setup: register the worker task in the swh.workers entrypoint (authored by douardda).
setup: register the worker task in the swh.workers entrypoint
Sep 5 2019, 4:57 PM
douardda closed D1960: setup: register the worker task in the swh.workers entrypoint.
Sep 5 2019, 4:57 PM
douardda committed rDLS780c0ef999e4: lister/base: remove the reference to the storage from ListerBase (authored by douardda).
lister/base: remove the reference to the storage from ListerBase
Sep 5 2019, 4:57 PM
douardda closed D1961: lister/base: remove the reference to the storage from ListerBase.
Sep 5 2019, 4:57 PM
douardda updated the diff for D1962: tests: add tests for swh.logger and swh.tarball modules.

maybe fix te other test

Sep 5 2019, 4:49 PM
douardda updated the diff for D1962: tests: add tests for swh.logger and swh.tarball modules.

maybe fix one test

Sep 5 2019, 4:47 PM
Herald added a reviewer for D1962: tests: add tests for swh.logger and swh.tarball modules: Reviewers.
Sep 5 2019, 4:33 PM
douardda added a comment to D1959: Publish origin_intrinsic_metadata to Kafka..
In D1959#45436, @olasd wrote:

I think this approach is perfectly fine.

We can just configure this topic to be under another hierarchy (e.g. swh.journal.metadata. instead of swh.journal.objects.) so it doesn't interfere with the mirroring infrastructure.

Sep 5 2019, 11:35 AM
Herald added a reviewer for D1961: lister/base: remove the reference to the storage from ListerBase: Reviewers.
Sep 5 2019, 10:41 AM
Herald added a reviewer for D1960: setup: register the worker task in the swh.workers entrypoint: Reviewers.
Sep 5 2019, 9:52 AM
douardda updated the diff for D1918: statsd: protect access to the statsd's socket.

update tests, as pointed out by olasd

Sep 5 2019, 9:45 AM
douardda added a comment to D1918: statsd: protect access to the statsd's socket.

with no obvious improvement.

It removes the need for a lock and a property.

Sep 5 2019, 9:38 AM

Sep 4 2019

douardda committed rDLSb810876ef827: tasks: normalize the url argument name of most lister (authored by douardda).
tasks: normalize the url argument name of most lister
Sep 4 2019, 4:46 PM
douardda closed D1950: tasks: normalize the url argument name of most lister.
Sep 4 2019, 4:46 PM
douardda committed rDLS631b8e7668a5: models: use the same declarative base class for all models (authored by douardda).
models: use the same declarative base class for all models
Sep 4 2019, 4:43 PM
douardda closed D1949: models: use the same declarative base class for all models.
Sep 4 2019, 4:43 PM
douardda committed rDLSbd1183032859: cgit: reduce the batch size to 10 and add a bit of logging (authored by douardda).
cgit: reduce the batch size to 10 and add a bit of logging
Sep 4 2019, 4:41 PM
douardda closed D1947: cgit: reduce the batch size to 10 and add a bit of logging.
Sep 4 2019, 4:41 PM
douardda committed rDLS8d9deeb8f800: plugins: add support for scheduler's task-type declaration (authored by douardda).
plugins: add support for scheduler's task-type declaration
Sep 4 2019, 4:37 PM
douardda closed D1940: plugins: add support for scheduler's task-type declaration.
Sep 4 2019, 4:37 PM
douardda committed rDSCHa64ac3fe9fec: sql: stop inserting lister tasks at scheduler's creation time (authored by douardda).
sql: stop inserting lister tasks at scheduler's creation time
Sep 4 2019, 4:07 PM
douardda closed D1957: sql: stop inserting lister tasks at scheduler's creation time.
Sep 4 2019, 4:07 PM
Herald added a reviewer for D1957: sql: stop inserting lister tasks at scheduler's creation time: Reviewers.
Sep 4 2019, 3:55 PM
douardda updated the diff for D1950: tasks: normalize the url argument name of most lister.

rebase

Sep 4 2019, 3:44 PM
douardda updated the diff for D1949: models: use the same declarative base class for all models.

rebase

Sep 4 2019, 3:44 PM
douardda updated the diff for D1947: cgit: reduce the batch size to 10 and add a bit of logging.

rebase

Sep 4 2019, 3:43 PM
douardda updated the summary of D1950: tasks: normalize the url argument name of most lister.
Sep 4 2019, 3:42 PM
douardda updated the summary of D1947: cgit: reduce the batch size to 10 and add a bit of logging.
Sep 4 2019, 3:42 PM
douardda updated the diff for D1940: plugins: add support for scheduler's task-type declaration.

Add tests, and (as a consequence) a fix

Sep 4 2019, 3:39 PM
douardda committed rDLSe3c0ea9d9002: implement listers as plugins (authored by douardda).
implement listers as plugins
Sep 4 2019, 2:41 PM
douardda closed D1504: implement listers as plugins.
Sep 4 2019, 2:41 PM
douardda updated the summary of D1947: cgit: reduce the batch size to 10 and add a bit of logging.
Sep 4 2019, 2:38 PM
douardda updated the diff for D1950: tasks: normalize the url argument name of most lister.

change of plan: use 'url' argument everywhere

Sep 4 2019, 2:38 PM
Herald added a reviewer for D1950: tasks: normalize the url argument name of most lister: Reviewers.
Sep 4 2019, 11:53 AM
Herald added a reviewer for D1949: models: use the same declarative base class for all models: Reviewers.
Sep 4 2019, 11:53 AM
Herald added a reviewer for D1947: cgit: reduce the batch size to 10 and add a bit of logging: Reviewers.
Sep 4 2019, 11:52 AM
douardda updated the diff for D1940: plugins: add support for scheduler's task-type declaration.

refactor a bit the ensure_task_type function and write a docstring

Sep 4 2019, 11:51 AM
douardda updated the diff for D1940: plugins: add support for scheduler's task-type declaration.

attempt to answer ardumont and vlorents queries/comments

Sep 4 2019, 11:02 AM

Sep 3 2019

douardda added inline comments to D1940: plugins: add support for scheduler's task-type declaration.
Sep 3 2019, 4:02 PM
douardda added inline comments to D1940: plugins: add support for scheduler's task-type declaration.
Sep 3 2019, 3:58 PM
Herald added a reviewer for D1940: plugins: add support for scheduler's task-type declaration: Reviewers.
Sep 3 2019, 3:15 PM
douardda added a comment to D1504: implement listers as plugins.

The ci is unhappy though.

I'm not sure why... oh might be because of the needed changes in the scheduler part... (the diff this diff depends on or something).

Sep 3 2019, 3:12 PM
douardda committed rDLSc67a926f266a: npm: make NpmVisitModel use the main declarative base class from core.models (authored by douardda).
npm: make NpmVisitModel use the main declarative base class from core.models
Sep 3 2019, 3:11 PM
douardda committed rDLS342964eda77c: phabricator: fix the FullPhabricatorLister task (authored by douardda).
phabricator: fix the FullPhabricatorLister task
Sep 3 2019, 3:11 PM
douardda committed rDLS8785fc1a4e78: cgit: fix cgit's task module and tests (authored by douardda).
cgit: fix cgit's task module and tests
Sep 3 2019, 3:11 PM
douardda closed D1939: Several fixes in npm, cgit and phab listers.
Sep 3 2019, 3:11 PM
douardda updated the diff for D1504: implement listers as plugins.

rebase + better ci msg + improve config handling in cli.py

Sep 3 2019, 3:08 PM
douardda updated the diff for D1939: Several fixes in npm, cgit and phab listers.

Fix cli.py for test_cli to pass (phabricator)

Sep 3 2019, 3:04 PM
Herald added a reviewer for D1939: Several fixes in npm, cgit and phab listers: Reviewers.
Sep 3 2019, 12:03 PM

Sep 2 2019

douardda committed rDSCHc3fae1572fb2: celery: auto add tasks declared in the swh.workers entry point in task_modules (authored by douardda).
celery: auto add tasks declared in the swh.workers entry point in task_modules
Sep 2 2019, 1:40 PM
douardda closed D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.
Sep 2 2019, 1:40 PM
douardda updated the diff for D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.

Use task_modules (a list) as registry entry

Sep 2 2019, 1:35 PM
douardda updated the diff for D1504: implement listers as plugins.

rebase and better commit message

Sep 2 2019, 1:30 PM
douardda committed rDLS87cec2f5c39e: phabricator: refactor PhabricatorLister's constructor (authored by douardda).
phabricator: refactor PhabricatorLister's constructor
Sep 2 2019, 1:17 PM
douardda closed D1934: phabricator: refactor PhabricatorLister's constructor.
Sep 2 2019, 1:17 PM
douardda committed rDLSbefe9a6d573b: gitlab: make GitLabLister's api_baseurl init argument optional (authored by douardda).
gitlab: make GitLabLister's api_baseurl init argument optional
Sep 2 2019, 1:17 PM
douardda committed rDLSb87cd5d3093d: github: make GitHubLister's api_baseurl init argument optional (authored by douardda).
github: make GitHubLister's api_baseurl init argument optional
Sep 2 2019, 1:17 PM
douardda closed D1933: gitlab: make GitLabLister's api_baseurl init argument optional.
Sep 2 2019, 1:17 PM
douardda closed D1932: github: make GitHubLister's api_baseurl init argument optional.
Sep 2 2019, 1:17 PM
douardda committed rDLS8950b0b32dfd: bitbucket: make BitBucketLister's api_baseurl init argument optional (authored by douardda).
bitbucket: make BitBucketLister's api_baseurl init argument optional
Sep 2 2019, 1:17 PM
douardda closed D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional.
Sep 2 2019, 1:17 PM
douardda committed rDLS22f2f2c43c5d: core: make it possible to specify the api_baseurl init argument in… (authored by douardda).
core: make it possible to specify the api_baseurl init argument in…
Sep 2 2019, 1:17 PM
douardda closed D1930: core: make it possible to specify the api_baseurl init argument in override_config.
Sep 2 2019, 1:17 PM
douardda updated the diff for D1934: phabricator: refactor PhabricatorLister's constructor.

rebase

Sep 2 2019, 1:16 PM
douardda updated the diff for D1933: gitlab: make GitLabLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 1:16 PM
douardda updated the diff for D1932: github: make GitHubLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 1:16 PM
douardda updated the diff for D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 1:15 PM
douardda updated the diff for D1930: core: make it possible to specify the api_baseurl init argument in override_config.

rebase

Sep 2 2019, 1:15 PM
douardda committed rDLS3816b4d3bf9c: cgit: rewrite the CGit lister (authored by douardda).
cgit: rewrite the CGit lister
Sep 2 2019, 1:14 PM
douardda closed D1929: cgit: rewrite the CGit lister.
Sep 2 2019, 1:14 PM
douardda updated the diff for D1929: cgit: rewrite the CGit lister.

typo in the docstring

Sep 2 2019, 12:30 PM
douardda added inline comments to D1929: cgit: rewrite the CGit lister.
Sep 2 2019, 12:20 PM
douardda updated the diff for D1934: phabricator: refactor PhabricatorLister's constructor.

rebase

Sep 2 2019, 12:16 PM
douardda updated the diff for D1933: gitlab: make GitLabLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 12:15 PM
douardda updated the diff for D1932: github: make GitHubLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 12:15 PM
douardda updated the diff for D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 12:15 PM
douardda updated the diff for D1930: core: make it possible to specify the api_baseurl init argument in override_config.

rebase

Sep 2 2019, 12:14 PM
douardda updated the diff for D1929: cgit: rewrite the CGit lister.

Add some docstring and ensure tests pass ok

Sep 2 2019, 12:13 PM
douardda added inline comments to D1929: cgit: rewrite the CGit lister.
Sep 2 2019, 10:58 AM
douardda added a comment to D1929: cgit: rewrite the CGit lister.

Don't this need a rebase (to make jenkins happy)?
The jenkins failure seems to be out of its depth.

Sep 2 2019, 10:56 AM
douardda added a comment to T1974: Document low-level storage layers.

Few comments:

Sep 2 2019, 10:51 AM · Documentation
douardda committed rDLSe0ce68377de0: bitbucket: simplify a bit BitBucketLister's constructor (authored by douardda).
bitbucket: simplify a bit BitBucketLister's constructor
Sep 2 2019, 10:05 AM
douardda closed D1928: bitbucket: simplify a bit BitBucketLister's constructor.
Sep 2 2019, 10:05 AM
douardda closed D1927: phabricator: randomly select the API token in the provided list.
Sep 2 2019, 10:05 AM
douardda committed rDLS814779404ccb: phabricator: small refactoring/simplification of the request_params method (authored by douardda).
phabricator: small refactoring/simplification of the request_params method
Sep 2 2019, 10:05 AM
douardda committed rDLSd807d15f65e7: phabricator: randomly select the API token in the provided list (authored by douardda).
phabricator: randomly select the API token in the provided list
Sep 2 2019, 10:05 AM
douardda committed rDLS83d138759ce8: phabricator: kill PhabricatorLister's api_token argument (authored by douardda).
phabricator: kill PhabricatorLister's api_token argument
Sep 2 2019, 10:05 AM
douardda closed D1926: phabricator: small refactoring/simplification of the request_params method.
Sep 2 2019, 10:05 AM
douardda committed rDLS6f56d2c8d72d: core: move credentials' docstring from request_params to… (authored by douardda).
core: move credentials' docstring from request_params to…
Sep 2 2019, 10:05 AM
douardda closed D1925: phabricator: kill PhabricatorLister's api_token argument.
Sep 2 2019, 10:05 AM
douardda closed D1924: core: move credentials' docstring from request_params to request_instance_credentials.
Sep 2 2019, 10:05 AM

Aug 30 2019

douardda triaged T1978: Simplify listers's db model as Low priority.
Aug 30 2019, 6:12 PM · Lister
douardda updated the diff for D1504: implement listers as plugins.

rebase and small fixes

Aug 30 2019, 6:05 PM
Herald added a reviewer for D1934: phabricator: refactor PhabricatorLister's constructor: Reviewers.
Aug 30 2019, 6:05 PM
Herald added a reviewer for D1933: gitlab: make GitLabLister's api_baseurl init argument optional: Reviewers.
Aug 30 2019, 6:04 PM
Herald added a reviewer for D1932: github: make GitHubLister's api_baseurl init argument optional: Reviewers.
Aug 30 2019, 6:04 PM