Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 4 2019

douardda closed D1947: cgit: reduce the batch size to 10 and add a bit of logging.
Sep 4 2019, 4:41 PM
douardda committed rDLS8d9deeb8f800: plugins: add support for scheduler's task-type declaration (authored by douardda).
plugins: add support for scheduler's task-type declaration
Sep 4 2019, 4:37 PM
douardda closed D1940: plugins: add support for scheduler's task-type declaration.
Sep 4 2019, 4:37 PM
douardda committed rDSCHa64ac3fe9fec: sql: stop inserting lister tasks at scheduler's creation time (authored by douardda).
sql: stop inserting lister tasks at scheduler's creation time
Sep 4 2019, 4:07 PM
douardda closed D1957: sql: stop inserting lister tasks at scheduler's creation time.
Sep 4 2019, 4:07 PM
Herald added a reviewer for D1957: sql: stop inserting lister tasks at scheduler's creation time: Reviewers.
Sep 4 2019, 3:55 PM
douardda updated the diff for D1950: tasks: normalize the url argument name of most lister.

rebase

Sep 4 2019, 3:44 PM
douardda updated the diff for D1949: models: use the same declarative base class for all models.

rebase

Sep 4 2019, 3:44 PM
douardda updated the diff for D1947: cgit: reduce the batch size to 10 and add a bit of logging.

rebase

Sep 4 2019, 3:43 PM
douardda updated the summary of D1950: tasks: normalize the url argument name of most lister.
Sep 4 2019, 3:42 PM
douardda updated the summary of D1947: cgit: reduce the batch size to 10 and add a bit of logging.
Sep 4 2019, 3:42 PM
douardda updated the diff for D1940: plugins: add support for scheduler's task-type declaration.

Add tests, and (as a consequence) a fix

Sep 4 2019, 3:39 PM
douardda committed rDLSe3c0ea9d9002: implement listers as plugins (authored by douardda).
implement listers as plugins
Sep 4 2019, 2:41 PM
douardda closed D1504: implement listers as plugins.
Sep 4 2019, 2:41 PM
douardda updated the summary of D1947: cgit: reduce the batch size to 10 and add a bit of logging.
Sep 4 2019, 2:38 PM
douardda updated the diff for D1950: tasks: normalize the url argument name of most lister.

change of plan: use 'url' argument everywhere

Sep 4 2019, 2:38 PM
Herald added a reviewer for D1950: tasks: normalize the url argument name of most lister: Reviewers.
Sep 4 2019, 11:53 AM
Herald added a reviewer for D1949: models: use the same declarative base class for all models: Reviewers.
Sep 4 2019, 11:53 AM
Herald added a reviewer for D1947: cgit: reduce the batch size to 10 and add a bit of logging: Reviewers.
Sep 4 2019, 11:52 AM
douardda updated the diff for D1940: plugins: add support for scheduler's task-type declaration.

refactor a bit the ensure_task_type function and write a docstring

Sep 4 2019, 11:51 AM
douardda updated the diff for D1940: plugins: add support for scheduler's task-type declaration.

attempt to answer ardumont and vlorents queries/comments

Sep 4 2019, 11:02 AM

Sep 3 2019

douardda added inline comments to D1940: plugins: add support for scheduler's task-type declaration.
Sep 3 2019, 4:02 PM
douardda added inline comments to D1940: plugins: add support for scheduler's task-type declaration.
Sep 3 2019, 3:58 PM
Herald added a reviewer for D1940: plugins: add support for scheduler's task-type declaration: Reviewers.
Sep 3 2019, 3:15 PM
douardda added a comment to D1504: implement listers as plugins.

The ci is unhappy though.

I'm not sure why... oh might be because of the needed changes in the scheduler part... (the diff this diff depends on or something).

Sep 3 2019, 3:12 PM
douardda committed rDLSc67a926f266a: npm: make NpmVisitModel use the main declarative base class from core.models (authored by douardda).
npm: make NpmVisitModel use the main declarative base class from core.models
Sep 3 2019, 3:11 PM
douardda committed rDLS342964eda77c: phabricator: fix the FullPhabricatorLister task (authored by douardda).
phabricator: fix the FullPhabricatorLister task
Sep 3 2019, 3:11 PM
douardda committed rDLS8785fc1a4e78: cgit: fix cgit's task module and tests (authored by douardda).
cgit: fix cgit's task module and tests
Sep 3 2019, 3:11 PM
douardda closed D1939: Several fixes in npm, cgit and phab listers.
Sep 3 2019, 3:11 PM
douardda updated the diff for D1504: implement listers as plugins.

rebase + better ci msg + improve config handling in cli.py

Sep 3 2019, 3:08 PM
douardda updated the diff for D1939: Several fixes in npm, cgit and phab listers.

Fix cli.py for test_cli to pass (phabricator)

Sep 3 2019, 3:04 PM
Herald added a reviewer for D1939: Several fixes in npm, cgit and phab listers: Reviewers.
Sep 3 2019, 12:03 PM

Sep 2 2019

douardda committed rDSCHc3fae1572fb2: celery: auto add tasks declared in the swh.workers entry point in task_modules (authored by douardda).
celery: auto add tasks declared in the swh.workers entry point in task_modules
Sep 2 2019, 1:40 PM
douardda closed D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.
Sep 2 2019, 1:40 PM
douardda updated the diff for D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.

Use task_modules (a list) as registry entry

Sep 2 2019, 1:35 PM
douardda updated the diff for D1504: implement listers as plugins.

rebase and better commit message

Sep 2 2019, 1:30 PM
douardda committed rDLS87cec2f5c39e: phabricator: refactor PhabricatorLister's constructor (authored by douardda).
phabricator: refactor PhabricatorLister's constructor
Sep 2 2019, 1:17 PM
douardda closed D1934: phabricator: refactor PhabricatorLister's constructor.
Sep 2 2019, 1:17 PM
douardda committed rDLSbefe9a6d573b: gitlab: make GitLabLister's api_baseurl init argument optional (authored by douardda).
gitlab: make GitLabLister's api_baseurl init argument optional
Sep 2 2019, 1:17 PM
douardda committed rDLSb87cd5d3093d: github: make GitHubLister's api_baseurl init argument optional (authored by douardda).
github: make GitHubLister's api_baseurl init argument optional
Sep 2 2019, 1:17 PM
douardda closed D1933: gitlab: make GitLabLister's api_baseurl init argument optional.
Sep 2 2019, 1:17 PM
douardda closed D1932: github: make GitHubLister's api_baseurl init argument optional.
Sep 2 2019, 1:17 PM
douardda committed rDLS8950b0b32dfd: bitbucket: make BitBucketLister's api_baseurl init argument optional (authored by douardda).
bitbucket: make BitBucketLister's api_baseurl init argument optional
Sep 2 2019, 1:17 PM
douardda closed D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional.
Sep 2 2019, 1:17 PM
douardda committed rDLS22f2f2c43c5d: core: make it possible to specify the api_baseurl init argument in… (authored by douardda).
core: make it possible to specify the api_baseurl init argument in…
Sep 2 2019, 1:17 PM
douardda closed D1930: core: make it possible to specify the api_baseurl init argument in override_config.
Sep 2 2019, 1:17 PM
douardda updated the diff for D1934: phabricator: refactor PhabricatorLister's constructor.

rebase

Sep 2 2019, 1:16 PM
douardda updated the diff for D1933: gitlab: make GitLabLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 1:16 PM
douardda updated the diff for D1932: github: make GitHubLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 1:16 PM
douardda updated the diff for D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 1:15 PM
douardda updated the diff for D1930: core: make it possible to specify the api_baseurl init argument in override_config.

rebase

Sep 2 2019, 1:15 PM
douardda committed rDLS3816b4d3bf9c: cgit: rewrite the CGit lister (authored by douardda).
cgit: rewrite the CGit lister
Sep 2 2019, 1:14 PM
douardda closed D1929: cgit: rewrite the CGit lister.
Sep 2 2019, 1:14 PM
douardda updated the diff for D1929: cgit: rewrite the CGit lister.

typo in the docstring

Sep 2 2019, 12:30 PM
douardda added inline comments to D1929: cgit: rewrite the CGit lister.
Sep 2 2019, 12:20 PM
douardda updated the diff for D1934: phabricator: refactor PhabricatorLister's constructor.

rebase

Sep 2 2019, 12:16 PM
douardda updated the diff for D1933: gitlab: make GitLabLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 12:15 PM
douardda updated the diff for D1932: github: make GitHubLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 12:15 PM
douardda updated the diff for D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional.

rebase

Sep 2 2019, 12:15 PM
douardda updated the diff for D1930: core: make it possible to specify the api_baseurl init argument in override_config.

rebase

Sep 2 2019, 12:14 PM
douardda updated the diff for D1929: cgit: rewrite the CGit lister.

Add some docstring and ensure tests pass ok

Sep 2 2019, 12:13 PM
douardda added inline comments to D1929: cgit: rewrite the CGit lister.
Sep 2 2019, 10:58 AM
douardda added a comment to D1929: cgit: rewrite the CGit lister.

Don't this need a rebase (to make jenkins happy)?
The jenkins failure seems to be out of its depth.

Sep 2 2019, 10:56 AM
douardda added a comment to T1974: Document low-level storage layers.

Few comments:

Sep 2 2019, 10:51 AM · Documentation
douardda committed rDLSe0ce68377de0: bitbucket: simplify a bit BitBucketLister's constructor (authored by douardda).
bitbucket: simplify a bit BitBucketLister's constructor
Sep 2 2019, 10:05 AM
douardda closed D1928: bitbucket: simplify a bit BitBucketLister's constructor.
Sep 2 2019, 10:05 AM
douardda closed D1927: phabricator: randomly select the API token in the provided list.
Sep 2 2019, 10:05 AM
douardda committed rDLS814779404ccb: phabricator: small refactoring/simplification of the request_params method (authored by douardda).
phabricator: small refactoring/simplification of the request_params method
Sep 2 2019, 10:05 AM
douardda committed rDLSd807d15f65e7: phabricator: randomly select the API token in the provided list (authored by douardda).
phabricator: randomly select the API token in the provided list
Sep 2 2019, 10:05 AM
douardda committed rDLS83d138759ce8: phabricator: kill PhabricatorLister's api_token argument (authored by douardda).
phabricator: kill PhabricatorLister's api_token argument
Sep 2 2019, 10:05 AM
douardda closed D1926: phabricator: small refactoring/simplification of the request_params method.
Sep 2 2019, 10:05 AM
douardda committed rDLS6f56d2c8d72d: core: move credentials' docstring from request_params to… (authored by douardda).
core: move credentials' docstring from request_params to…
Sep 2 2019, 10:05 AM
douardda closed D1925: phabricator: kill PhabricatorLister's api_token argument.
Sep 2 2019, 10:05 AM
douardda closed D1924: core: move credentials' docstring from request_params to request_instance_credentials.
Sep 2 2019, 10:05 AM

Aug 30 2019

douardda triaged T1978: Simplify listers's db model as Low priority.
Aug 30 2019, 6:12 PM · Lister
douardda updated the diff for D1504: implement listers as plugins.

rebase and small fixes

Aug 30 2019, 6:05 PM
Herald added a reviewer for D1934: phabricator: refactor PhabricatorLister's constructor: Reviewers.
Aug 30 2019, 6:05 PM
Herald added a reviewer for D1933: gitlab: make GitLabLister's api_baseurl init argument optional: Reviewers.
Aug 30 2019, 6:04 PM
Herald added a reviewer for D1932: github: make GitHubLister's api_baseurl init argument optional: Reviewers.
Aug 30 2019, 6:04 PM
Herald added a reviewer for D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional: Reviewers.
Aug 30 2019, 6:04 PM
Herald added a reviewer for D1930: core: make it possible to specify the api_baseurl init argument in override_config: Reviewers.
Aug 30 2019, 6:03 PM
Herald added a reviewer for D1929: cgit: rewrite the CGit lister: Reviewers.
Aug 30 2019, 6:03 PM
Herald added a reviewer for D1928: bitbucket: simplify a bit BitBucketLister's constructor: Reviewers.
Aug 30 2019, 6:02 PM
Herald added a reviewer for D1927: phabricator: randomly select the API token in the provided list: Reviewers.
Aug 30 2019, 6:02 PM
Herald added a reviewer for D1926: phabricator: small refactoring/simplification of the request_params method: Reviewers.
Aug 30 2019, 6:02 PM
Herald added a reviewer for D1925: phabricator: kill PhabricatorLister's api_token argument: Reviewers.
Aug 30 2019, 6:01 PM
Herald added a reviewer for D1924: core: move credentials' docstring from request_params to request_instance_credentials: Reviewers.
Aug 30 2019, 6:01 PM

Aug 29 2019

douardda committed rDJNL50727acccd9a: cli: rename cli command content_replay as content-replay (authored by douardda).
cli: rename cli command content_replay as content-replay
Aug 29 2019, 4:41 PM
douardda closed D1921: cli: rename cli command content_replay as content-replay.
Aug 29 2019, 4:41 PM
douardda committed rDJNLe7417989d5aa: replayer: make the replayer handle kafka message without 'metadata' field (authored by douardda).
replayer: make the replayer handle kafka message without 'metadata' field
Aug 29 2019, 4:41 PM
douardda closed D1790: replayer: make the replayer handle kafka message without 'metadata' field.
Aug 29 2019, 4:41 PM
douardda committed rDJNL094cede04a93: tests: extract most of test_*_origin_visit tests in a helper function (authored by douardda).
tests: extract most of test_*_origin_visit tests in a helper function
Aug 29 2019, 4:35 PM
douardda closed D1920: tests: extract most of test_*_origin_visit tests in a helper function.
Aug 29 2019, 4:35 PM
douardda updated the diff for D1921: cli: rename cli command content_replay as content-replay.

rebase

Aug 29 2019, 4:31 PM
douardda updated the diff for D1790: replayer: make the replayer handle kafka message without 'metadata' field.

rebase

Aug 29 2019, 4:30 PM
douardda updated the diff for D1920: tests: extract most of test_*_origin_visit tests in a helper function.

fix a typo in test_replay.py

Aug 29 2019, 4:29 PM
douardda updated the diff for D1921: cli: rename cli command content_replay as content-replay.

rebase

Aug 29 2019, 3:39 PM
douardda updated the diff for D1790: replayer: make the replayer handle kafka message without 'metadata' field.

rebase

Aug 29 2019, 3:38 PM
douardda added a comment to T1958: Performance tuning of zfs infrastructure.

Let me add this to the list:

Aug 29 2019, 3:30 PM · System administration
douardda added a comment to T1958: Performance tuning of zfs infrastructure.

have you made you mind on the storage model you want for this? Can we purchase a few of them any time soon?

Aug 29 2019, 3:24 PM · System administration