Page MenuHomeSoftware Heritage
Feed Advanced Search

Feb 6 2019

Herald added a reviewer for D1087: Improve a bit the README file: Reviewers.
Feb 6 2019, 3:22 PM
douardda committed rCDFD842f819f3439: Merge all loaders and listers services in swh-loader and swh-lister (authored by douardda).
Merge all loaders and listers services in swh-loader and swh-lister
Feb 6 2019, 3:22 PM
douardda committed rCDFD29c9481102d3: Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used (authored by douardda).
Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used
Feb 6 2019, 3:22 PM
douardda committed rCDFD7ddf391cdccb: Reduce verbosity of the journal pusblisher and storage listener. (authored by douardda).
Reduce verbosity of the journal pusblisher and storage listener.
Feb 6 2019, 3:22 PM
douardda committed rCDFDa1d4f5a8f5de: Move all swh config file in conf/ and use volumes to inject them in dockers (authored by douardda).
Move all swh config file in conf/ and use volumes to inject them in dockers
Feb 6 2019, 3:22 PM
douardda committed rCDFDf8ca643a0508: Install kombu from sources in scheduler-worker as a workaround for T1491 (authored by douardda).
Install kombu from sources in scheduler-worker as a workaround for T1491
Feb 6 2019, 3:22 PM
douardda committed rCDFD1b6edf887e77: Move conf and env files in dedicated directories (authored by douardda).
Move conf and env files in dedicated directories
Feb 6 2019, 3:22 PM
douardda closed D1084: Simplify and organize a bit the whole docker environment.
Feb 6 2019, 3:22 PM
douardda committed rDSCHdb25694f1e12: Fix a bug in the listener: commit() is not defined in the backend (authored by douardda).
Fix a bug in the listener: commit() is not defined in the backend
Feb 6 2019, 3:17 PM
douardda closed D1085: Fix a bug in the listener: commit() is not defined in the backend.
Feb 6 2019, 3:17 PM
Herald added a reviewer for D1086: Split the getting-started guide in 3 parts: Reviewers.
Feb 6 2019, 3:15 PM
Herald added a reviewer for D1085: Fix a bug in the listener: commit() is not defined in the backend: Reviewers.
Feb 6 2019, 2:21 PM
douardda committed rDENV5aef579b9d04: Excluse swh-docker-env from ls-py-modules (authored by douardda).
Excluse swh-docker-env from ls-py-modules
Feb 6 2019, 1:28 PM
douardda added inline comments to D1083: Improve the cli a bit and normalize the lister_db_url config.
Feb 6 2019, 11:08 AM
Herald added a reviewer for D1084: Simplify and organize a bit the whole docker environment: Reviewers.
Feb 6 2019, 10:40 AM
douardda committed rCDFD4dcbc2cf5e5a: Update config system for scheduler services (authored by douardda).
Update config system for scheduler services
Feb 6 2019, 10:38 AM
douardda committed rCDFD144f580b4662: Workers' celery config is now managed as the [celery] section of the main… (authored by douardda).
Workers' celery config is now managed as the [celery] section of the main…
Feb 6 2019, 10:38 AM
douardda committed rCDFDf1aae8764ed0: Reduce the slicing for objstorage (authored by douardda).
Reduce the slicing for objstorage
Feb 6 2019, 10:38 AM
douardda committed rCDFDc90fb7242ff6: Ensure pip, setuptools and wheel are up to date at image build time (authored by douardda).
Ensure pip, setuptools and wheel are up to date at image build time
Feb 6 2019, 10:38 AM
douardda committed rCDFD9be3d5233674: Update config of the scheduler (authored by douardda).
Update config of the scheduler
Feb 6 2019, 10:38 AM
douardda committed rCDFDaed3cf803d12: Fix a typo in indexer's Dockerfile (authored by douardda).
Fix a typo in indexer's Dockerfile
Feb 6 2019, 10:38 AM
douardda committed rCDFD6f6b92cdb173: Small fix for the prometheus service (authored by douardda).
Small fix for the prometheus service
Feb 6 2019, 10:38 AM
douardda committed rCDFD7f8ff5e21523: Add a prefix in celery workers' hostnames to prevent confusion eg. with pypi (authored by douardda).
Add a prefix in celery workers' hostnames to prevent confusion eg. with pypi
Feb 6 2019, 10:38 AM
douardda committed rCDFD652f9f2709e2: Fix the celery worker's hostname (authored by douardda).
Fix the celery worker's hostname
Feb 6 2019, 10:38 AM
douardda committed rCDFD4d33cbaa87b1: Indexers have been refactored so we now only one celery worker (authored by douardda).
Indexers have been refactored so we now only one celery worker
Feb 6 2019, 10:38 AM
douardda closed D1052: Big pile of fixes to adapt to current HEAD of core,scheduler,storage etc..
Feb 6 2019, 10:38 AM
Herald added a reviewer for D1083: Improve the cli a bit and normalize the lister_db_url config: Reviewers.
Feb 6 2019, 10:35 AM
douardda committed rDCOREf3efe0cd6357: Allow to override config file name via the SWH_CONFIG_FILENAME env var (authored by douardda).
Allow to override config file name via the SWH_CONFIG_FILENAME env var
Feb 6 2019, 10:30 AM
douardda closed D1066: Allow to override config file name via the SWH_CONFIG_FILENAME env var.
Feb 6 2019, 10:30 AM
douardda added a comment to D1066: Allow to override config file name via the SWH_CONFIG_FILENAME env var.

slowly but surely we progress towards the implicit configuration killing ;)

In fact this diff is probably not that useful, the one really needed, for most celery workers in fact, is D1067

Feb 6 2019, 10:29 AM
douardda committed rDSCHabfe3db7f227: Allow to override celery config file name via the SWH_CONFIG_FILENAME env var (authored by douardda).
Allow to override celery config file name via the SWH_CONFIG_FILENAME env var
Feb 6 2019, 10:26 AM
douardda closed D1067: Allow to override celery config file name via the SWH_CONFIG_FILENAME env var.
Feb 6 2019, 10:26 AM
douardda updated the diff for D1067: Allow to override celery config file name via the SWH_CONFIG_FILENAME env var.

rebased ans small fix

Feb 6 2019, 10:26 AM

Feb 5 2019

douardda triaged T1515: Add automatic tests for the docker environment as High priority.
Feb 5 2019, 9:54 AM · Docker environment
douardda triaged T1514: MemoryError in loader-git as Normal priority.
Feb 5 2019, 9:47 AM · Git loader
douardda triaged T1513: The indexer journal client is unstable as High priority.
Feb 5 2019, 9:43 AM · Indexer
douardda added a comment to T1510: Have a look at openAPI and decide whether we want to follow these specs.

In fact, OpenAPI is the new name for swagger (more or less).

Feb 5 2019, 9:36 AM · Web app

Feb 4 2019

douardda added inline comments to D1067: Allow to override celery config file name via the SWH_CONFIG_FILENAME env var.
Feb 4 2019, 11:23 AM

Feb 1 2019

douardda added a comment to D1066: Allow to override config file name via the SWH_CONFIG_FILENAME env var.

slowly but surely we progress towards the implicit configuration killing ;)

Feb 1 2019, 5:00 PM
Herald added a reviewer for D1067: Allow to override celery config file name via the SWH_CONFIG_FILENAME env var: Reviewers.
Feb 1 2019, 5:00 PM
douardda committed rDSCH0f2f3ff9d09f: Make (celery) tests immune to environment variables (authored by douardda).
Make (celery) tests immune to environment variables
Feb 1 2019, 4:50 PM
douardda closed D1065: Make (celery) tests immune to environment variables.
Feb 1 2019, 4:50 PM
Herald added a reviewer for D1066: Allow to override config file name via the SWH_CONFIG_FILENAME env var: Reviewers.
Feb 1 2019, 3:57 PM
douardda committed rDLSc2c26d7e46ee: Fix the bitbucket lister; handle properly the date-like bounds (authored by douardda).
Fix the bitbucket lister; handle properly the date-like bounds
Feb 1 2019, 3:39 PM
douardda committed rDLS1b2d6895a9ff: Use the named logger instead of the root logger in lister_base.py (authored by douardda).
Use the named logger instead of the root logger in lister_base.py
Feb 1 2019, 3:39 PM
douardda committed rDLS94a35f12aa0e: Fix the SWHIndexingLister.db_partition_indices (authored by douardda).
Fix the SWHIndexingLister.db_partition_indices
Feb 1 2019, 3:39 PM
douardda committed rDLS1d7d9b6128ea: Log errors when fetching an url in SWHListerHttpTransport (authored by douardda).
Log errors when fetching an url in SWHListerHttpTransport
Feb 1 2019, 3:39 PM
douardda closed D1051: Fix the bitbucket lister;.
Feb 1 2019, 3:39 PM
douardda updated the diff for D1051: Fix the bitbucket lister;.

rebased

Feb 1 2019, 3:38 PM
Herald added a reviewer for D1065: Make (celery) tests immune to environment variables: Reviewers.
Feb 1 2019, 3:33 PM
douardda committed rDLDSVN791272ced541: flake8 (authored by douardda).
flake8
Feb 1 2019, 3:14 PM
douardda committed rDVAU19015b28a94f: Fix test_cookers.py: we need to use explicitely GitLoaderFromDisk now (authored by douardda).
Fix test_cookers.py: we need to use explicitely GitLoaderFromDisk now
Feb 1 2019, 2:31 PM
douardda closed D1064: Fix test_cookers.py: we need to use explicitely GitLoaderFromDisk now.
Feb 1 2019, 2:31 PM
douardda committed rDCOREcc65e0f77497: flake8 (authored by douardda).
flake8
Feb 1 2019, 2:24 PM
Herald added a reviewer for D1064: Fix test_cookers.py: we need to use explicitely GitLoaderFromDisk now: Reviewers.
Feb 1 2019, 2:13 PM
douardda committed rDCORE0e277770ad0f: Put the default_values argument of BaseDb.copy_to after cur and iten_cb (authored by douardda).
Put the default_values argument of BaseDb.copy_to after cur and iten_cb
Feb 1 2019, 1:23 PM
douardda closed D1057: Put the default_values argument of BaseDb.copy_to after cur and iten_cb.
Feb 1 2019, 1:23 PM
douardda committed rDCOREd24a1ffd30e3: Fix the default_values handling in BaseDb.copy_to (authored by douardda).
Fix the default_values handling in BaseDb.copy_to
Feb 1 2019, 1:23 PM
douardda closed D1055: Fix the default_values handling in BaseDb.copy_to.
Feb 1 2019, 1:23 PM
douardda abandoned D1056: Use named 'cur' argument when cally Db.copy_to().

Not needed after D1057

Feb 1 2019, 12:41 PM
douardda triaged T1510: Have a look at openAPI and decide whether we want to follow these specs as Wishlist priority.
Feb 1 2019, 12:39 PM · Web app
Herald added a reviewer for D1057: Put the default_values argument of BaseDb.copy_to after cur and iten_cb: Reviewers.
Feb 1 2019, 12:33 PM
Herald added a reviewer for D1056: Use named 'cur' argument when cally Db.copy_to(): Reviewers.
Feb 1 2019, 12:22 PM
Herald added a reviewer for D1055: Fix the default_values handling in BaseDb.copy_to: Reviewers.
Feb 1 2019, 12:20 PM
douardda updated the diff for D1051: Fix the bitbucket lister;.

Do really remove a debug piece of code and fix the test

Feb 1 2019, 11:40 AM
douardda updated the diff for D1051: Fix the bitbucket lister;.

remove a debug piece of code

Feb 1 2019, 11:21 AM
douardda added inline comments to D1051: Fix the bitbucket lister;.
Feb 1 2019, 11:20 AM
douardda added inline comments to D1051: Fix the bitbucket lister;.
Feb 1 2019, 11:09 AM
douardda added a comment to D1051: Fix the bitbucket lister;.

What is that error?

Feb 1 2019, 10:52 AM

Jan 31 2019

douardda added inline comments to D1051: Fix the bitbucket lister;.
Jan 31 2019, 6:09 PM
Herald added a reviewer for D1052: Big pile of fixes to adapt to current HEAD of core,scheduler,storage etc.: Reviewers.
Jan 31 2019, 5:29 PM
douardda committed rDCORE657819435b1c: Fix async version of decode_request (authored by douardda).
Fix async version of decode_request
Jan 31 2019, 5:24 PM
douardda committed rDCORE508e3d0d15df: Make the cur_arg argument optional in BaseDb.cursor() (authored by douardda).
Make the cur_arg argument optional in BaseDb.cursor()
Jan 31 2019, 5:24 PM
douardda closed D1050: 2 small improvements.
Jan 31 2019, 5:24 PM
douardda closed D1049: Fix the task_queues Celery config setting in build_app().
Jan 31 2019, 5:23 PM
douardda committed rDSCH0c3306bbfebb: Fix the task_queues Celery config setting in build_app() (authored by douardda).
Fix the task_queues Celery config setting in build_app()
Jan 31 2019, 5:23 PM
douardda committed rDSCHb0e6dd80440d: Fix the listener: accessing the db cnx from the backend has changed (authored by douardda).
Fix the listener: accessing the db cnx from the backend has changed
Jan 31 2019, 5:23 PM
douardda committed rDSCHf1883433bee7: cli: display a sorted list of task-types (authored by douardda).
cli: display a sorted list of task-types
Jan 31 2019, 5:23 PM
douardda closed D1048: cli: display a sorted list of task-types.
Jan 31 2019, 5:23 PM
douardda closed D1047: Fix the listener: accessing the db cnx from the backend has changed.
Jan 31 2019, 5:23 PM
douardda committed rDSCH5d40529c74ea: Make cli tools output logs on the console by default (authored by douardda).
Make cli tools output logs on the console by default
Jan 31 2019, 5:23 PM
douardda closed D1046: Make cli tools output logs on the console by default.
Jan 31 2019, 5:23 PM
douardda committed rDSCHa8bc684cceb5: cli: build the celery app from a celery section of the given configuration file (authored by douardda).
cli: build the celery app from a celery section of the given configuration file
Jan 31 2019, 5:23 PM
douardda committed rDSCH42462869f91c: Add a build_app() function to instantiate a Celery app with controlled config (authored by douardda).
Add a build_app() function to instantiate a Celery app with controlled config
Jan 31 2019, 5:23 PM
douardda closed D1045: Make the celery app easier to configure.
Jan 31 2019, 5:23 PM
douardda closed D997: Use the BaseDb (and friends) from swh-core.

8cb3ca2c4206569f147f3544e4bb1b107e1e0980

Jan 31 2019, 5:20 PM
Herald added a reviewer for D1051: Fix the bitbucket lister;: Reviewers.
Jan 31 2019, 4:15 PM
Herald added a reviewer for D1050: 2 small improvements: Reviewers.
Jan 31 2019, 4:04 PM
douardda closed D1019: Add python-decorator dep and adapt debian/copyright for swh/core/api/negotiate.

55da57a197e1daf3f94904f3b3dc785b2b497938

Jan 31 2019, 4:02 PM
Herald added a reviewer for D1049: Fix the task_queues Celery config setting in build_app(): Reviewers.
Jan 31 2019, 3:56 PM
Herald added a reviewer for D1048: cli: display a sorted list of task-types: Reviewers.
Jan 31 2019, 3:56 PM
Herald added a reviewer for D1047: Fix the listener: accessing the db cnx from the backend has changed: Reviewers.
Jan 31 2019, 3:56 PM
Herald added a reviewer for D1046: Make cli tools output logs on the console by default: Reviewers.
Jan 31 2019, 3:55 PM
Herald added a reviewer for D1045: Make the celery app easier to configure: Reviewers.
Jan 31 2019, 3:55 PM
douardda added a comment to T1388: Document the configuration system of each component.

See also T826 which is somewhat related

Jan 31 2019, 3:51 PM · Documentation
douardda closed T1494: swh-scheduler API does not really support concurrency as Resolved.

via cebc11d1752e

Jan 31 2019, 3:49 PM · Scheduling utilities
douardda closed T1499: Integrate negotiate in swh.core as Resolved.
Jan 31 2019, 3:47 PM · Core & foundations
douardda committed rDSCH70581b67c0d0: Add a /site-map endpoint that lists published routes for this server (authored by douardda).
Add a /site-map endpoint that lists published routes for this server
Jan 31 2019, 3:44 PM
douardda closed D1042: Add a /site-map endpoint that lists published routes for this server.
Jan 31 2019, 3:44 PM
douardda triaged T1508: Rationalize task type names as Low priority.
Jan 31 2019, 2:22 PM · Scheduling utilities