Page MenuHomeSoftware Heritage

douardda (David Douard)
User

Projects (7)

User Details

User Since
Jul 10 2018, 12:38 PM (73 w, 5 d)

Recent Activity

Fri, Dec 6

douardda moved T2122: Lister monitoring: add statsd probe for each lister instance from Backlog to in progress on the Sprint 2019/12 (Monitor and Conquer) board.
Fri, Dec 6, 10:36 AM · Sprint 2019/12 (Monitor and Conquer)
douardda closed T2133: Scheduler listener/runner: add statsd probes as Resolved.

Closed by D2394

Fri, Dec 6, 10:22 AM · Metrics/monitoring, Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
douardda committed rDSCHa18f56205d1d: celery: add 2 statsd probes for the runner and listener (authored by douardda).
celery: add 2 statsd probes for the runner and listener
Fri, Dec 6, 10:22 AM
douardda closed D2394: celery: add 2 statsd probes for the runner and listener.
Fri, Dec 6, 10:22 AM

Thu, Dec 5

douardda accepted D2395: package.archive: Move archive loader to its own namespace.

LGTM

Thu, Dec 5, 12:04 PM · SWH command line interface, Core Loader

Wed, Dec 4

douardda updated the diff for D2394: celery: add 2 statsd probes for the runner and listener.

ok, let's keep _scheduler_ in probe names

Wed, Dec 4, 4:37 PM
douardda added inline comments to D2394: celery: add 2 statsd probes for the runner and listener.
Wed, Dec 4, 4:20 PM
douardda updated the diff for D2394: celery: add 2 statsd probes for the runner and listener.

I said -scheduler !

Wed, Dec 4, 4:18 PM
douardda updated the diff for D2394: celery: add 2 statsd probes for the runner and listener.

rebased + rename statsd probes (-scheduler/+total)

Wed, Dec 4, 3:27 PM
douardda committed rDSCH08243bbc9e3e: tests: fix celery_task's test_multiping (authored by douardda).
tests: fix celery_task's test_multiping
Wed, Dec 4, 3:12 PM
douardda committed rDSCHf206076232a8: celery: make SWHTask send start/end of execution statsd gauges with timestamps (authored by douardda).
celery: make SWHTask send start/end of execution statsd gauges with timestamps
Wed, Dec 4, 3:12 PM
douardda closed T2119: Monitoring of workers as Resolved by committing rDSCHf206076232a8: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Wed, Dec 4, 3:12 PM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
douardda closed D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Wed, Dec 4, 3:12 PM
douardda added a revision to T2133: Scheduler listener/runner: add statsd probes: D2394: celery: add 2 statsd probes for the runner and listener.
Wed, Dec 4, 10:58 AM · Metrics/monitoring, Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
douardda created D2394: celery: add 2 statsd probes for the runner and listener.
Wed, Dec 4, 10:58 AM
douardda created D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Wed, Dec 4, 10:30 AM
douardda added a revision to T2119: Monitoring of workers: D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Wed, Dec 4, 10:30 AM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)

Tue, Dec 3

douardda moved T2119: Monitoring of workers from Backlog to in progress on the Sprint 2019/12 (Monitor and Conquer) board.
Tue, Dec 3, 11:37 AM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)

Fri, Nov 29

douardda committed rDJNL3bb1d771c4bc: replay: use tag based statsd probes (authored by douardda).
replay: use tag based statsd probes
Fri, Nov 29, 3:35 PM
douardda closed D2377: replay: use tag based statsd probes.
Fri, Nov 29, 3:35 PM
douardda created D2377: replay: use tag based statsd probes.
Fri, Nov 29, 3:10 PM
douardda committed rDJNL3f61999d2d08: replay: add a bit of statsd probing in process_replay_objects (authored by douardda).
replay: add a bit of statsd probing in process_replay_objects
Fri, Nov 29, 11:49 AM
douardda closed D2374: replay: add a bit of statsd probing in process_replay_objects.
Fri, Nov 29, 11:49 AM
douardda updated the diff for D2374: replay: add a bit of statsd probing in process_replay_objects.

rebased

Fri, Nov 29, 11:46 AM
douardda committed rDJNL0177a9272bbe: replay: ensure a revision is present only once in a batch (authored by douardda).
replay: ensure a revision is present only once in a batch
Fri, Nov 29, 11:45 AM
douardda closed D2372: replay: ensure a revision is present only once in a batch.
Fri, Nov 29, 11:45 AM
douardda accepted D2370: Hide history link for empty snapshot.

LGTM but I'm not very used to the webapp's code.

Fri, Nov 29, 11:04 AM
douardda requested changes to D2371: tarball: Add support for tar.Z, tar.x, tar.lz files.
Fri, Nov 29, 11:01 AM
douardda accepted D2376: docker/README: drop obsolete mentions of swh-docker-dev.

looks very good to me, thanks!

Fri, Nov 29, 10:12 AM

Thu, Nov 28

douardda created D2374: replay: add a bit of statsd probing in process_replay_objects.
Thu, Nov 28, 5:20 PM
douardda accepted D2367: pypi: metadata -> revision: Deal with previous metadata format.
Thu, Nov 28, 5:14 PM
douardda created D2372: replay: ensure a revision is present only once in a batch.
Thu, Nov 28, 4:16 PM
douardda created P564 revisions in journal.
Thu, Nov 28, 4:04 PM
douardda accepted D2365: npm: metadata -> revision: Deal with previous metadata format.
Thu, Nov 28, 11:55 AM

Wed, Nov 27

douardda accepted D2360: sphinx/Dockerfile: Add missing pre-commit dependency.

Not very fond, but will work and remains the simplest solution.

Wed, Nov 27, 10:19 AM

Tue, Nov 26

douardda committed rDENV12931aff1a94: Dockerfile: fix a typo in var substitution (authored by douardda).
Dockerfile: fix a typo in var substitution
Tue, Nov 26, 3:42 PM
douardda committed rDENV74252ff5d8cc: Allow to set CASS_DRIVER_ env vars when building the docker image (authored by douardda).
Allow to set CASS_DRIVER_ env vars when building the docker image
Tue, Nov 26, 3:37 PM
douardda committed rDENV78ee2eeb7ae2: Stop referencing swh-docker-dev in .mrconfig (authored by douardda).
Stop referencing swh-docker-dev in .mrconfig
Tue, Nov 26, 1:48 PM
douardda committed rDENV357084c46082: Fix entrypoint of most services (authored by douardda).
Fix entrypoint of most services
Tue, Nov 26, 1:39 PM
douardda closed T2097: Merge swh-docker-dev into swh-environment as Resolved.

Closed by 9a98e8be06817055693671cfbe6917645171993e

Tue, Nov 26, 1:36 PM · Docker environment, Development environment
douardda committed rDENVc8591006d03b: Dockerfile: get rid of swh-loader-xxx for packages loaders (authored by douardda).
Dockerfile: get rid of swh-loader-xxx for packages loaders
Tue, Nov 26, 1:35 PM
douardda committed rDENV9a98e8be0681: Merge 'swh-docker-dev' into master (authored by douardda).
Merge 'swh-docker-dev' into master
Tue, Nov 26, 1:35 PM
douardda committed rDENV3b0c74bc80ba: Dockerfile: install cassandra-driver in a dedicated step (authored by douardda).
Dockerfile: install cassandra-driver in a dedicated step
Tue, Nov 26, 1:35 PM
douardda committed rDENV7b2e570a57da: Dockerfile: use --no-install-recommends for r-cran packages (authored by douardda).
Dockerfile: use --no-install-recommends for r-cran packages
Tue, Nov 26, 1:35 PM
douardda committed rDENV9b12218d59cd: entrypoints: ensure gunicorn services can handle more than one connection (authored by douardda).
entrypoints: ensure gunicorn services can handle more than one connection
Tue, Nov 26, 1:35 PM
douardda committed rDENV8d48959f9643: Dockerfile: update to python 3.7 (authored by douardda).
Dockerfile: update to python 3.7
Tue, Nov 26, 1:35 PM
douardda committed rDENV00d3f8f35840: README: update doc to use the new 'swh' master cli tool (authored by douardda).
README: update doc to use the new 'swh' master cli tool
Tue, Nov 26, 1:35 PM
douardda committed rDENV30e9c934ef20: lister: allways run the db initialization step (authored by douardda).
lister: allways run the db initialization step
Tue, Nov 26, 1:35 PM
douardda committed rDENVb7f02d8add7f: dockerfile: install python packages in a venv under the swh user (authored by douardda).
dockerfile: install python packages in a venv under the swh user
Tue, Nov 26, 1:35 PM
douardda committed rDENV53fa588c7fc2: Factorise the pip install of source repos in a shell function (authored by douardda).
Factorise the pip install of source repos in a shell function
Tue, Nov 26, 1:35 PM
douardda committed rDENV6d49580cd56c: replica: ensure entrypoints are defined in replica related services (authored by douardda).
replica: ensure entrypoints are defined in replica related services
Tue, Nov 26, 1:35 PM
douardda committed rDENV7b0ea2803606: Remove entrypoint.sh files from the Dockerfile (authored by douardda).
Remove entrypoint.sh files from the Dockerfile
Tue, Nov 26, 1:35 PM
douardda committed rDENV6558c6c8ad18: entrypoint: pgsql has been moved to ~swh/ (authored by douardda).
entrypoint: pgsql has been moved to ~swh/
Tue, Nov 26, 1:35 PM
douardda committed rDENVd1f5b87ba8c7: Dockerfile: small readability refactoring (authored by douardda).
Dockerfile: small readability refactoring
Tue, Nov 26, 1:35 PM
douardda committed rDENV587f9df57a80: lister: Use explicit postgresql URLs as a workaround for a sqlalchemy issue (authored by douardda).
lister: Use explicit postgresql URLs as a workaround for a sqlalchemy issue
Tue, Nov 26, 1:35 PM
douardda committed rDENV9359da6dbf95: Add support for a kafka-powered replica of the graph. (authored by douardda).
Add support for a kafka-powered replica of the graph.
Tue, Nov 26, 1:35 PM
douardda committed rDENV20b0733b84f3: swh-web: enforce the database file to be created in either $HOME or /tmp (authored by douardda).
swh-web: enforce the database file to be created in either $HOME or /tmp
Tue, Nov 26, 1:35 PM
douardda committed rDENV8a2458ee2bf0: compose: fix inconsistent dependency (authored by douardda).
compose: fix inconsistent dependency
Tue, Nov 26, 1:35 PM
douardda committed rDENVc56678130229: readme: integrate the docker-based development setup from the main's doc (authored by douardda).
readme: integrate the docker-based development setup from the main's doc
Tue, Nov 26, 1:35 PM
douardda committed rDENV6417e87e38e0: readme: make it compliant with phabricator's limited remarkup format (authored by douardda).
readme: make it compliant with phabricator's limited remarkup format
Tue, Nov 26, 1:35 PM
douardda committed rDENV8871e9cd32eb: swh-scheduler: add SWH_CONFIG_FILENAME and SWH_SCHEDULER_CONFIG_FILE env vars (authored by douardda).
swh-scheduler: add SWH_CONFIG_FILENAME and SWH_SCHEDULER_CONFIG_FILE env vars
Tue, Nov 26, 1:35 PM
douardda committed rDENVd192c1cde3d7: docker-compose: move the swh-indexer-journal-client in the journal "section" (authored by douardda).
docker-compose: move the swh-indexer-journal-client in the journal "section"
Tue, Nov 26, 1:35 PM
douardda committed rDENV0b031ba074df: web: remove djangosettings.py file and use swh.web.settings.development (authored by douardda).
web: remove djangosettings.py file and use swh.web.settings.development
Tue, Nov 26, 1:35 PM
douardda committed rDENV0c89cd3350bb: dockerfile: ensure swh-web's version of pip is up to date (authored by douardda).
dockerfile: ensure swh-web's version of pip is up to date
Tue, Nov 26, 1:35 PM
douardda committed rDENV7b3213293ca1: conf: make swh-web always serve assets (authored by douardda).
conf: make swh-web always serve assets
Tue, Nov 26, 1:35 PM
douardda committed rDENVaac4cff40773: grafana: replace the tasks dashboard with olasd's task-processing one (authored by douardda).
grafana: replace the tasks dashboard with olasd's task-processing one
Tue, Nov 26, 1:35 PM
douardda committed rDENV777d5be54ec0: Fix nginx revert proxy for rabbitmq (authored by douardda).
Fix nginx revert proxy for rabbitmq
Tue, Nov 26, 1:35 PM
douardda committed rDENV1f10d774be7b: Fix celery workers conf files: explicit list of queues is now required (authored by douardda).
Fix celery workers conf files: explicit list of queues is now required
Tue, Nov 26, 1:35 PM
douardda committed rDENV3a7e4df76175: Activate a 10s heartbeat for celery workers (authored by douardda).
Activate a 10s heartbeat for celery workers
Tue, Nov 26, 1:35 PM
douardda committed rDENV48038bdb707a: Upgrade to pg 11 (authored by douardda).
Upgrade to pg 11
Tue, Nov 26, 1:35 PM
douardda committed rDENV2ed0c7833c5b: Add the vault services (api and worker) and make them avaible in swh-web (authored by douardda).
Add the vault services (api and worker) and make them avaible in swh-web
Tue, Nov 26, 1:35 PM
douardda committed rDENV0ac8db330055: Move options and arguments of the swh manage command as COMMAND (authored by douardda).
Move options and arguments of the swh manage command as COMMAND
Tue, Nov 26, 1:35 PM
douardda committed rDENVbb38cd93622e: Deploy a djangossettings.py for swh-web that allows to set a dumd asmin password (authored by douardda).
Deploy a djangossettings.py for swh-web that allows to set a dumd asmin password
Tue, Nov 26, 1:35 PM
douardda committed rDENV7000265592f0: Update the lister entrypoint to make latest cli updates (authored by douardda).
Update the lister entrypoint to make latest cli updates
Tue, Nov 26, 1:35 PM
douardda committed rDENV452185dac5ef: Very beginning of a grafana service (authored by douardda).
Very beginning of a grafana service
Tue, Nov 26, 1:35 PM
douardda committed rDENV7a0178e5c839: Improve a bit the README file (authored by douardda).
Improve a bit the README file
Tue, Nov 26, 1:35 PM
douardda committed rDENV842f819f3439: Merge all loaders and listers services in swh-loader and swh-lister (authored by douardda).
Merge all loaders and listers services in swh-loader and swh-lister
Tue, Nov 26, 1:35 PM
douardda committed rDENV29c9481102d3: Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used (authored by douardda).
Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used
Tue, Nov 26, 1:35 PM
douardda committed rDENVa1d4f5a8f5de: Move all swh config file in conf/ and use volumes to inject them in dockers (authored by douardda).
Move all swh config file in conf/ and use volumes to inject them in dockers
Tue, Nov 26, 1:35 PM
douardda committed rDENV7ddf391cdccb: Reduce verbosity of the journal pusblisher and storage listener. (authored by douardda).
Reduce verbosity of the journal pusblisher and storage listener.
Tue, Nov 26, 1:35 PM
douardda committed rDENVf8ca643a0508: Install kombu from sources in scheduler-worker as a workaround for T1491 (authored by douardda).
Install kombu from sources in scheduler-worker as a workaround for T1491
Tue, Nov 26, 1:35 PM
douardda committed rDENV144f580b4662: Workers' celery config is now managed as the [celery] section of the main… (authored by douardda).
Workers' celery config is now managed as the [celery] section of the main…
Tue, Nov 26, 1:35 PM
douardda committed rDENV4dcbc2cf5e5a: Update config system for scheduler services (authored by douardda).
Update config system for scheduler services
Tue, Nov 26, 1:35 PM
douardda committed rDENVf1aae8764ed0: Reduce the slicing for objstorage (authored by douardda).
Reduce the slicing for objstorage
Tue, Nov 26, 1:35 PM
douardda committed rDENV1b6edf887e77: Move conf and env files in dedicated directories (authored by douardda).
Move conf and env files in dedicated directories
Tue, Nov 26, 1:35 PM
douardda committed rDENVaed3cf803d12: Fix a typo in indexer's Dockerfile (authored by douardda).
Fix a typo in indexer's Dockerfile
Tue, Nov 26, 1:35 PM
douardda committed rDENVc90fb7242ff6: Ensure pip, setuptools and wheel are up to date at image build time (authored by douardda).
Ensure pip, setuptools and wheel are up to date at image build time
Tue, Nov 26, 1:35 PM
douardda committed rDENV7f8ff5e21523: Add a prefix in celery workers' hostnames to prevent confusion eg. with pypi (authored by douardda).
Add a prefix in celery workers' hostnames to prevent confusion eg. with pypi
Tue, Nov 26, 1:35 PM
douardda committed rDENV6f6b92cdb173: Small fix for the prometheus service (authored by douardda).
Small fix for the prometheus service
Tue, Nov 26, 1:35 PM
douardda committed rDENV9be3d5233674: Update config of the scheduler (authored by douardda).
Update config of the scheduler
Tue, Nov 26, 1:35 PM
douardda committed rDENV4d33cbaa87b1: Indexers have been refactored so we now only one celery worker (authored by douardda).
Indexers have been refactored so we now only one celery worker
Tue, Nov 26, 1:35 PM
douardda committed rDENV652f9f2709e2: Fix the celery worker's hostname (authored by douardda).
Fix the celery worker's hostname
Tue, Nov 26, 1:35 PM
douardda committed rDENV04d38c79e427: Try to rationalize a bit ports published on the host (authored by douardda).
Try to rationalize a bit ports published on the host
Tue, Nov 26, 1:35 PM
douardda committed rDENVe0795aa1d5e7: Rewrite the 'How to use' section as a 'Quick Start' (authored by douardda).
Rewrite the 'How to use' section as a 'Quick Start'
Tue, Nov 26, 1:35 PM
douardda committed rDENVb24f45b91d5f: Add an nginx service to group all http services on the same service endpoint (authored by douardda).
Add an nginx service to group all http services on the same service endpoint
Tue, Nov 26, 1:35 PM
douardda committed rDENVb0cf67760891: Fix tab indent in dockerfiles/swh-indexer-worker/entrypoint.sh (authored by douardda).
Fix tab indent in dockerfiles/swh-indexer-worker/entrypoint.sh
Tue, Nov 26, 1:35 PM
douardda committed rDENVe1d3e4241823: Use full postgresql connexion URLs everywhere (authored by douardda).
Use full postgresql connexion URLs everywhere
Tue, Nov 26, 1:35 PM
douardda committed rDENV4d1f1a3ef3b4: Rename celery workers as <swh-instance>@<hostname> (authored by douardda).
Rename celery workers as <swh-instance>@<hostname>
Tue, Nov 26, 1:35 PM
douardda committed rDENV3c3f86d3ef4d: Use Python 3.6 since celery 4.2 is not yet compatible with python 3.7 (authored by douardda).
Use Python 3.6 since celery 4.2 is not yet compatible with python 3.7
Tue, Nov 26, 1:35 PM
douardda committed rDENV8deedeb75ae8: No need to expose port 5008 in swh-scheduler-worker's Dockerfile (authored by douardda).
No need to expose port 5008 in swh-scheduler-worker's Dockerfile
Tue, Nov 26, 1:34 PM