Page MenuHomeSoftware Heritage
Feed Advanced Search

Dec 9 2019

douardda closed D2415: docker/Dockefile: clean the $HOME/.cache/ at the end of the build.
Dec 9 2019, 4:40 PM
douardda committed rDENVbaeb787d8d9b: docker/nginx: use standard port 80 in nginx's container (authored by douardda).
docker/nginx: use standard port 80 in nginx's container
Dec 9 2019, 4:40 PM
douardda closed D2414: docker/nginx: use standard port 80 in nginx's container.
Dec 9 2019, 4:40 PM
douardda committed rDENV57ab82a18cd2: Rename swh-scheduler-api as swh-scheduler and swh-vault-api as swh-vault (authored by douardda).
Rename swh-scheduler-api as swh-scheduler and swh-vault-api as swh-vault
Dec 9 2019, 4:40 PM
douardda closed D2413: Rename swh-scheduler-api as swh-scheduler and swh-vault-api as swh-vault.
Dec 9 2019, 4:40 PM
douardda updated the diff for D2415: docker/Dockefile: clean the $HOME/.cache/ at the end of the build.

rebased

Dec 9 2019, 4:38 PM
douardda updated the diff for D2414: docker/nginx: use standard port 80 in nginx's container.

rebased

Dec 9 2019, 4:37 PM
douardda updated the diff for D2413: Rename swh-scheduler-api as swh-scheduler and swh-vault-api as swh-vault.

forgot a few matches, as noticed by anlambert

Dec 9 2019, 4:34 PM
douardda added a comment to D2413: Rename swh-scheduler-api as swh-scheduler and swh-vault-api as swh-vault.

I totally agree on this. You miss some replacements in the tests and the README though.

Dec 9 2019, 4:29 PM
douardda created D2417: docker/compose: add rabbitmq_exporter service.
Dec 9 2019, 4:26 PM
douardda created D2416: docker/compose: configure the statsd endpoint for most of the containers.
Dec 9 2019, 4:26 PM
douardda created D2415: docker/Dockefile: clean the $HOME/.cache/ at the end of the build.
Dec 9 2019, 4:25 PM
douardda created D2414: docker/nginx: use standard port 80 in nginx's container.
Dec 9 2019, 4:25 PM
douardda created D2413: Rename swh-scheduler-api as swh-scheduler and swh-vault-api as swh-vault.
Dec 9 2019, 4:23 PM
douardda moved T2122: Lister monitoring: add statsd probe for each lister instance from in progress to Backlog on the Sprint 2019/12 (Monitor and Conquer) board.
Dec 9 2019, 1:51 PM · Sprint 2019/12 (Monitor and Conquer)
douardda added a comment to T2122: Lister monitoring: add statsd probe for each lister instance.

Okay I see no "simple" way of doing this with the current implementation of tasks using SWHTask.

Dec 9 2019, 12:32 PM · Sprint 2019/12 (Monitor and Conquer)

Dec 6 2019

douardda moved T2122: Lister monitoring: add statsd probe for each lister instance from Backlog to in progress on the Sprint 2019/12 (Monitor and Conquer) board.
Dec 6 2019, 10:36 AM · Sprint 2019/12 (Monitor and Conquer)
douardda closed T2133: Scheduler listener/runner: add statsd probes as Resolved.

Closed by D2394

Dec 6 2019, 10:22 AM · Metrics/monitoring, Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
douardda committed rDSCHa18f56205d1d: celery: add 2 statsd probes for the runner and listener (authored by douardda).
celery: add 2 statsd probes for the runner and listener
Dec 6 2019, 10:22 AM
douardda closed D2394: celery: add 2 statsd probes for the runner and listener.
Dec 6 2019, 10:22 AM

Dec 5 2019

douardda accepted D2395: package.archive: Move archive loader to its own namespace.

LGTM

Dec 5 2019, 12:04 PM · SWH command line interface, Core Loader

Dec 4 2019

douardda updated the diff for D2394: celery: add 2 statsd probes for the runner and listener.

ok, let's keep _scheduler_ in probe names

Dec 4 2019, 4:37 PM
douardda added inline comments to D2394: celery: add 2 statsd probes for the runner and listener.
Dec 4 2019, 4:20 PM
douardda updated the diff for D2394: celery: add 2 statsd probes for the runner and listener.

I said -scheduler !

Dec 4 2019, 4:18 PM
douardda updated the diff for D2394: celery: add 2 statsd probes for the runner and listener.

rebased + rename statsd probes (-scheduler/+total)

Dec 4 2019, 3:27 PM
douardda committed rDSCH08243bbc9e3e: tests: fix celery_task's test_multiping (authored by douardda).
tests: fix celery_task's test_multiping
Dec 4 2019, 3:12 PM
douardda committed rDSCHf206076232a8: celery: make SWHTask send start/end of execution statsd gauges with timestamps (authored by douardda).
celery: make SWHTask send start/end of execution statsd gauges with timestamps
Dec 4 2019, 3:12 PM
douardda closed T2119: Monitoring of workers as Resolved by committing rDSCHf206076232a8: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Dec 4 2019, 3:12 PM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
douardda closed D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Dec 4 2019, 3:12 PM
douardda added a revision to T2133: Scheduler listener/runner: add statsd probes: D2394: celery: add 2 statsd probes for the runner and listener.
Dec 4 2019, 10:58 AM · Metrics/monitoring, Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
douardda created D2394: celery: add 2 statsd probes for the runner and listener.
Dec 4 2019, 10:58 AM
douardda created D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Dec 4 2019, 10:30 AM
douardda added a revision to T2119: Monitoring of workers: D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Dec 4 2019, 10:30 AM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)

Dec 3 2019

douardda moved T2119: Monitoring of workers from Backlog to in progress on the Sprint 2019/12 (Monitor and Conquer) board.
Dec 3 2019, 11:37 AM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)

Nov 29 2019

douardda committed rDJNL3bb1d771c4bc: replay: use tag based statsd probes (authored by douardda).
replay: use tag based statsd probes
Nov 29 2019, 3:35 PM
douardda closed D2377: replay: use tag based statsd probes.
Nov 29 2019, 3:35 PM
douardda created D2377: replay: use tag based statsd probes.
Nov 29 2019, 3:10 PM
douardda committed rDJNL3f61999d2d08: replay: add a bit of statsd probing in process_replay_objects (authored by douardda).
replay: add a bit of statsd probing in process_replay_objects
Nov 29 2019, 11:49 AM
douardda closed D2374: replay: add a bit of statsd probing in process_replay_objects.
Nov 29 2019, 11:49 AM
douardda updated the diff for D2374: replay: add a bit of statsd probing in process_replay_objects.

rebased

Nov 29 2019, 11:46 AM
douardda committed rDJNL0177a9272bbe: replay: ensure a revision is present only once in a batch (authored by douardda).
replay: ensure a revision is present only once in a batch
Nov 29 2019, 11:45 AM
douardda closed D2372: replay: ensure a revision is present only once in a batch.
Nov 29 2019, 11:45 AM
douardda accepted D2370: Hide history link for empty snapshot.

LGTM but I'm not very used to the webapp's code.

Nov 29 2019, 11:04 AM
douardda requested changes to D2371: tarball: Add support for tar.Z, tar.x, tar.lz files.
Nov 29 2019, 11:01 AM
douardda accepted D2376: docker/README: drop obsolete mentions of swh-docker-dev.

looks very good to me, thanks!

Nov 29 2019, 10:12 AM

Nov 28 2019

douardda created D2374: replay: add a bit of statsd probing in process_replay_objects.
Nov 28 2019, 5:20 PM
douardda accepted D2367: pypi: metadata -> revision: Deal with previous metadata format.
Nov 28 2019, 5:14 PM
douardda created D2372: replay: ensure a revision is present only once in a batch.
Nov 28 2019, 4:16 PM
douardda created P564 revisions in journal.
Nov 28 2019, 4:04 PM
douardda accepted D2365: npm: metadata -> revision: Deal with previous metadata format.
Nov 28 2019, 11:55 AM

Nov 27 2019

douardda accepted D2360: sphinx/Dockerfile: Add missing pre-commit dependency.

Not very fond, but will work and remains the simplest solution.

Nov 27 2019, 10:19 AM

Nov 26 2019

douardda committed rDENV12931aff1a94: Dockerfile: fix a typo in var substitution (authored by douardda).
Dockerfile: fix a typo in var substitution
Nov 26 2019, 3:42 PM
douardda committed rDENV74252ff5d8cc: Allow to set CASS_DRIVER_ env vars when building the docker image (authored by douardda).
Allow to set CASS_DRIVER_ env vars when building the docker image
Nov 26 2019, 3:37 PM
douardda committed rDENV78ee2eeb7ae2: Stop referencing swh-docker-dev in .mrconfig (authored by douardda).
Stop referencing swh-docker-dev in .mrconfig
Nov 26 2019, 1:48 PM
douardda committed rDENV357084c46082: Fix entrypoint of most services (authored by douardda).
Fix entrypoint of most services
Nov 26 2019, 1:39 PM
douardda closed T2097: Merge swh-docker-dev into swh-environment as Resolved.

Closed by 9a98e8be06817055693671cfbe6917645171993e

Nov 26 2019, 1:36 PM · Docker environment, Development environment
douardda committed rDENVc8591006d03b: Dockerfile: get rid of swh-loader-xxx for packages loaders (authored by douardda).
Dockerfile: get rid of swh-loader-xxx for packages loaders
Nov 26 2019, 1:35 PM
douardda committed rDENV9a98e8be0681: Merge 'swh-docker-dev' into master (authored by douardda).
Merge 'swh-docker-dev' into master
Nov 26 2019, 1:35 PM
douardda committed rDENV3b0c74bc80ba: Dockerfile: install cassandra-driver in a dedicated step (authored by douardda).
Dockerfile: install cassandra-driver in a dedicated step
Nov 26 2019, 1:35 PM
douardda committed rDENV7b2e570a57da: Dockerfile: use --no-install-recommends for r-cran packages (authored by douardda).
Dockerfile: use --no-install-recommends for r-cran packages
Nov 26 2019, 1:35 PM
douardda committed rDENV9b12218d59cd: entrypoints: ensure gunicorn services can handle more than one connection (authored by douardda).
entrypoints: ensure gunicorn services can handle more than one connection
Nov 26 2019, 1:35 PM
douardda committed rDENV8d48959f9643: Dockerfile: update to python 3.7 (authored by douardda).
Dockerfile: update to python 3.7
Nov 26 2019, 1:35 PM
douardda committed rDENV00d3f8f35840: README: update doc to use the new 'swh' master cli tool (authored by douardda).
README: update doc to use the new 'swh' master cli tool
Nov 26 2019, 1:35 PM
douardda committed rDENV30e9c934ef20: lister: allways run the db initialization step (authored by douardda).
lister: allways run the db initialization step
Nov 26 2019, 1:35 PM
douardda committed rDENVb7f02d8add7f: dockerfile: install python packages in a venv under the swh user (authored by douardda).
dockerfile: install python packages in a venv under the swh user
Nov 26 2019, 1:35 PM
douardda committed rDENV53fa588c7fc2: Factorise the pip install of source repos in a shell function (authored by douardda).
Factorise the pip install of source repos in a shell function
Nov 26 2019, 1:35 PM
douardda committed rDENV6d49580cd56c: replica: ensure entrypoints are defined in replica related services (authored by douardda).
replica: ensure entrypoints are defined in replica related services
Nov 26 2019, 1:35 PM
douardda committed rDENV7b0ea2803606: Remove entrypoint.sh files from the Dockerfile (authored by douardda).
Remove entrypoint.sh files from the Dockerfile
Nov 26 2019, 1:35 PM
douardda committed rDENV6558c6c8ad18: entrypoint: pgsql has been moved to ~swh/ (authored by douardda).
entrypoint: pgsql has been moved to ~swh/
Nov 26 2019, 1:35 PM
douardda committed rDENVd1f5b87ba8c7: Dockerfile: small readability refactoring (authored by douardda).
Dockerfile: small readability refactoring
Nov 26 2019, 1:35 PM
douardda committed rDENV587f9df57a80: lister: Use explicit postgresql URLs as a workaround for a sqlalchemy issue (authored by douardda).
lister: Use explicit postgresql URLs as a workaround for a sqlalchemy issue
Nov 26 2019, 1:35 PM
douardda committed rDENV9359da6dbf95: Add support for a kafka-powered replica of the graph. (authored by douardda).
Add support for a kafka-powered replica of the graph.
Nov 26 2019, 1:35 PM
douardda committed rDENV20b0733b84f3: swh-web: enforce the database file to be created in either $HOME or /tmp (authored by douardda).
swh-web: enforce the database file to be created in either $HOME or /tmp
Nov 26 2019, 1:35 PM
douardda committed rDENV8a2458ee2bf0: compose: fix inconsistent dependency (authored by douardda).
compose: fix inconsistent dependency
Nov 26 2019, 1:35 PM
douardda committed rDENVc56678130229: readme: integrate the docker-based development setup from the main's doc (authored by douardda).
readme: integrate the docker-based development setup from the main's doc
Nov 26 2019, 1:35 PM
douardda committed rDENV6417e87e38e0: readme: make it compliant with phabricator's limited remarkup format (authored by douardda).
readme: make it compliant with phabricator's limited remarkup format
Nov 26 2019, 1:35 PM
douardda committed rDENV8871e9cd32eb: swh-scheduler: add SWH_CONFIG_FILENAME and SWH_SCHEDULER_CONFIG_FILE env vars (authored by douardda).
swh-scheduler: add SWH_CONFIG_FILENAME and SWH_SCHEDULER_CONFIG_FILE env vars
Nov 26 2019, 1:35 PM
douardda committed rDENVd192c1cde3d7: docker-compose: move the swh-indexer-journal-client in the journal "section" (authored by douardda).
docker-compose: move the swh-indexer-journal-client in the journal "section"
Nov 26 2019, 1:35 PM
douardda committed rDENV0b031ba074df: web: remove djangosettings.py file and use swh.web.settings.development (authored by douardda).
web: remove djangosettings.py file and use swh.web.settings.development
Nov 26 2019, 1:35 PM
douardda committed rDENV0c89cd3350bb: dockerfile: ensure swh-web's version of pip is up to date (authored by douardda).
dockerfile: ensure swh-web's version of pip is up to date
Nov 26 2019, 1:35 PM
douardda committed rDENV7b3213293ca1: conf: make swh-web always serve assets (authored by douardda).
conf: make swh-web always serve assets
Nov 26 2019, 1:35 PM
douardda committed rDENVaac4cff40773: grafana: replace the tasks dashboard with olasd's task-processing one (authored by douardda).
grafana: replace the tasks dashboard with olasd's task-processing one
Nov 26 2019, 1:35 PM
douardda committed rDENV777d5be54ec0: Fix nginx revert proxy for rabbitmq (authored by douardda).
Fix nginx revert proxy for rabbitmq
Nov 26 2019, 1:35 PM
douardda committed rDENV1f10d774be7b: Fix celery workers conf files: explicit list of queues is now required (authored by douardda).
Fix celery workers conf files: explicit list of queues is now required
Nov 26 2019, 1:35 PM
douardda committed rDENV3a7e4df76175: Activate a 10s heartbeat for celery workers (authored by douardda).
Activate a 10s heartbeat for celery workers
Nov 26 2019, 1:35 PM
douardda committed rDENV48038bdb707a: Upgrade to pg 11 (authored by douardda).
Upgrade to pg 11
Nov 26 2019, 1:35 PM
douardda committed rDENV2ed0c7833c5b: Add the vault services (api and worker) and make them avaible in swh-web (authored by douardda).
Add the vault services (api and worker) and make them avaible in swh-web
Nov 26 2019, 1:35 PM
douardda committed rDENV0ac8db330055: Move options and arguments of the swh manage command as COMMAND (authored by douardda).
Move options and arguments of the swh manage command as COMMAND
Nov 26 2019, 1:35 PM
douardda committed rDENVbb38cd93622e: Deploy a djangossettings.py for swh-web that allows to set a dumd asmin password (authored by douardda).
Deploy a djangossettings.py for swh-web that allows to set a dumd asmin password
Nov 26 2019, 1:35 PM
douardda committed rDENV7000265592f0: Update the lister entrypoint to make latest cli updates (authored by douardda).
Update the lister entrypoint to make latest cli updates
Nov 26 2019, 1:35 PM
douardda committed rDENV452185dac5ef: Very beginning of a grafana service (authored by douardda).
Very beginning of a grafana service
Nov 26 2019, 1:35 PM
douardda committed rDENV7a0178e5c839: Improve a bit the README file (authored by douardda).
Improve a bit the README file
Nov 26 2019, 1:35 PM
douardda committed rDENV842f819f3439: Merge all loaders and listers services in swh-loader and swh-lister (authored by douardda).
Merge all loaders and listers services in swh-loader and swh-lister
Nov 26 2019, 1:35 PM
douardda committed rDENV29c9481102d3: Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used (authored by douardda).
Ensure PATH contains ~/.local/bin for dockers where 'pip install --user' is used
Nov 26 2019, 1:35 PM
douardda committed rDENVa1d4f5a8f5de: Move all swh config file in conf/ and use volumes to inject them in dockers (authored by douardda).
Move all swh config file in conf/ and use volumes to inject them in dockers
Nov 26 2019, 1:35 PM
douardda committed rDENV7ddf391cdccb: Reduce verbosity of the journal pusblisher and storage listener. (authored by douardda).
Reduce verbosity of the journal pusblisher and storage listener.
Nov 26 2019, 1:35 PM
douardda committed rDENVf8ca643a0508: Install kombu from sources in scheduler-worker as a workaround for T1491 (authored by douardda).
Install kombu from sources in scheduler-worker as a workaround for T1491
Nov 26 2019, 1:35 PM
douardda committed rDENV144f580b4662: Workers' celery config is now managed as the [celery] section of the main… (authored by douardda).
Workers' celery config is now managed as the [celery] section of the main…
Nov 26 2019, 1:35 PM
douardda committed rDENV4dcbc2cf5e5a: Update config system for scheduler services (authored by douardda).
Update config system for scheduler services
Nov 26 2019, 1:35 PM
douardda committed rDENVf1aae8764ed0: Reduce the slicing for objstorage (authored by douardda).
Reduce the slicing for objstorage
Nov 26 2019, 1:35 PM