commands for running deposit load:
- run sword server on port 5006: in swh-deposit: make run-dev
- update deposit db in swh deposit: make db-migrate
- run deposit with metadata locally in bin/: make new-complete
- run local storage: python3 -m swh.storage.api.server ~/.config/swh/storage.yml
# run storage api server (port 5002)
- review options for deposit scheduuling: python3 -m swh.deposit.loader.scheduler --help
- schedule check task: python3 -m swh.deposit.loader.scheduler --check --platform development --scheduling-method swh-scheduler
- schedule load task: python3 -m swh.deposit.loader.scheduler --platform development --scheduling-method swh-scheduler
- run tasks scheduled: python3 -m swh.scheduler.celery_backend.runner
- run celery: python3 -m celery worker --app=swh.scheduler.celery_backend.config.app --pool=prefork --events -concurrency=10 -Ofair --loglevel=DEBUG --without-gossip --without-mingle --without-heartbeat
(view launch-celery P73)
Open dbs (configure in ~/.pg_service.conf):
- psql service=swh-deposit-dev (for deposits)
- psql service=swh-scheduler-dev (for tasks)
- psql service=swh-dev (for local data)
Don't forget 'make rebuild-testdata' in swh-environment