Page Menu
Home
Software Heritage
Search
Configure Global Search
Log In
Paste
P200
deposit load commands
Active
Public
Actions
Authored by
moranegg
on Dec 5 2017, 4:50 PM.
Edit Paste
Archive Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
None
Subscribers
None
commands for running deposit load:
- run sword server on port 5006: in swh-deposit: make run-dev
- update deposit db in swh deposit: make db-migrate
- run deposit with metadata locally in bin/: make new-complete
- run local storage: python3 -m swh.storage.api.server ~/.config/swh/storage.yml
# run storage api server (port 5002)
- run celery: python3 -m celery worker --app=swh.scheduler.celery_backend.config.app --pool=prefork --events --concurrency=10 -Ofair --loglevel=DEBUG --without-gossip --without-mingle --without-heartbeat
(view launch-celery P73)
- review options for deposit scheduuling: python3 -m swh.deposit.loader.scheduler --help
- schedule check task: python3 -m swh.deposit.loader.scheduler --check --platform development --scheduling-method swh-scheduler
- schedule load task: python3 -m swh.deposit.loader.scheduler --platform development --scheduling-method swh-scheduler
- run tasks scheduled: python3 -m swh.scheduler.celery_backend.runner
Open dbs (configure in ~/.pg_service.conf):
- psql service=swh-deposit-dev (for deposits)
- psql service=swh-scheduler-dev (for tasks)
- psql service=swh-dev (for local data)
Don't forget 'make rebuild-testdata' in swh-environment
Event Timeline
moranegg
created this paste.
Dec 5 2017, 4:50 PM
2017-12-05 16:50:55 (UTC+1)
moranegg
edited the content of this paste.
(Show Details)
Dec 6 2017, 3:52 PM
2017-12-06 15:52:02 (UTC+1)
moranegg
mentioned this in
T869: Test deposit workflow from start to vault cooking
.
Dec 6 2017, 4:11 PM
2017-12-06 16:11:05 (UTC+1)
moranegg
edited the content of this paste.
(Show Details)
Jan 3 2018, 3:53 PM
2018-01-03 15:53:28 (UTC+1)
moranegg
edited the content of this paste.
(Show Details)
Jan 10 2018, 11:25 AM
2018-01-10 11:25:11 (UTC+1)
moranegg
edited the content of this paste.
(Show Details)
Jan 12 2018, 11:51 AM
2018-01-12 11:51:35 (UTC+1)
Log In to Comment