Just testing if those errors still popup when building that diff on Jenkins using multiple jobs in parallel.
Details
Details
- Reviewers
vlorentz - Group Reviewers
Reviewers - Commits
- rDWAPPSddcfa6ce48c1: sqlite: Prevent locked database errors when running cypress tests
Diff Detail
Diff Detail
- Repository
- rDWAPPS Web applications
- Branch
- master
- Lint
No Linters Available - Unit
No Unit Test Coverage - Build Status
Buildable 31022 Build 48527: Phabricator diff pipeline on jenkins Jenkins console · Jenkins Build 48526: arc lint + arc unit
| Time | Test | |
|---|---|---|
| 250,503 ms | Jenkins > .tox.py3.lib.python3.7.site-packages.swh.web.tests.api.views.test_origin::Tests / Python tests / test_api_lookup_origin_visits_by_id api_client = <rest_framework.test.APIClient object at 0x7fe756381860>
subtest = <function subtest.<locals>.inner at 0x7fe757f24730>
| |
| 0 ms | Coverage Data | |
| 0 ms | Coverage Data | |
| 0 ms | Coverage Data | |
| 237 ms | Jenkins > .tox.py3.lib.python3.7.site-packages.swh.web.tests.add_forge_now.test_api_views::Tests / Python tests / test_add_forge_request_create_anonymous_user | |
| View Full Test Results (1 Failed · 4,098 Passed · 8 Skipped) |
Event Timeline
Comment Actions
Build is green
Patch application report for D8300 (id=29966)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 4bff6ddb4e341bf391ecb4be1fa2918455d4f4cb
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Tue Aug 23 19:18:26 2022 +0200
sqlite: Try to mitigate locked database when running tests in parallelSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2002/ for more details.
Comment Actions
Build is green
Patch application report for D8300 (id=29966)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 4bff6ddb4e341bf391ecb4be1fa2918455d4f4cb
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Tue Aug 23 19:18:26 2022 +0200
sqlite: Try to mitigate locked database when running tests in parallelSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2003/ for more details.
Comment Actions
Build is green
Patch application report for D8300 (id=29966)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 4bff6ddb4e341bf391ecb4be1fa2918455d4f4cb
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Tue Aug 23 19:18:26 2022 +0200
sqlite: Try to mitigate locked database when running tests in parallelSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2004/ for more details.
Comment Actions
Have you tried PRAGMA journal_mode = WAL? It should allow running queries in parallel without locking like this. (and https://stackoverflow.com/a/6843199/539465 to apply it)
Comment Actions
Actually, what about changing the DB path, so both tests instances don't use the same? :memory: might even work
Comment Actions
Actually, reading tests configuration, Python tests use a postgres db while Cypress ones use a sqlite db so looks like
the locked database is due to the cypress tests execution only (we have some cypress tasks populating db dynamically,
they are supposed to be synchronous but my guess is that issues must come from here).
For Python tests, the postgresdb is created on the fly using pytest-postgresql magics, for cypress ones we cannot
use them unfortunately.
I will try the WAL journal approach then.
Comment Actions
Hmm it's probably not good to have multiple tests using the same DB at the same time, but I don't see how to avoid it if it all runs in the same process :/
Comment Actions
Build is green
Patch application report for D8300 (id=29972)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 03cdf5b4e72c6d965c79f8ca028b1dfd189ba17f
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Wed Aug 24 11:44:05 2022 +0200
sqlite: Try to mitigate locked database when running cypress testsSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2006/ for more details.
Comment Actions
Build is green
Patch application report for D8300 (id=29972)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 03cdf5b4e72c6d965c79f8ca028b1dfd189ba17f
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Wed Aug 24 11:44:05 2022 +0200
sqlite: Try to mitigate locked database when running cypress testsSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2005/ for more details.
Comment Actions
Build has FAILED
Patch application report for D8300 (id=29972)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 03cdf5b4e72c6d965c79f8ca028b1dfd189ba17f
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Wed Aug 24 11:44:05 2022 +0200
sqlite: Try to mitigate locked database when running cypress testsLink to build: https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2007/
See console output for more information: https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2007/console
Comment Actions
Build is green
Patch application report for D8300 (id=29972)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit 03cdf5b4e72c6d965c79f8ca028b1dfd189ba17f
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Wed Aug 24 11:44:05 2022 +0200
sqlite: Try to mitigate locked database when running cypress testsSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2008/ for more details.
Comment Actions
Build is green
Patch application report for D8300 (id=29974)
Rebasing onto 8496d6a551...
Current branch diff-target is up to date.
Changes applied before test
commit ddcfa6ce48c1d5c4e80044197fac576ba66ad7b1
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Wed Aug 24 11:44:05 2022 +0200
sqlite: Prevent locked database errors when running cypress testsSee https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2009/ for more details.