Cypress parallel testing references:
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Mar 28 2022
Mar 28 2022
Mar 16 2022
Mar 16 2022
Feb 18 2022
Feb 18 2022
Jan 4 2022
Jan 4 2022
Dec 16 2021
Dec 16 2021
Issue upstream closed.
Mostly all swh repository (besides loader-bzs which @Alphare will take care of) are back to green now.
It was suggested to drop the type annotation in those files [1].
olasd renamed T3812: Fix builds broken by mypy 0.920 from Fix jenkins builds to Fix builds broken by mypy 0.920.
Dec 1 2021
Dec 1 2021
zack moved T2054: CI: ImportMismatchError when running on swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2055: swh-graph CI hangs badly when py4j doesn't find needed files from Backlog to Deployed on the Compressed graph service board.
zack moved T2768: unbreak swh-graph CI from Backlog to Deployed on the Compressed graph service board.
Jul 7 2021
Jul 7 2021
After some hacks on the current Jenkins pipeline for swh-web to test if it was feasible, I managed to setup the use of sorry-cypress but could not run multiple cypress in parallel as Jenkins pipelines forbid nested parallel stages.
So this would require setting up a dedicated pipeline build job for cypress tests as currently Python and cypress tests are executed in parallel in a single job.
Jul 6 2021
Jul 6 2021
May 19 2021
May 19 2021
Issue is now solved, closing this.
awesome, thanks :)
May 18 2021
May 18 2021
and the build is green ;)
16:50:52 ============================= test session starts ============================== 16:50:52 platform linux -- Python 3.7.3, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 16:50:52 cachedir: .tox/py3/.pytest_cache 16:50:52 rootdir: /var/lib/jenkins/workspace/swh-docker-dev/docker 16:50:52 plugins: testinfra-6.3.0, testinfra-6.0.0 16:50:52 collected 7 items 16:50:52 16:50:52 tests/test_deposit.py ..... [ 71%] 16:53:13 tests/test_git_loader.py . [ 85%]
thanks for having investigated that
So the docker_default network did not get removed since April 20, 2021, see docker network inspect docker_default output below:
15:07:16 [
15:07:16 {
15:07:16 "Name": "docker_default",
15:07:16 "Id": "a0145eb2f5b3f055bfafce7a88289346c4668f3a19f2544122267272cd96f7b3",
15:07:16 "Created": "2021-04-20T02:57:51.141593622Z",
15:07:16 "Scope": "local",
15:07:16 "Driver": "bridge",
15:07:16 "EnableIPv6": false,
15:07:16 "IPAM": {
15:07:16 "Driver": "default",
15:07:16 "Options": null,
15:07:16 "Config": [
15:07:16 {
15:07:16 "Subnet": "172.28.0.0/16",
15:07:16 "Gateway": "172.28.0.1"
15:07:16 }
15:07:16 ]
15:07:16 },
15:07:16 "Internal": false,
15:07:16 "Attachable": true,
15:07:16 "Ingress": false,
15:07:16 "ConfigFrom": {
15:07:16 "Network": ""
15:07:16 },
15:07:16 "ConfigOnly": false,
15:07:16 "Containers": {},
15:07:16 "Options": {},
15:07:16 "Labels": {
15:07:16 "com.docker.compose.network": "default",
15:07:16 "com.docker.compose.project": "docker",
15:07:16 "com.docker.compose.version": "1.29.1"
15:07:16 }
15:07:16 }
15:07:16 ]May 12 2021
May 12 2021
May 10 2021
May 10 2021
We should also build the whole documentation when submitting a diff to swh-docs, some sphinx errors not related to packages documentation could be caught this way (see https://jenkins.softwareheritage.org/job/DDOC/job/dev/5700/artifact/swh-docs/docs/errors.log)
May 5 2021
May 5 2021
vsellier closed T3307: apidoc generation is not performed on swh modules during dev build as Resolved.
vsellier added a comment to T3307: apidoc generation is not performed on swh modules during dev build.
@anlambert I didn't succeed to work with link to the modules, but I found another way with a standard installation (i.e without the -e flag) we can force with a flag on the ci (cf D5681).
I really not sure if it's the good approach or not.
vsellier renamed T3307: apidoc generation is not performed on swh modules during dev build from swh dependencies not installed during dev build to apidoc generation is not performed on swh modules during dev build.
vsellier added a comment to T3307: apidoc generation is not performed on swh modules during dev build.
thanks a lot @anlambert, I will look in that direction
anlambert added a comment to T3307: apidoc generation is not performed on swh modules during dev build.
@vsellier, you should be able to create the required symbolic links by adding an extra step in the apidoc-stamp make target.
vsellier added a comment to T3307: apidoc generation is not performed on swh modules during dev build.
Aparrently, the modules are well installed but the sphinx-apidoc is not detecting them due to the local installation
jenkins@4e5220b923d8:~/workspace/swh-environment/swh-docs$ .tox/sphinx-dev/bin/python3 -m pip list | grep swh swh.auth 0.5.4 /home/jenkins/workspace/swh-environment/swh-auth swh.core 0.13.2.dev1+g7d42035 /home/jenkins/workspace/swh-environment/swh-core swh.counters 0.7.1.dev1+g6a44a84 /home/jenkins/workspace/swh-environment/swh-counters swh.deposit 0.13.6 /home/jenkins/workspace/swh-environment/swh-deposit swh.docs 0.0.1.dev334+g044cb9b.d20210505 swh.fuse 1.0.3 /home/jenkins/workspace/swh-environment/swh-fuse swh.graph 0.3.2.dev3+g62c2fd3 /home/jenkins/workspace/swh-environment/swh-graph swh.icinga-plugins 0.3.1.dev1+g8878925 /home/jenkins/workspace/swh-environment/swh-icinga-plugins swh.indexer 0.7.1.dev4+g8f1fb0f /home/jenkins/workspace/swh-environment/swh-indexer swh.journal 0.7.2.dev8+g2972c7a /home/jenkins/workspace/swh-environment/swh-journal swh.lister 1.1.0 /home/jenkins/workspace/swh-environment/swh-lister swh.loader.core 0.22.1.dev2+g0e4bb4b /home/jenkins/workspace/swh-environment/swh-loader-core swh.loader.git 0.9.2.dev1+g15e12fa /home/jenkins/workspace/swh-environment/swh-loader-git swh.loader.mercurial 0.5.1.dev4+g8884714 /home/jenkins/workspace/swh-environment/swh-loader-mercurial swh.loader.svn 0.7.1 /home/jenkins/workspace/swh-environment/swh-loader-svn swh.model 2.4.2.dev1+gdf036ef /home/jenkins/workspace/swh-environment/swh-model swh.objstorage 0.2.3 /home/jenkins/workspace/swh-environment/swh-objstorage swh.objstorage.replayer 0.2.2 /home/jenkins/workspace/swh-environment/swh-objstorage-replayer swh.scanner 0.4.2.dev1+g30b40cc /home/jenkins/workspace/swh-environment/swh-scanner swh.scheduler 0.13.1.dev5+gbab557e /home/jenkins/workspace/swh-environment/swh-scheduler swh.search 0.8.1 /home/jenkins/workspace/swh-environment/swh-search swh.storage 0.27.5.dev4+g051b7715 /home/jenkins/workspace/swh-environment/swh-storage swh.vault 0.5.2.dev2+gf87dd54 /home/jenkins/workspace/swh-environment/swh-vault swh.web 0.0.307.dev3+gf8c750b6 /home/jenkins/workspace/swh-environment/swh-web swh.web.client 0.3.1.dev1+g4b610ad /home/jenkins/workspace/swh-environment/swh-web-client
sphinx-apidoc \ --implicit-namespaces \ --templatedir=../swh/docs/templates/ \ --maxdepth=3 \ --ext-viewcode --separate \ -o apidoc \ /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh \ /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/tests /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/tests/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/tests/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/*/tests/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/migrations /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/migrations/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/migrations/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/*/migrations/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/wsgi.py /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/wsgi.py /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/*/wsgi.py /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/*/*/*/wsgi.py /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/deposit/settings/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/web/settings/* /home/jenkins/workspace/swh-environment/swh-docs/.tox/sphinx-dev/lib/python3.7/site-packages/swh/dataset/* Creating file apidoc/swh.rst. Creating file apidoc/swh.docs.rst. Creating file apidoc/swh.docs.django_settings.rst. Creating file apidoc/swh.docs.sphinx.rst. Creating file apidoc/swh.docs.sphinx.conf.rst. Creating file apidoc/swh.docs.sphinx.view_in_phabricator.rst. Creating file apidoc/modules.rst.
anlambert added a comment to T3307: apidoc generation is not performed on swh modules during dev build.
This is not a dependencies installation issue. When the swh packages are installed in dev mode (pip -e) and the global doc is built, the apidoc files are generated in swh-docs/docs/apidoc, but as those files are linked in the index.rst file of each package, sphinx expects them to be in swh-docs/docs/<swh_package>/apidoc so the warnings.
vsellier changed the status of T3307: apidoc generation is not performed on swh modules during dev build from Open to Work in Progress.
Less warnings to distract us when something goes wrong in the build.
vsellier added a reviewer for D5674: sphinx: Fix the creation of the pre-commit file during the mr update: Reviewers.
Apr 28 2021
Apr 28 2021
Solution 3 has been implemented through new tox environments in each swh package.
Apr 27 2021
Apr 27 2021
moranegg moved T3258: Build documentation on every diff from Backlog to building docs on the Documentation board.
moranegg moved T3148: Make Jenkins publish the built documentation on swh-docs diffs from sponsors/clients to building docs on the Documentation board.
moranegg moved T3148: Make Jenkins publish the built documentation on swh-docs diffs from Backlog to sponsors/clients on the Documentation board.
Apr 26 2021
Apr 26 2021
Apr 21 2021
Apr 21 2021
Apr 20 2021
Apr 20 2021
Apr 17 2021
Apr 17 2021
This should help:
12:08 <+ardumont> fwiw, i don't see swh-dataset in the jenkins ci declaration so that won't get published 12:08 <+ardumont> https://forge.softwareheritage.org/source/swh-jenkins-jobs/browse/master/jobs/swh-packages.yaml 12:10 <+ardumont> (relatedly without ^ that won't show up in jenkins) 12:10 <+ardumont> related docs https://wiki.softwareheritage.org/wiki/Debian_packaging#Setting_up_the_repository_on_Phabricator and https://wiki.softwareheritage.org/wiki/Debian_packaging#Setting_up_the_repository_on_Phabricator
Apr 16 2021
Apr 16 2021
Mar 17 2021
Mar 17 2021
Dec 11 2020
Dec 11 2020
ardumont moved T2871: Unstuck deposit tests failing the docker-dev and icinga-plugins from Backlog to Deployed on the SWORD deposit board.
Dec 10 2020
Dec 10 2020
v0.7.1 packaged fixed the docker-dev build.
D4715 fixed the icinga plugins build.
ardumont updated the task description for T2871: Unstuck deposit tests failing the docker-dev and icinga-plugins.
Dec 9 2020
Dec 9 2020
ardumont updated the task description for T2871: Unstuck deposit tests failing the docker-dev and icinga-plugins.
ardumont renamed T2871: Unstuck deposit tests failing the docker-dev and icinga-plugins from Unstuck deposit tests failing the docker-dev to Unstuck deposit tests failing the docker-dev and icinga-plugins.
ardumont updated the task description for T2871: Unstuck deposit tests failing the docker-dev and icinga-plugins.
ardumont triaged T2871: Unstuck deposit tests failing the docker-dev and icinga-plugins as Normal priority.
Nov 12 2020
Nov 12 2020
anlambert closed T2768: unbreak swh-graph CI as Resolved by committing rDGRPH262432b1295d: server/app: Fix aiohttp >= 3.7 exception related errors.
Nov 10 2020
Nov 10 2020
Oct 26 2020
Oct 26 2020
Oct 26 2020, 12:30 PM · Metrics/monitoring, Restricted Project, Continuous Integration, System administration
douardda closed T1370: Report key code metrics in prometheus, a subtask of T1024: Proper continuous integration setup, as Resolved.
Oct 22 2020
Oct 22 2020