Page MenuHomeSoftware Heritage

cypress: Try to fix some flaky tests when executed in parallel
ClosedPublic

Authored by anlambert on Sep 13 2022, 2:40 PM.

Details

Summary

Some tests often end up flaky when executed in parallel.

This diff is a playground to try fixing those.

Diff Detail

Repository
rDWAPPS Web applications
Branch
cypress-flaky-fixes
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 31526
Build 49318: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 49317: arc lint + arc unit

Event Timeline

Build is green

Patch application report for D8463 (id=30491)

Rebasing onto 104f3b79bf...

Current branch diff-target is up to date.
Changes applied before test
commit 7f99f135d06ca5c589101f8967473df115b33a31
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2052/ for more details.

Build is green

Patch application report for D8463 (id=30491)

Rebasing onto 104f3b79bf...

Current branch diff-target is up to date.
Changes applied before test
commit 7f99f135d06ca5c589101f8967473df115b33a31
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2055/ for more details.

Build is green

Patch application report for D8463 (id=30491)

Rebasing onto 104f3b79bf...

Current branch diff-target is up to date.
Changes applied before test
commit 7f99f135d06ca5c589101f8967473df115b33a31
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2054/ for more details.

It seems the issue comes from the use of some before hooks,
turning them to beforeEach ones seems to fix the issue.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto a0b384e56f...

Current branch diff-target is up to date.
Changes applied before test
commit 7c6de78cbed95e245c9e9cb14cbbe1610043ecb0
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2058/ for more details.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto 5b0ab27a8d...

First, rewinding head to replay your work on top of it...
Applying: cypress: Try to fix some flaky tests when executed in parallel
Changes applied before test
commit c108cc1d921d41d34b266cc3c18658633004128f
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2060/ for more details.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto 5b0ab27a8d...

First, rewinding head to replay your work on top of it...
Applying: cypress: Try to fix some flaky tests when executed in parallel
Changes applied before test
commit 0513a061ec066af44440bf9ef7063de865a94486
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2059/ for more details.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto 5b0ab27a8d...

First, rewinding head to replay your work on top of it...
Applying: cypress: Try to fix some flaky tests when executed in parallel
Changes applied before test
commit acee5f75e6b0935e073720bf0d9fb466e554c1cb
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2061/ for more details.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto 5b0ab27a8d...

First, rewinding head to replay your work on top of it...
Applying: cypress: Try to fix some flaky tests when executed in parallel
Changes applied before test
commit acee5f75e6b0935e073720bf0d9fb466e554c1cb
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2062/ for more details.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto 5b0ab27a8d...

First, rewinding head to replay your work on top of it...
Applying: cypress: Try to fix some flaky tests when executed in parallel
Changes applied before test
commit 4e49d5203e9450142843b8b7a53098d51bd3784d
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2063/ for more details.

Build is green

Patch application report for D8463 (id=30506)

Rebasing onto 5b0ab27a8d...

First, rewinding head to replay your work on top of it...
Applying: cypress: Try to fix some flaky tests when executed in parallel
Changes applied before test
commit d5d062c0ba802784a20c5f69b9d911bb4a0cfe16
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Try to fix some flaky tests when executed in parallel

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2064/ for more details.

Rebase and update commit message

Build is green

Patch application report for D8463 (id=30524)

Rebasing onto 5b0ab27a8d...

Current branch diff-target is up to date.
Changes applied before test
commit f894060b15f6554f77b4d519128cd3eedf5f739f
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Fix some flaky tests when executed in parallel
    
    It seems there is an issue with the before hooks of cypress regarding
    their execution order when running tests in parallel.
    
    So turn some before hooks into beforEach ones to fix some flaky tests.

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2066/ for more details.

This revision is now accepted and ready to land.Sep 15 2022, 10:19 AM

Rebase and fix typo in commit message

Build is green

Patch application report for D8463 (id=30551)

Rebasing onto 58fae8e0ea...

Current branch diff-target is up to date.
Changes applied before test
commit 755755df44b2d413bccf19118885394b1889ca89
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Sep 13 14:38:57 2022 +0200

    cypress: Fix some flaky tests when executed in parallel
    
    It seems there is an issue with the before hooks of cypress regarding
    their execution order when running tests in parallel.
    
    So turn some before hooks into beforeEach ones to fix some flaky tests.

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/2068/ for more details.