Page MenuHomeSoftware Heritage

Continuous IntegrationFolder
ActivePublic

Details

Description

Continuous Integration toolchain, powering https://jenkins.softwareheritage.org/

Recent Activity

Nov 13 2019

seirl closed T2055: swh-graph CI hangs badly when py4j doesn't find needed files as Resolved.

Fixed in https://forge.softwareheritage.org/rDGRPHcd135e6607350710ec5b3403b19a92c1d5a28cf5 and https://forge.softwareheritage.org/rDGRPH164bf7b1464ea3b9eb38c91c2a7caee7d6b149f7

Nov 13 2019, 5:54 PM · Continuous Integration, Graph service

Nov 12 2019

zack assigned T2055: swh-graph CI hangs badly when py4j doesn't find needed files to seirl.

Another simple way to reproduce is just removing the *.jar file and running pytest on test_api_client.py.
This is not even a Java exception, but chances are fixing that case will fix at least a significant part of the general problem, if not all.

Nov 12 2019, 4:16 PM · Continuous Integration, Graph service

Nov 11 2019

zack added a comment to T2055: swh-graph CI hangs badly when py4j doesn't find needed files.

AFAICT this is a more general problem, the Java backend can hang forever in case of unexpected situations (uncaught exceptions? I really don't know…), which will make it not respond to any incoming request with no visible output.
We should make this visible and debuggable.

Nov 11 2019, 1:45 PM · Continuous Integration, Graph service

Nov 8 2019

ardumont closed D2239: base-buster/Dockerfile: Add missing subversion/mercurial dependencies.
Nov 8 2019, 1:37 PM · Continuous Integration
olasd accepted D2239: base-buster/Dockerfile: Add missing subversion/mercurial dependencies.

$kitchen_sink++

Nov 8 2019, 1:36 PM · Continuous Integration
ardumont updated the summary of D2239: base-buster/Dockerfile: Add missing subversion/mercurial dependencies.
Nov 8 2019, 1:35 PM · Continuous Integration

Nov 7 2019

olasd added a comment to T2066: when pushing several commits, only run CI on the most recent commit.

I've been wondering about this for a while too. The only use case for having red/green on every commit is that it might help people who bisect a repo, and it's certainly not worth the downsides that much.

Nov 7 2019, 1:55 PM · Continuous Integration
anlambert added a comment to T2066: when pushing several commits, only run CI on the most recent commit.

+1 on this.

Nov 7 2019, 10:29 AM · Continuous Integration
zack renamed T2066: when pushing several commits, only run CI on the most recent commit from when pushing several commits, do not run CI on all of them to when pushing several commits, only run CI on the most recent commit.
Nov 7 2019, 9:50 AM · Continuous Integration
zack triaged T2066: when pushing several commits, only run CI on the most recent commit as Normal priority.
Nov 7 2019, 9:50 AM · Continuous Integration
zack closed T1024: Proper continuous integration setup as Resolved.

closing this, as we have "proper" CI since quite a while now (it could always be improved of course, but no need to keep the meta task open at this point)

Nov 7 2019, 9:48 AM · Restricted Project, Continuous Integration, System administration

Nov 4 2019

zack renamed T2055: swh-graph CI hangs badly when py4j doesn't find needed files from swh-graph CI hangs badly on test_api_client.py to swh-graph CI hangs badly when py4j doesn't find needed files.
Nov 4 2019, 1:45 PM · Continuous Integration, Graph service
olasd added a comment to T2055: swh-graph CI hangs badly when py4j doesn't find needed files.

The .jar file is never installed within the tox environment, so the graph backend process fixture never actually succeeds in launching the server. FWIW, when running tox on my system, the tests hang just the same.

Nov 4 2019, 11:43 AM · Continuous Integration, Graph service

Nov 3 2019

zack triaged T2055: swh-graph CI hangs badly when py4j doesn't find needed files as Unbreak Now! priority.
Nov 3 2019, 4:46 PM · Continuous Integration, Graph service
zack closed T2054: CI: ImportMismatchError when running on swh-graph as Resolved by committing rDGRPH677daca371fe: tox.ini: fix pytest ImportMismatchError.
Nov 3 2019, 4:25 PM · Graph service, Continuous Integration
zack updated the task description for T2054: CI: ImportMismatchError when running on swh-graph.
Nov 3 2019, 4:12 PM · Graph service, Continuous Integration
zack updated the task description for T2054: CI: ImportMismatchError when running on swh-graph.
Nov 3 2019, 4:07 PM · Graph service, Continuous Integration
zack triaged T2054: CI: ImportMismatchError when running on swh-graph as High priority.
Nov 3 2019, 4:05 PM · Graph service, Continuous Integration

Oct 1 2019

olasd closed T2027: CI: Run swh-graph tests with Python 3.7 as Resolved.

I've rebased the jdk11 image on top of buster using the awful, awful a3776d744f. This means python 3.7 by default, and it looks like swh.graph CI works.

Oct 1 2019, 3:09 PM · Continuous Integration
seirl triaged T2027: CI: Run swh-graph tests with Python 3.7 as Normal priority.
Oct 1 2019, 1:33 PM · Continuous Integration

Sep 19 2019

ardumont added a comment to T2012: ci: Add a rule to prevent push when ci build failure.

I've definitely got a "build failed" automatic notification after a push I did a while ago. I think it was on swh-environment, before we (recently) disabled the CI on it. If this notification behavior is not uniform across repos, we should make it so.

Sep 19 2019, 11:41 PM · Continuous Integration
zack added a comment to T2012: ci: Add a rule to prevent push when ci build failure.
In T2012#37261, @zack wrote:

Count me as -1 on this.

Strict rules like these tend to get in the way of getting work done when you need it.

Sep 19 2019, 10:55 PM · Continuous Integration
zack added a comment to T2012: ci: Add a rule to prevent push when ci build failure.

From what you wrote, what I think will actually fix your problem is seeing the OK/KO CI marker in the list of pending review requests, so that you can just skip the ones with failing build without having to click them. Would that be enough?

Sep 19 2019, 10:45 PM · Continuous Integration
ardumont added a comment to T2012: ci: Add a rule to prevent push when ci build failure.

I totally agree that we need safeguards against pushing stuff that breaks CI, but we seem to have plenty already: we use code review thoroughly, and that triggers CI;

Sep 19 2019, 10:34 PM · Continuous Integration
zack added a comment to T2012: ci: Add a rule to prevent push when ci build failure.

Count me as -1 on this.

Sep 19 2019, 9:55 AM · Continuous Integration
ardumont triaged T2012: ci: Add a rule to prevent push when ci build failure as Normal priority.
Sep 19 2019, 9:48 AM · Continuous Integration
ardumont created T2012: ci: Add a rule to prevent push when ci build failure.
Sep 19 2019, 9:48 AM · Continuous Integration

Aug 2 2019

anlambert closed T1841: Run swh-web's front-end tests on Jenkins as Resolved.
Aug 2 2019, 4:34 PM · Continuous Integration, Web app
anlambert closed T1913: Generate HTML report for cypress tests, a subtask of T1841: Run swh-web's front-end tests on Jenkins, as Resolved.
Aug 2 2019, 4:27 PM · Continuous Integration, Web app
anlambert closed T1913: Generate HTML report for cypress tests as Resolved by committing rCJSWHec692539ecdf: Publish test results and code coverage HTML reports for cypress jobs.
Aug 2 2019, 4:27 PM · Continuous Integration, Web app

Jul 11 2019

anlambert triaged T1913: Generate HTML report for cypress tests as Normal priority.
Jul 11 2019, 5:24 PM · Continuous Integration, Web app
anlambert closed T1911: Add new Harbomaster build plans to execute the cypress tests as Resolved.

Build plan for new commits: https://forge.softwareheritage.org/harbormaster/plan/7/

Jul 11 2019, 4:32 PM · Continuous Integration, Web app
anlambert closed T1911: Add new Harbomaster build plans to execute the cypress tests, a subtask of T1841: Run swh-web's front-end tests on Jenkins, as Resolved.
Jul 11 2019, 4:32 PM · Continuous Integration, Web app
anlambert closed T1908: Add new Herald rules to trigger the cypress tests as Resolved.

Rule to trigger the cypress tests execution on new commits: H35

Jul 11 2019, 4:31 PM · Continuous Integration, Web app
anlambert closed T1908: Add new Herald rules to trigger the cypress tests, a subtask of T1841: Run swh-web's front-end tests on Jenkins, as Resolved.
Jul 11 2019, 4:31 PM · Continuous Integration, Web app
anlambert triaged T1911: Add new Harbomaster build plans to execute the cypress tests as Normal priority.
Jul 11 2019, 4:29 PM · Continuous Integration, Web app
anlambert renamed T1908: Add new Herald rules to trigger the cypress tests from Add new Herald rules to run the cypress tests to Add new Herald rules to trigger the cypress tests.
Jul 11 2019, 4:28 PM · Continuous Integration, Web app
anlambert renamed T1908: Add new Herald rules to trigger the cypress tests from Add new Harbomaster rules to run the cypress tests to Add new Herald rules to run the cypress tests.
Jul 11 2019, 4:27 PM · Continuous Integration, Web app
anlambert closed T1907: Configure swh-cypress docker image on Jenkins as Resolved.

Done !

Jul 11 2019, 1:28 PM · Continuous Integration, Web app
anlambert closed T1907: Configure swh-cypress docker image on Jenkins, a subtask of T1841: Run swh-web's front-end tests on Jenkins, as Resolved.
Jul 11 2019, 1:28 PM · Continuous Integration, Web app

Jul 10 2019

anlambert triaged T1908: Add new Herald rules to trigger the cypress tests as Normal priority.
Jul 10 2019, 4:23 PM · Continuous Integration, Web app
anlambert triaged T1907: Configure swh-cypress docker image on Jenkins as Normal priority.
Jul 10 2019, 4:22 PM · Continuous Integration, Web app
anlambert closed T1842: Install yarn on swh-web's Jenkins docker image as Invalid.

Turns out yarn is already installed on the base docker image used by Jenkins to run tests.

Jul 10 2019, 3:48 PM · Continuous Integration
anlambert closed T1842: Install yarn on swh-web's Jenkins docker image, a subtask of T1841: Run swh-web's front-end tests on Jenkins, as Invalid.
Jul 10 2019, 3:48 PM · Continuous Integration, Web app

Jul 9 2019

anlambert claimed T1841: Run swh-web's front-end tests on Jenkins.
Jul 9 2019, 12:13 PM · Continuous Integration, Web app

Jun 28 2019

zack added a comment to T1855: automatically check CONTRIBUTORS file for completeness.

in 288055f74683ae517770dc2f5a17a8b4bdaeff03 i've added a (Python!) script to check for CONTRIBUTORS completeness

Jun 28 2019, 10:16 AM · Continuous Integration
zack triaged T1855: automatically check CONTRIBUTORS file for completeness as Low priority.
Jun 28 2019, 9:54 AM · Continuous Integration

Jun 24 2019

olasd closed T1846: exclude swh-py-template from CI build (or make it build) as Resolved.

I've now excluded that repo from the H27 herald rule.

Jun 24 2019, 3:58 PM · Continuous Integration

Jun 23 2019

zack triaged T1846: exclude swh-py-template from CI build (or make it build) as Low priority.
Jun 23 2019, 6:33 PM · Continuous Integration

Jun 21 2019

vlorentz triaged T1842: Install yarn on swh-web's Jenkins docker image as Normal priority.
Jun 21 2019, 10:28 AM · Continuous Integration