Page MenuHomeSoftware Heritage

jobs: Add swh-environment tests
ClosedPublic

Authored by anlambert on Aug 28 2020, 7:38 PM.

Details

Summary

I noticed the swh-environment jenkins job running the whole set of tests on the
dev version of swh modules was in bad shape since a while (see this log for instance).

So I took some time to fix it as it can be usefull to detect breaking changes
across swh modules.

The job was also missing a jenkins-job-builder definition file so the creation
of that diff.

The job will be aborted when one test suite fails to quickly detect flaky tests
and API breakage.

You can see in that log that swh module test suites are now correctly executed sequentially.

Diff Detail

Repository
rCJSWH Jenkins jobs
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

anlambert edited the summary of this revision. (Show Details)
ardumont added a subscriber: ardumont.

Thanks, looks good

... for a while ...

yes, at this point, I don't even recall if it ever was green (besides the job
start i mean)...

The job will be aborted when one test suite fails to quickly detect flaky
tests and API breakage.

And right now, for example, we currently have one discrepancy between latest
model and storage data tests it seems. Storage tests are red because of naive
datetime that latest model refuses now. Nice catch!

Cheers,

This revision is now accepted and ready to land.Aug 31 2020, 8:44 AM

Update: Ensure pytest options are reset between each test suite

This revision was automatically updated to reflect the committed changes.