How to show results of individual test pass/fail in Jenkins?

jenkins continuous-integration automated-tests qa jenkins-plugins
Aaron Shaver picture Aaron Shaver · Nov 13, 2012 · Viewed 24.1k times · Source

We're using Scala + Maven + ScalaTest runner + Jenkins. We have JUnit-style XML output going here:

test_dir/target/scalatest-reports/

Right now we can see entire build pass/fail, or dig through the verbose Console Output to see test pass/fail (not ideal), but I'm sure there's a better way.

I've tried several of the post-build steps such as:

  • Aggregate downstream test results
  • Publish xUnit test result report

But can't get a table of test results working.

Do you have any ideas? Thanks.

Answer

Joost den Boer picture Joost den Boer · Mar 3, 2015

There are two options:

  • ScalaTest can generate HTML reports. Just add

    (testOptions in Test) += Tests.Argument(TestFrameworks.ScalaTest, "-h", "target/scalatest-report")

to your 'build.sbt'. Running 'sbt test' will then generate an HTML report in the folder 'target/scalatest-report'.

In Jenkins you can use the 'Publish HTML' plugin to capture this report for a build. The test html becomes then available for each build and also on job page.

  • ScalaTest also generates normal JUnit XML reports in the 'target/test-reports' folder. The Jenkins these reports can be captured with the 'Publish JUnit XML test report' post-build-action which is default available in Jenkins I think.

Both solutions give a view on the test results and they can be used together.

Related questions

How to set environment variables in Jenkins?

I would like to be able to do something like: AOEU=$(echo aoeu) and have Jenkins set AOEU=aoeu. The Environment Variables section in Jenkins doesn't do that. Instead, it sets AOEU='$(echo aoeu)'. How can I get …

Read More
How to choose between Hudson and Jenkins?

It took me an hour or so to work out Hudson has only branched recently (Jan/2011) I have no idea how rapid the change of each branch is now, but more importantly, what is the direction each branch is taking …

Read More
Jenkins CI Pipeline Scripts not permitted to use method groovy.lang.GroovyObject

I am Using Jenkins 2 for compiling Java Projects, I want to read the version from a pom.xml, I was following this example: https://github.com/jenkinsci/pipeline-plugin/blob/master/TUTORIAL.md The example suggest: It seems that there is …

Read More