How to only output one Pass/Fail result when test is rerun?

java unit-testing testng reportng
user1547185 picture user1547185 · Jul 24, 2012 · Viewed 9k times · Source

I'm using the IRetryAnalyzer class in TestNG in order to relaunch tests that fail (up to 5 attempts). Right now if I run a test and it fails three times before passing, it says:

Tests run: 4, Failures: 3, Errors 0, Skipped 0.

What I want the results to show is:

Tests run: 1, Failures: 0, Errors 0, Skipped 0.

Basically, I don't want it to count as a failure unless it fails all 5 reruns. How do I do this?

Answer

MushyPeas picture MushyPeas · Aug 28, 2012

since nobody replied, i give it a try.

just random thoughts i had when reading your post, while i was searching for a solution for my problem...

you can get the result of your test in your @AfterTest method via ITestResult result

@AfterMethod
public void AfterMethod_CheckForFailure(ITestResult result, Method m)

an @AfterMethod is called when a method with @Test annotation has finished. able to read the current iteration from a static class with a static member and if its <5 then use

result.setStatus(ITestResult.SUCCESS); // or what ever status you want
setCurrentTestResult(result);

dunno if that works, but looks to me it could :) Good luck

Related questions

java.lang.IllegalStateException: missing behavior definition for the preceding method call getMessage("title")

I'm using EasyMock(version 2.4) and TestNG for writing UnitTest. I have a following scenario and I cannot change the way class hierarchy is defined. I'm testing ClassB which is extending ClassA. ClassB look like this public class ClassB extends ClassA { …

Read More
@BeforeClass and inheritance - order of execution

I have an abstract base class, which I use as a base for my unit tests (TestNG 5.10). In this class, I initialize the whole environment for my tests, setting up database mappings, etc. This abstract class has a method with …

Read More
How to execute one test from large TestNG suite using testng.xml?

I have a TestNG suite with large amount of methods. I execute this suite using wrapper built on top of TestNG runner. All tests in the suite fail except one. What should I write in testng.xml to execute just …

Read More