Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-2143

Disabled @ParametrizedTest is not counted as skipped one in M8 (worked in M7)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-M8
    • 3.0.0
    • JUnit 5.x support
    • None

    Description

      I'm upgrading surefire plugin from 2.22.2 to 3.0.0-M8, but there are differences in numbers of skipped tests.

       

      Follows https://issues.apache.org/jira/browse/SUREFIRE-1812 -> which is working correctly with M8 (not with M7)

       

      But there is another issue, when disabled @ParametrizedTest is not counted towards skipped tests. This issue happens in M8, works in M7 

       

      I prepared simple reproducer - https://github.com/JiriOndrusek/surefire-reproducer-2

       

      Result with 3.0.0-M8 is  wrong 

       [INFO] Running reproducer.ReproducerTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.03 s - in reproducer.ReproducerTest
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1

      Result with 3.0.0-M7 is correct:

      [INFO] Running reproducer.ReproducerTest
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.031 s - in reproducer.ReproducerTest
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SUREFIRE-2032 When declare the @Disabled annotation at the class level, skip displayed in other test class

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #612

          Activity

            People

              sjaranowski Slawomir Jaranowski
              jondruse Jiri Ondrusek
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: