Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-2241

Junitparams based parameterized test may cause test execution to silently pass

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • JUnit 5.x support
    • None

    Description

      • junit5 vintage
      • testcase with junitparams
      • 1 failing / 1 passing / 1 assumeviolated case
      • test reruns enabled
      • maven 3.9.x
      • not sure why but 3.8.8 works correctly

      impact:

      • failing test is not reported at all
      • followup tests are not run
      • exit code 0
       [INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.druid.sql.calcite.CalciteJoinQueryTest
[INFO] Running org.apache.druid.sql.calcite.CalciteQueryTest
[INFO] Running org.apache.druid.sql.calcite.CalciteJoinQueryTest
Warning:  ForkStarter IOException: Element name cannot be empty
Element name cannot be empty
Element name cannot be empty. See the dump file /home/runner/work/junitparams-junit5-rerun-issue/junitparams-junit5-rerun-issue/target/surefire-reports/2024-03-07T13-29-58_925-jvmRun1.dumpstream
[INFO] 
[INFO] Results:

      made a repro project:
      https://github.com/kgyrtkirk/junitparams-junit5-rerun-issue

      Attachments

        Activity

          People

            Unassigned Unassigned
            kgyrtkirk Zoltan Haindrich
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: