Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24417 Build and Run Spark on JDK11
  3. SPARK-28101

Fix Flaky Test: `InputStreamsSuite.Modified files are correctly detected` in JDK9+

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • DStreams, Tests
    • None

    Description

      $ build/sbt "streaming/testOnly *.InputStreamsSuite"
[info] - Modified files are correctly detected. *** FAILED *** (134 milliseconds)
[info]   Set("renamed") did not equal Set() (InputStreamsSuite.scala:312)
[info]   org.scalatest.exceptions.TestFailedException:

      Getting new files for time 1560896662000, ignoring files older than 1560896659679
file:/Users/dongjoon/PRS/SPARK-STEAM-TEST/target/tmp/spark-f34c23f6-9fb4-4ded-87f3-8cdfb57d85a6/streaming/subdir/renamed.txt not selected as mod time 1560896662679 > current time 1560896662000
file:/Users/dongjoon/PRS/SPARK-STEAM-TEST/target/tmp/spark-f34c23f6-9fb4-4ded-87f3-8cdfb57d85a6/streaming/subdir/existing ignored as mod time 1560896657679 <= ignore time 1560896659679
Finding new files took 0 ms
New files at time 1560896662000 ms:

      Attachments

        1. error.png
          390 kB
          Dongjoon Hyun

        Issue Links

          links to

          Web Link GitHub Pull Request #24904

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: