Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-2361

Reduce failure rate of unit test testParquetFileWithBloomFilterWithFpp

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.13.2
    • 1.14.0
    • parquet-mr
    • None

    Description

      [INFO] Results:
      [INFO] 
      Error:  Failures: 
      Error:    TestParquetWriter.testParquetFileWithBloomFilterWithFpp:342
      [INFO]  

      The unit test utilizes random string generation for test data without using a fixed seed. The expectation of a unit test is that the number of false positives in the Bloom filter should match the set probability. Therefore, a simple fix is to increase the number of tests on the Bloom filter. The reason for not using a fixed seed with random numbers is to avoid making the tests effective only in specific scenarios. If it is necessary to use a fixed seed, I can also modify the PR accordingly.

      Attachments

        Activity

          People

            fengjiajie Feng Jiajie
            fengjiajie Feng Jiajie
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: