Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26985

Test "access only some column of the all of columns " fails on big endian

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.2
    • 2.4.5, 3.0.0
    • SQL

    Description

      While running tests on Apache Spark v2.3.2 with AdoptJDK on big endian, I am observing test failures for 2 Suites of Project SQL.
      1. InMemoryColumnarQuerySuite
      2. DataFrameTungstenSuite
      In both the cases test "access only some column of the all of columns" fails due to mismatch in the final assert.

      Observed that the data obtained after df.cache() is causing the error. Please find attached the log with the details. 

      cache() works perfectly fine if double and  float values are not in picture.

      Inside test !!!!!!- access only some column of the all of columns *** FAILED ***

      Attachments

        1. access only some column of the all of columns.txt
          4 kB
          Anuja Jakhade
        2. DataFrameTungstenSuite.txt
          2 kB
          Anuja Jakhade
        3. InMemoryColumnarQuerySuite.txt
          2 kB
          Anuja Jakhade

        Issue Links

          Activity

            People

              ketan22584 ketan kunde
              Anuja Anuja Jakhade
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: