Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9555

TestDateQueries.test_queries failing because Hive3 switched back to the hybrid Julian Gregorian calendar

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • Impala 3.4.0
    • Impala 3.4.0
    • None
    • None
    • ghx-label-9

    Description

      TestDateQueries.test_queries is failing after upgrading the CDP GBN with the following error:

      query_test.test_date_queries.TestDateQueries.test_queries[protocol: beeswax | exec_option: {'disable_codegen_rows_threshold': 0, 'disable_codegen': 'true', 'batch_size': 1} | table_format: avro/snap/block] (from pytest)
      
      Error Message
      
      query_test/test_date_queries.py:60: in test_queries     self.run_test_case('QueryTest/avro_date', vector) common/impala_test_suite.py:690: in run_test_case     self.__verify_results_and_errors(vector, test_section, result, use_db) common/impala_test_suite.py:523: in __verify_results_and_errors     replace_filenames_with_placeholder) common/test_result_verifier.py:456: in verify_raw_results     VERIFIER_MAP[verifier](expected, actual) common/test_result_verifier.py:278: in verify_query_result_is_equal     assert expected_results == actual_results E   assert Comparing QueryTestResults (expected vs actual): E     0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28 E     1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL E     10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31 E     11,1399-06-27,NULL != 20,2017-11-27,0001-06-19 E     12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20 E     2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21 E     20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22 E     21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23 E     22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24 E     23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25 E     24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26 E     25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27 E     26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28 E     27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01 E     28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31 E     29,2017-11-27,2017-11-28 != None E     3,0001-01-01,1399-12-31 != None E     30,9999-12-31,9999-12-01 != None E     31,9999-12-31,9999-12-31 != None E     4,0001-01-01,2017-11-28 != None E     5,0001-01-01,9999-12-31 != None E     6,0001-01-01,NULL != None E     Number of rows returned (expected vs actual): 22 != 15
      
      Stacktrace
      
      query_test/test_date_queries.py:60: in test_queries
          self.run_test_case('QueryTest/avro_date', vector)
      common/impala_test_suite.py:690: in run_test_case
          self.__verify_results_and_errors(vector, test_section, result, use_db)
      common/impala_test_suite.py:523: in __verify_results_and_errors
          replace_filenames_with_placeholder)
      common/test_result_verifier.py:456: in verify_raw_results
          VERIFIER_MAP[verifier](expected, actual)
      common/test_result_verifier.py:278: in verify_query_result_is_equal
          assert expected_results == actual_results
      E   assert Comparing QueryTestResults (expected vs actual):
      E     0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
      E     1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
      E     10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
      E     11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
      E     12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
      E     2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
      E     20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
      E     21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
      E     22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
      E     23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
      E     24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
      E     25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
      E     26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
      E     27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
      E     28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
      E     29,2017-11-27,2017-11-28 != None
      E     3,0001-01-01,1399-12-31 != None
      E     30,9999-12-31,9999-12-01 != None
      E     31,9999-12-31,9999-12-31 != None
      E     4,0001-01-01,2017-11-28 != None
      E     5,0001-01-01,9999-12-31 != None
      E     6,0001-01-01,NULL != None
      E     Number of rows returned (expected vs actual): 22 != 15
      
      Standard Error
      
      ERROR:test_configuration:Comparing QueryTestResults (expected vs actual):
      0,0001-01-01,0001-01-01 != 10,1399-06-27,2017-11-28
      1,0001-01-01,0001-12-31 != 11,1399-06-27,NULL
      10,1399-06-27,2017-11-28 != 12,1399-06-27,2018-12-31
      11,1399-06-27,NULL != 20,2017-11-27,0001-06-19
      12,1399-06-27,2018-12-31 != 21,2017-11-27,0001-06-20
      2,0001-01-01,0002-01-01 != 22,2017-11-27,0001-06-21
      20,2017-11-27,0001-06-21 != 23,2017-11-27,0001-06-22
      21,2017-11-27,0001-06-22 != 24,2017-11-27,0001-06-23
      22,2017-11-27,0001-06-23 != 25,2017-11-27,0001-06-24
      23,2017-11-27,0001-06-24 != 26,2017-11-27,0001-06-25
      24,2017-11-27,0001-06-25 != 27,2017-11-27,0001-06-26
      25,2017-11-27,0001-06-26 != 28,2017-11-27,0001-06-27
      26,2017-11-27,0001-06-27 != 29,2017-11-27,2017-11-28
      27,2017-11-27,0001-06-28 != 30,9999-12-31,9999-12-01
      28,2017-11-27,0001-06-29 != 31,9999-12-31,9999-12-31
      29,2017-11-27,2017-11-28 != None
      3,0001-01-01,1399-12-31 != None
      30,9999-12-31,9999-12-01 != None
      31,9999-12-31,9999-12-31 != None
      4,0001-01-01,2017-11-28 != None
      5,0001-01-01,9999-12-31 != None
      6,0001-01-01,NULL != None
      Number of rows returned (expected vs actual): 22 != 15
      

      Looks like HIVE-22589 introduced a new set of Hive3 configuration options, including hive.avro.proleptic.gregorian which is false by default.

      Attachments

        Activity

          People

            attilaj Attila Jeges
            attilaj Attila Jeges
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: