Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17593

DataWritableWriter strip spaces for CHAR type before writing, but predicate generator doesn't do same thing.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.3.0, 3.0.0
    • None
    • None

    Description

      DataWritableWriter strip spaces for CHAR type before writing. While when generating predicate, it does NOT do same striping which should cause data missing!

      In current version, it doesn't cause data missing since predicate is not well push down to parquet due to HIVE-17261.

      Please see ConvertAstTosearchArg.java, getTypes treats CHAR and STRING as same which will build a predicate with tail spaces.

      Attachments

        1. HIVE-17593.2.patch
          2 kB
          Junjie Chen
        2. HIVE-17593.3.patch
          3 kB
          Junjie Chen
        3. HIVE-17593.4.patch
          5 kB
          Junjie Chen
        4. HIVE-17593.5.patch
          6 kB
          Junjie Chen
        5. HIVE-17593.patch
          0.7 kB
          Junjie Chen

        Issue Links

          Activity

            People

              junjie Junjie Chen
              junjie Junjie Chen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m