Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15061

Metastore types are sometimes case sensitive

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.0
    • 2.1.1, 2.2.0
    • API
    • None

    Description

      Impala recently encountered an issue with the metastore (IMPALA-4260 ) where column stats would get dropped when adding a column to a table.

      The reason seems to be that Hive does a case sensitive check on the column stats types during an "alter table" and expects the types to be all lower case. This case sensitive check doesn't appear to happen when the stats are set in the first place.

      We're solving this on the Impala end by storing types in the metastore as all lower case, but Hive's behavior here is very confusing. It should either always be case sensitive, so that you can't create column stats with types that Hive considers invalid, or it should never be case sensitive.

      Attachments

        1. HIVE-15061.1.patch
          2 kB
          Chaoyu Tang
        2. HIVE-15061.1.patch
          2 kB
          Chaoyu Tang
        3. HIVE-15061.patch
          4 kB
          Chaoyu Tang

        Activity

          People

            ctang Chaoyu Tang
            twmarshall Thomas Tauber-Marshall
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: