Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3201

Support gzipped HMS notifications (GzipJSONMessageEncoder)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.13.0
    • 1.14.0
    • hms
    • None

    Description

      In HIVE-20679 a new message encoder was added to Hive that gzips and based64 encodes notification messages. In HIVE-21307 the default encoder was changed to use the gzip encoder, GzipJSONMessageEncoder.

      Though Hive 4 is not released, failures as a result of this new message format were reported in IMPALA-8751. We should add support for the gzip format to prevent future HMS sync issues.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-8751 Kudu tables cannot be found after created

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HIVE-20679 DDL operations on hive might create large messages for DBNotification

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HIVE-21307 Need to set GzipJSONMessageEncoder as default config for EVENT_MESSAGE_FACTORY.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              granthenke Grant Henke
              granthenke Grant Henke
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: