Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9252

Linking custom SerDe jar to table definition.

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      In HIVE-6047 the option was created that a jar file can be hooked to the definition of a function. (See: Language Manual DDL: Permanent Functions )

      I propose to add something similar that can be used when defining an external table that relies on a custom Serde (I expect to usually only have the Deserializer).

      Something like this:

      CREATE [TEMPORARY] [EXTERNAL] TABLE [IF NOT EXISTS] [db_name.]table_name
          ...
          STORED BY 'storage.handler.class.name' [WITH SERDEPROPERTIES (...)] 
          [USING JAR|FILE|ARCHIVE 'file_uri' [, JAR|FILE|ARCHIVE 'file_uri'] ];
      

      Using this you can define (and share !!!) a Hive table on top of a custom fileformat without the need to let the IT operations people deploy a custom SerDe jar file on all nodes.

      Attachments

        1. HIVE-9252.1.patch
          66 kB
          Ferdinand Xu

        Issue Links

          Activity

            People

              Ferd Ferdinand Xu
              nielsbasjes Niels Basjes
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: