Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18785

Make JSON SerDe First-Class SerDe

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • Serializers/Deserializers
    • None

    Description

      According to the Hive SerDe Docs, there are some extra steps involved in getting the JSON SerDe to work:

      ROW FORMAT SERDE
      'org.apache.hive.hcatalog.data.JsonSerDe'
      STORED AS TEXTFILE

      In some distributions, a reference to hive-hcatalog-core.jar is required.
      ADD JAR /usr/lib/hive-hcatalog/lib/hive-hcatalog-core.jar;

      I would like to propose that we move this SerDe into first-class status:

      STORED AS JSONFILE

      The user should have to perform no additional steps to use this SerDe.

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HIVE-19960 Add Column Mapping to JsonSerDe

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-19901 Consolidate JsonSerde Classes

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-21240 JSON SerDe Re-Write

          • Major - Major loss of function.
          • Closed
          is a child of

          New Feature - A new feature of the product, which has yet to be developed. HIVE-163 support loading json data into hive

          • Major - Major loss of function.
          • Closed
          is depended upon by

          Task - A task that needs to be done. HIVE-19842 Improve Hive UDF/SerDe Usability

          • Major - Major loss of function.
          • Open
          is duplicated by

          Sub-task - The sub-task of the issue HIVE-19899 Support stored as JsonFile

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-1640 hive-exec.jar contains JSON classes

          • Major - Major loss of function.
          • Open
          is superceded by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-22061 Selecting from JsonSerDe backed table fails for array type

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-15475 JsonSerDe cannot handle json file with empty lines

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18295 Add ability to ignore invalid values in JSON SerDe

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-15826 Add 'serialization.encoding' To All SerDes

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18545 Add UDF to parse complex types from json

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-21414 Hive JSON SerDe Does Not Properly Handle Field Comments

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. HIVE-17299 Cannot validate SerDe even if it is in Hadoop classpath

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HIVE-10968 Windows: analyze json table via beeline failed throwing Class org.apache.hive.hcatalog.data.JsonSerDe not found

          • Major - Major loss of function.
          • Closed

          Activity

            People

              aihuaxu Aihua Xu
              belugabehr David Mollitor
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: