Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18785

Make JSON SerDe First-Class SerDe

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: Serializers/Deserializers
    • Labels:
      None

      Description

      According to the Hive SerDe Docs, there are some extra steps involved in getting the JSON SerDe to work:

      ROW FORMAT SERDE
      'org.apache.hive.hcatalog.data.JsonSerDe'
      STORED AS TEXTFILE

      In some distributions, a reference to hive-hcatalog-core.jar is required.
      ADD JAR /usr/lib/hive-hcatalog/lib/hive-hcatalog-core.jar;

      I would like to propose that we move this SerDe into first-class status:

      STORED AS JSONFILE

      The user should have to perform no additional steps to use this SerDe.

        Attachments

          Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HIVE-19960 Add Column Mapping to JsonSerDe

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-19901 Consolidate JsonSerde Classes

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-21240 JSON SerDe Re-Write

          • Major - Major loss of function.
          • Resolved
          is a child of

          New Feature - A new feature of the product, which has yet to be developed. HIVE-163 support loading json data into hive

          • Major - Major loss of function.
          • Closed
          is depended upon by

          Task - A task that needs to be done. HIVE-19842 Improve Hive UDF/SerDe Usability

          • Major - Major loss of function.
          • Open
          is duplicated by

          Sub-task - The sub-task of the issue HIVE-19899 Support stored as JsonFile

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-1640 hive-exec.jar contains JSON classes

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-15475 JsonSerDe cannot handle json file with empty lines

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18295 Add ability to ignore invalid values in JSON SerDe

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-21414 Hive JSON SerDe Does Not Properly Handle Field Comments

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18545 Add UDF to parse complex types from json

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-15826 Add 'serialization.encoding' To All SerDes

          • Major - Major loss of function.
          • Patch Available
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. HIVE-17299 Cannot validate SerDe even if it is in Hadoop classpath

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HIVE-10968 Windows: analyze json table via beeline failed throwing Class org.apache.hive.hcatalog.data.JsonSerDe not found

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                aihuaxu Aihua Xu
                Reporter:
                belugabehr David Mollitor
              • Votes:
                1 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: