Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21240

JSON SerDe Re-Write

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed
    • Flags:
      Patch, Important

      Description

      The JSON SerDe has a few issues, I will link them to this JIRA.

      • Use Jackson Tree parser instead of manually parsing
      • Added support for base-64 encoded data (the expected format when using JSON)
      • Added support to skip blank lines (returns all columns as null values)
      • Current JSON parser accepts, but does not apply, custom timestamp formats in most cases
      • Added some unit tests
      • Added cache for column-name to column-index searches, currently O(n) for each row processed, for each column in the row

        Attachments

        1. HIVE-21240.1.patch
          56 kB
          David Mollitor
        2. HIVE-21240.1.patch
          56 kB
          David Mollitor
        3. HIVE-21240.2.patch
          67 kB
          David Mollitor
        4. HIVE-21240.3.patch
          62 kB
          David Mollitor
        5. HIVE-21240.4.patch
          62 kB
          David Mollitor
        6. HIVE-21240.5.patch
          85 kB
          David Mollitor
        7. HIVE-21240.6.patch
          86 kB
          David Mollitor
        8. HIVE-21240.7.patch
          87 kB
          David Mollitor
        9. HIVE-24240.8.patch
          87 kB
          David Mollitor
        10. HIVE-21240.9.patch
          88 kB
          David Mollitor
        11. HIVE-21240.10.patch
          88 kB
          David Mollitor
        12. kafka_storage_handler.diff
          20 kB
          David Mollitor
        13. HIVE-21240.11.patch
          110 kB
          David Mollitor
        14. HIVE-21240.12.patch
          110 kB
          David Mollitor
        15. HIVE-21240.12.patch
          110 kB
          David Mollitor
        16. HIVE-21240.12.patch
          110 kB
          David Mollitor
        17. HIVE-21240.12.patch
          110 kB
          David Mollitor
        18. HIVE-21240.12.patch
          110 kB
          David Mollitor

          Issue Links

            Activity

              People

              • Assignee:
                belugabehr David Mollitor
                Reporter:
                belugabehr David Mollitor
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m