Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18295

Add ability to ignore invalid values in JSON SerDe

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: HCatalog

      Description

      It would be nice to be able to configure the JSON SerDe to ignore invalid values while parsing JSON.

      In our case our raw JSON data is ingested from multiple sources, some of which unreliably sanitize the data. Our current practice is to cleanse the data after ingestion, but that can lead to other issues as well. Having the ability to simply default to NULL if a value can not be parsed would be immensely helpful to us.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mattk42 Matthew Knox
                Reporter:
                mattk42 Matthew Knox
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: