Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2622

SelectHiveQL with Avro output doesn't handle complex types

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.0.0
    • Extensions
    • None

    Description

      Hive supports table columns of complex type, such as Arrays, Structs, Maps, etc. However when using SelectHiveQL with Avro output, the result set is not being converted correctly and an error occurs.

      This is a fundamental issue with the way SelectHiveQL attempts to create an Avro schema without having seen any of the rows, since the sub-types of complex items cannot be determined from the SQL type alone.

      Attachments

        Issue Links

          Activity

            People

              mattyb149 Matt Burgess
              mattyb149 Matt Burgess
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: