Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2889

HBaseAvroStorage UDF

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.11
    • None
    • data, piggybank
    • None

    Description

      I want to use HBaseStorage without specifying the schema. Storing data in Avro format in HBase is a very common practice. I would like to create a UDF, HBaseAvroStorage that works just like the internal HBaseStorage UDF, but loads the Avro schema metadata so that specifying a schema is unnecessary.

      I haven't thought through all the particulars, so if you have - please chime in

      I am also not sure if this isn't sort of handled some place in HCatalog?

      Attachments

        Activity

          People

            russell.jurney Russell Jurney
            russell.jurney Russell Jurney
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: