Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17656

Hive settings are not passed to Orc/Avro SerDes, when used from HCatalog

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.2.0, 3.0.0
    • None
    • None

    Description

      We find that tables/partitions accessed through HCatLoader/HCatStorer use Hive settings hard-coded in HiveConf, rather than settings in the hive-site.xml. For instance, ORC files written through Pig/HCatStorer use default orc.stripe.size settings, rather than any overrides in hive-site.xml.

      This has to do with the way the HiveStorageHandler is constructed in the HCat path. I'll upload the fix shortly.

      Attachments

        1. HIVE-17656.1.patch
          10 kB
          Mithun Radhakrishnan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mithun Mithun Radhakrishnan Assign to me
            mithun Mithun Radhakrishnan

            Dates

              Created:
              Updated:

              Slack

                Issue deployment