Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19090

Running concatenate on ORC tables either increase or decrease the number of files depends on the order of file being picked

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • ORC
    • None

    Description

      I ran concatenate 2 times without changing any config

      For the 1st run, 14 files merged to 8 files

      For the 2nd run, 8 files expanded to 10 files

      From logs i could see Input files are same, whereas output splits from CombineHiveInputFormat are varying depending upon the file being picked first.

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            prasanth_j Prasanth Jayachandran Assign to me
            nareshpr Naresh P R

            Dates

              Created:
              Updated:

              Slack

                Issue deployment