Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23877

Hive on Spark incorrect partition pruning ANALYZE TABLE

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Partitions are pruned based on the partition specification in ANALYZE TABLE command and cached in TableSpec.
      When compiling, It's unnecessary to use PartitionPruner.prune() to get partitions again. And PartitionPruner can not prune partitions for ANALYZE TABLE command, so it will get all partitions.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            fornaix Han Assign to me
            fornaix Han

            Dates

              Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 1h 10m
              1h 10m

              Slack

                Issue deployment