Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12051

push file metadata PPD into HBase

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      This can be done as two steps or one. Both are valuable...
      1) Store subset of the footer that is specific to PPD - e.g. for ORC that would be stripe boundaries and some stats.
      2) Actually push down the filter on some stats into HBase via a custom filter, or even a basic filter for min/max values.

      Attachments

        Issue Links

        is blocked by

        Bug - A problem which impairs or prevents the functions of the product. HIVE-11676 implement metastore API to do file footer PPD

        • Major - Major loss of function.
        • Closed
        is part of

        Sub-task - The sub-task of the issue HIVE-11500 implement file footer / splits cache in HBase metastore

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment