Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20491

Fix mapjoin size estimations for Fast implementation

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      HIVE-19824 have fixed the estimations; but it calculated for the "optimized" impl; the "fast" one has a little bit bigger footprint.

      It also seems like fast is a bit overestimated at runtime...that should be also taken care of.

      numkeys implementation compiler estimation runtime estimation runtime measurement ce / rm re / rm
      25M FAST 1168435456 2189433712 1513584984 .77 1.44
      25M OPTIMIZED 1168435456 1191203764 1168439664 100% 1.01

      Attachments

        1. HIVE-20491.01wip02.patch
          10 kB
          Zoltan Haindrich
        2. HIVE-20491.01.patch
          10 kB
          Zoltan Haindrich
        3. HIVE-20491.02.patch
          16 kB
          Zoltan Haindrich

        Issue Links

        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-19824 Improve online datasize estimations for MapJoins

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kgyrtkirk Zoltan Haindrich Assign to me
            kgyrtkirk Zoltan Haindrich
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment