Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14200

Tez: disable auto-reducer parallelism when reducer-count * min.partition.factor < 1.0

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None
    •  Tez: disable auto-reducer parallelism when reducer-count * min.partition.factor < 1.0 (Gopal V, reviewed by Gunther Hagleitner)

    Description

      The min/max factors offer no real improvement when the fractions are meaningless, for example when 0.25 * 2 is applied as the min.

      Attachments

        1. HIVE-14200.3.patch
          2 kB
          Gopal Vijayaraghavan
        2. HIVE-14200.2.patch
          2 kB
          Gopal Vijayaraghavan
        3. HIVE-14200.1.patch
          0.9 kB
          Gopal Vijayaraghavan

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HIVE-22075 Fix the max-reducers=1 regression from HIVE-14200

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. TEZ-1248 Reduce slow-start should special case 1 reducer runs

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-23831 Make auto reducer parallelism min threshold configurable.

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gopalv Gopal Vijayaraghavan Assign to me
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment