Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2675

Optimization: Remove unnecessary Limit jobs from plan

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      LIMIT operator always inserts a limiting single-reducer job after PIG-2652.
      We can optimize this job away when the preceding job only has 1 reducer at run-time.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. PIG-2784 Framework for dynamic query optimization

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. PIG-483 PERFORMANCE: different strategies for large and small order bys

          • Major - Major loss of function.
          • Open

          Activity

            People

              daijy Daniel Dai
              dvryaboy Dmitriy V. Ryaboy
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: