Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24031

Infinite planning time on syntactically big queries

    XMLWordPrintableJSON

Details

    Description

      Syntactically big queries (~1 million tokens), such as the query shown below, lead to very big (seemingly infinite) planning times.

      select posexplode(array('item1', 'item2', ..., 'item1M'));

      Attachments

        1. query_big_array_constructor.nps
          33 kB
          Stamatis Zampetakis
        2. ASTNode_getChildren_cost.png
          65 kB
          Stamatis Zampetakis

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-22079 Post order walker for iterating over expression tree

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-24362 AST tree processing is suboptimal for tree with large number of nodes

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #1424

          Activity

            People

              zabetak Stamatis Zampetakis
              zabetak Stamatis Zampetakis
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m