Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23744 Reduce query startup latency
  3. HIVE-23596

LLAP: Encode initial guaranteed task information in containerId

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      We should avoid calling LlapTaskScheduler to get initial isguaranteed flag for all the tasks. It causes arbitrary delays in sending tasks out. Since communicator is a single thread, any blocking there delays all the tasks.

      There are https://jira.apache.org/jira/browse/TEZ-4192 and https://jira.apache.org/jira/browse/HIVE-23589 for a proper solution to this. However, that requires a Tez release which seems far right now. We can replace the current hack with another hack that does not require locking.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mustafaiman Mustafa İman Assign to me
            mustafaiman Mustafa İman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 20m
              20m

              Slack

                Issue deployment