Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18665

LLAP: Ignore cache-affinity if the LLAP IO elevator is disabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • llap
    • None

    Description

      SplitLocationProvider removes HDFS locality in LLAP, causing more network traffic when reading file formats which aren't currently cached.

      In the absence of the IO elevator, cache affinity should be disabled.

      This information is encoded into the MapWork in deriveLlapIoDescString, move this to an Enum type for comparisons.

      Attachments

        1. HIVE-18665.1.patch
          7 kB
          Gopal Vijayaraghavan

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HIVE-18860 fix TestAcidOnTez#testGetSplitsLocks

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-19362 enable LLAP cache affinity by default

          • Major - Major loss of function.
          • Closed

          Activity

            People

              gopalv Gopal Vijayaraghavan
              gopalv Gopal Vijayaraghavan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: