Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12995

LLAP: Synthetic file ids need collision checks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.1.0
    • 2.1.0
    • llap

    Description

      LLAP synthetic file ids do not have any way of checking whether a collision occurs other than a data-error.

      Synthetic file-ids have only been used with unit tests so far - but they will be needed to add cache mechanisms to non-HDFS filesystems.

      In case of Synthetic file-ids, it is recommended that we track the full-tuple (path, mtime, len) in the cache so that a cache-hit for the synthetic file-id can be compared against the parameters & only accepted if those match.

      Attachments

        1. HIVE-12995.patch
          78 kB
          Sergey Shelukhin
        2. HIVE-12995.04.patch
          95 kB
          Sergey Shelukhin
        3. HIVE-12995.03.patch
          95 kB
          Sergey Shelukhin
        4. HIVE-12995.02.patch
          95 kB
          Sergey Shelukhin
        5. HIVE-12995.01.patch
          84 kB
          Sergey Shelukhin

        Issue Links

          Activity

            People

              sershe Sergey Shelukhin
              gopalv Gopal Vijayaraghavan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: