Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14895

CompactorMR.CompactorOutputCommitter race condition

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.14.0
    • 2.3.0
    • None
    • None

    Description

      commitJob() method renames each file in TMP_LOCATION separately. so someone may read FINAL_LOCATION and see only some of the files that should be there.
      Use FileSystem.getFileStatus(TMP_LOCATION) and just rename the dir.

      Attachments

        1. HIVE-14895.01.patch
          0.8 kB
          Eugene Koifman
        2. HIVE-14895.02.patch
          0.8 kB
          Eugene Koifman
        3. HIVE-14895.03.patch
          1 kB
          Eugene Koifman

        Activity

          People

            ekoifman Eugene Koifman
            ekoifman Eugene Koifman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: