Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8739

FileMetadataLoader skips empty directories

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • None
    • ghx-label-2

    Description

      FileMetadataLoader has certain code paths like the one below which using listFiles API on the filesystem. This API ignores empty directories which is okay for non-transactional tables. However, in case of transactional table an empty base directory provides writeId information which is used to skip loading files which are not relevant for a given writeId. See AcidUtils#filterFilesForAcidState usage for details.

      Attachments

        Activity

          People

            boroknagyz Zoltán Borók-Nagy
            vihangk1 Vihang Karajgaonkar
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: