Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20433

HBase Export Snapshot utility does not close FileSystem instances

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.2.6, 1.4.3
    • None
    • Client, Filesystem Integration, snapshots
    • None

    Description

      It seems org.apache.hadoop.hbase.snapshot.ExportSnapshot disallows FileSystem instance caching.

      When verifySnapshot method is being run it calls often methods like org.apache.hadoop.hbase.util.FSUtils#getRootDir that instantiate FileSystem but never calls org.apache.hadoop.fs.FileSystem#close method. This behaviour allows allocation of unwanted objects potentially causing memory leaks.

      Related issue: https://issues.apache.org/jira/browse/HADOOP-15392

       

      Expectation:

      • HBase should properly release/close all objects, especially FileSystem instances.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HBASE-28222 Leak in ExportSnapshot during verifySnapshot on S3A

          • Major - Major loss of function.
          • Resolved
          is fixed by

          Bug - A problem which impairs or prevents the functions of the product. HBASE-28222 Leak in ExportSnapshot during verifySnapshot on S3A

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HADOOP-15392 S3A Metrics in S3AInstrumentation Cause Memory Leaks in HBase Export

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-12819 ExportSnapshot doesn't close FileSystem instances

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              Krizek Voyta
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: