XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Add a new config to hbase-default.xml

        <property>
          <name>hbase.procedure.store.region.hfilecleaner.plugins</name>
          <value>org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner</value>
          <description>A comma-separated list of BaseHFileCleanerDelegate invoked by
          the RegionProcedureStore HFileCleaner service. These HFiles cleaners are
          called in order, so put the cleaner that prunes the most files in front. To
          implement your own BaseHFileCleanerDelegate, just put it in HBase's classpath
          and add the fully qualified class name here. Always add the above
          default hfile cleaners in the list as they will be overwritten in
          hbase-site.xml.</description>
        </property>

      It will share the same TTL with other HFileCleaners. And you can also implement your own cleaner and change this property to enable it.
      Show
      Add a new config to hbase-default.xml   <property>     <name>hbase.procedure.store.region.hfilecleaner.plugins</name>     <value>org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner</value>     <description>A comma-separated list of BaseHFileCleanerDelegate invoked by     the RegionProcedureStore HFileCleaner service. These HFiles cleaners are     called in order, so put the cleaner that prunes the most files in front. To     implement your own BaseHFileCleanerDelegate, just put it in HBase's classpath     and add the fully qualified class name here. Always add the above     default hfile cleaners in the list as they will be overwritten in     hbase-site.xml.</description>   </property> It will share the same TTL with other HFileCleaners. And you can also implement your own cleaner and change this property to enable it.

    Description

      See tail of parent issue. The new RegionProcedureStore accumulates deleted hfiles in its local archive dir. Needs a cleaner like the one that watches over /hbase/archive.

      Is there a problem clearning the new $masterproc$ files from the oldWALs too? These seem to stick around also.

      Attachments

        Issue Links

          Activity

            People

              zhangduo Duo Zhang
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: