Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21263

Mention compression algorithm along with other storefile details

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Where we log storefile details we should also log the compression algorithm used to compress blocks on disk, if any.

      For example, here's a log line out of compaction:

      2018-10-02 21:59:47,594 DEBUG [regionserver/host/1.1.1.1:8120-longCompactions-1538517461152] compactions.Compactor: Compacting hdfs://namenode:8020/hbase/data/default/TestTable/86037c19117a46b5b8148439ea55753b/i/3d04a7c28d6343ceb773737dbb192533, keycount=3335873, bloomtype=ROW, size=107.5 M, encoding=ROW_INDEX_V1, seqNum=154199, earliestPutTs=1538516084915

      Aside from bloom type, block encoding, and filename, it would be good to know compression type in this type of DEBUG or INFO level logging. A minor omission of information that could be helpful during debugging.

      Attachments

        1. HBASE-21263.master.001.patch
          2 kB
          Subrat Mishra
        2. HBASE-21263.master.002.patch
          2 kB
          Subrat Mishra
        3. HBASE-21263.master.003.patch
          9 kB
          Subrat Mishra
        4. HBASE-21263.patch
          8 kB
          Andrew Kyle Purtell
        5. HBASE-21263-branch-1.patch
          7 kB
          Andrew Kyle Purtell
        6. HBASE-21263-branch-2.0.patch
          7 kB
          Andrew Kyle Purtell

        Activity

          People

            subrat.mishra Subrat Mishra
            apurtell Andrew Kyle Purtell
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: