Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-13484

Truncate the list of SSTableReaders logged when there is insufficient space on disk during compaction

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Low
    • Resolution: Unresolved
    • None
    • Legacy/Observability
    • None

    Description

      In the CompactionTask class, there is an expression `StringUtils.join(transaction.originals(), ", ")` (present since 1.0 in the form: `StringUtils.join(toCompact, ", ")`) (nowadays in method `reduceScopeForLimitedSpace`).

      If the set of SSTableReader is very large, then the generated log line, which contains full file paths for each reader, will be enormous. This is specially the case when dealing with SSTable files generated from big data sets using CQLSSTableWriter, since it will create many small files. (Over 40k in my case. The single log line will be well in the 10's of MB, potentially causing problems in some log viewers.) To make matters worse, reduceScopeForLimitedSpace() is called multiple times in checkAvailableDiskSpace().

      Attachments

        Activity

          People

            Unassigned Unassigned
            garciat Gabriel Garcia
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: