Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-14895

SSTable loader exception when loading 3.0/3.11 compact tables into 4.0

    XMLWordPrintableJSON

Details

    • Critical

    Description

      While working on the upgrade tests I added 3.0/3.11 to current tests for loading old version sstables using sstable loader. The tests for loading compact sstables fail.

      It doesn't help to alter the table to drop compact storage and then run rebuild and cleanup before attempting to load into current.

      Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      java.lang.RuntimeException: Unknown column value during deserialization
      java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
      at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
      at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
      at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:166)
      at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:83)
      at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:49)
      Caused by: java.lang.RuntimeException: Unknown column value during deserialization
      at org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:317)
      at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
      at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
      at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
      at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
      at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
      at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
      at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
      at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
      ... 5 more
      Exception in thread "main" org.apache.cassandra.tools.BulkLoadException: java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:96)
      at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:49)
      Caused by: java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
      at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
      at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
      at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:166)
      at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:83)
      ... 1 more
      Caused by: java.lang.RuntimeException: Unknown column value during deserialization
      at org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:317)
      at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
      at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
      at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
      at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
      at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
      at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
      at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
      at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
      ... 5 more

      Attachments

        Activity

          People

            djoshi Dinesh Joshi
            aweisberg Ariel Weisberg
            Dinesh Joshi
            Ariel Weisberg
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: