[SOLR-13487] Unable to upgrade Lucene 6.x index using IndexUpgrader - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Invalid
Affects Version/s: 7.7.1, 8.1
Fix Version/s: None
Component/s: scripts and tools, SolrCloud
Labels:

Description

I'm trying to upgrade a index from Lucene 6.x to 7.x, and then to 8.x, using IndexUpgrader [1]. But it never successfully upgrades to 7, and I cannot figure out why.

I've also tried using CheckIndex [2] with the -exorcise option to fix the index first, but that doesn't help.

[1] https://lucene.apache.org/solr/guide/7_7/indexupgrader-tool.html
[2] https://lucene.apache.org/core/7_1_0/core/org/apache/lucene/index/CheckIndex.html#main-java.lang.String:A-

user@dev-appsolr2535:/home/user> java -cp '/opt/common/apps/apache-solr-7.7.1/server/solr-webapp/webapp/WEB-INF/lib/*' org.apache.lucene.index.IndexUpgrader -delete-prior-commits -verbose /opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index

IFD 0 [2019-05-22T09:24:14.317Z; main]: init: current segments file is "segments_505t"; deletionPolicy=org.apache.lucene.index.KeepOnlyLastCommitDeletionPolicy@29774679
IFD 0 [2019-05-22T09:24:14.336Z; main]: init: load commit "segments_505t"
IFD 0 [2019-05-22T09:24:14.346Z; main]: init: seg=_11nw3 set nextWriteFieldInfosGen=134 vs current=1
IFD 0 [2019-05-22T09:24:14.347Z; main]: init: seg=_11nw3 set nextWriteDocValuesGen=134 vs current=1
IFD 0 [2019-05-22T09:24:14.358Z; main]: now checkpoint "_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]" [5 segments ; isCommit = false]
IFD 0 [2019-05-22T09:24:14.358Z; main]: 11 msec to checkpoint
IW 0 [2019-05-22T09:24:14.359Z; main]: init: create=false reader=null
IW 0 [2019-05-22T09:24:14.362Z; main]: 
dir=MMapDirectory@/opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14bf9759
index=_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
version=7.7.1
analyzer=null
ramBufferSizeMB=16.0
maxBufferedDocs=-1
mergedSegmentWarmer=null
delPolicy=org.apache.lucene.index.KeepOnlyLastCommitDeletionPolicy
commit=null
openMode=CREATE_OR_APPEND
similarity=org.apache.lucene.search.similarities.BM25Similarity
mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=-1, maxMergeCount=-1, ioThrottle=true
codec=Lucene70
infoStream=org.apache.lucene.util.PrintStreamInfoStream
mergePolicy=UpgradeIndexMergePolicy([TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1, deletesPctAllowed=33.0)
indexerThreadPool=org.apache.lucene.index.DocumentsWriterPerThreadPool@5f341870
readerPooling=true
perThreadHardLimitMB=1945
useCompoundFile=true
commitOnClose=true
indexSort=null
checkPendingFlushOnUpdate=true
softDeletesField=null
writer=org.apache.lucene.index.IndexWriter@553f17c

IW 0 [2019-05-22T09:24:14.363Z; main]: MMapDirectory.UNMAP_SUPPORTED=true
IndexUpgrader 0 [2019-05-22T09:24:14.363Z; main]: Upgrading all pre-7.7.1 segments of index directory 'MMapDirectory@/opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14bf9759' to version 7.7.1...
IW 0 [2019-05-22T09:24:14.364Z; main]: forceMerge: index now _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
IW 0 [2019-05-22T09:24:14.364Z; main]: now flush at forceMerge
IW 0 [2019-05-22T09:24:14.364Z; main]:   start flush: applyAllDeletes=true
IW 0 [2019-05-22T09:24:14.365Z; main]:   index before flush _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
DW 0 [2019-05-22T09:24:14.365Z; main]: startFullFlush
DW 0 [2019-05-22T09:24:14.367Z; main]: main finishFullFlush success=true
IW 0 [2019-05-22T09:24:14.367Z; main]: now apply all deletes for all segments buffered updates bytesUsed=0 reader pool bytesUsed=0
BD 0 [2019-05-22T09:24:14.367Z; main]: waitApply: no deletes to apply
MP 0 [2019-05-22T09:24:14.368Z; main]: findForcedMerges: segmentsToUpgrade={}
MS 0 [2019-05-22T09:24:14.371Z; main]: initDynamicDefaults spins=true maxThreadCount=1 maxMergeCount=6
MS 0 [2019-05-22T09:24:14.372Z; main]: now merge
MS 0 [2019-05-22T09:24:14.372Z; main]:   index: _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
MS 0 [2019-05-22T09:24:14.372Z; main]:   no more merges pending; now return
IndexUpgrader 0 [2019-05-22T09:24:14.372Z; main]: All segments upgraded to version 7.7.1
IndexUpgrader 0 [2019-05-22T09:24:14.373Z; main]: Enforcing commit to rewrite all index metadata...
IW 0 [2019-05-22T09:24:14.373Z; main]: commit: start
IW 0 [2019-05-22T09:24:14.373Z; main]: commit: enter lock
IW 0 [2019-05-22T09:24:14.373Z; main]: commit: now prepare
IW 0 [2019-05-22T09:24:14.373Z; main]: prepareCommit: flush
IW 0 [2019-05-22T09:24:14.374Z; main]:   index before flush _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
DW 0 [2019-05-22T09:24:14.374Z; main]: startFullFlush
IW 0 [2019-05-22T09:24:14.374Z; main]: now apply all deletes for all segments buffered updates bytesUsed=0 reader pool bytesUsed=0
BD 0 [2019-05-22T09:24:14.375Z; main]: waitApply: no deletes to apply
DW 0 [2019-05-22T09:24:14.375Z; main]: main finishFullFlush success=true
IW 0 [2019-05-22T09:24:14.375Z; main]: startCommit(): start
IW 0 [2019-05-22T09:24:14.376Z; main]: startCommit index=_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] changeCount=2
IW 0 [2019-05-22T09:24:14.382Z; main]: startCommit: wrote pending segments file "pending_segments_505u"
IW 0 [2019-05-22T09:24:14.387Z; main]: done all syncs: [_11oa0.si, _11oa0.fdx, _11nw3_3p.liv, _11oa0_Lucene50_0.doc, _11nw3.nvd, _11oa0.fdt, _11oa1_Lucene50_0.doc, _11nw3.si, _11o9p.cfe, _11nw3_Lucene50_0.pos, _11oa1.fdx, _11nw3_Lucene50_0.tim, _11nw3_Lucene50_0.tip, _11oa1.fdt, _11nw3.fdx, _11oa0_Lucene50_0.pos, _11oa1.fnm, _11oa1.nvm, _11oa1.si, _11nw3.fdt, _11o9p.cfs, _11oa0.nvd, _11o9z.si, _11o9z.cfs, _11oa0_Lucene50_0.tim, _11o9p.si, _11oa0_Lucene50_0.tip, _11oa1_Lucene50_0.tim, _11nw3.fnm, _11nw3.nvm, _11oa1_Lucene50_0.pos, _11oa1.nvd, _11o9z.cfe, _11oa1_Lucene50_0.tip, _11nw3_Lucene50_0.doc, _11oa0.fnm, _11oa0.nvm]
IW 0 [2019-05-22T09:24:14.388Z; main]: commit: pendingCommit != null
IW 0 [2019-05-22T09:24:14.389Z; main]: commit: done writing segments file "segments_505u"
IFD 0 [2019-05-22T09:24:14.390Z; main]: now checkpoint "_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]" [5 segments ; isCommit = true]
IFD 0 [2019-05-22T09:24:14.390Z; main]: deleteCommits: now decRef commit "segments_505t"
IFD 0 [2019-05-22T09:24:14.391Z; main]: delete [segments_505t]
IFD 0 [2019-05-22T09:24:14.391Z; main]: 1 msec to checkpoint
IW 0 [2019-05-22T09:24:14.400Z; main]: commit: took 18.0 msec
IW 0 [2019-05-22T09:24:14.401Z; main]: commit: done
IndexUpgrader 0 [2019-05-22T09:24:14.401Z; main]: Committed upgraded metadata to index.
IW 0 [2019-05-22T09:24:14.401Z; main]: now flush at close
IW 0 [2019-05-22T09:24:14.401Z; main]:   start flush: applyAllDeletes=true
IW 0 [2019-05-22T09:24:14.401Z; main]:   index before flush _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
DW 0 [2019-05-22T09:24:14.402Z; main]: startFullFlush
DW 0 [2019-05-22T09:24:14.402Z; main]: main finishFullFlush success=true
IW 0 [2019-05-22T09:24:14.402Z; main]: now apply all deletes for all segments buffered updates bytesUsed=0 reader pool bytesUsed=0
BD 0 [2019-05-22T09:24:14.402Z; main]: waitApply: no deletes to apply
MS 0 [2019-05-22T09:24:14.403Z; main]: updateMergeThreads ioThrottle=true targetMBPerSec=10240.0 MB/sec
MS 0 [2019-05-22T09:24:14.403Z; main]: now merge
MS 0 [2019-05-22T09:24:14.403Z; main]:   index: _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
MS 0 [2019-05-22T09:24:14.404Z; main]:   no more merges pending; now return
IW 0 [2019-05-22T09:24:14.404Z; main]: waitForMerges
IW 0 [2019-05-22T09:24:14.404Z; main]: waitForMerges done
IW 0 [2019-05-22T09:24:14.404Z; main]: commit: start
IW 0 [2019-05-22T09:24:14.404Z; main]: commit: enter lock
IW 0 [2019-05-22T09:24:14.404Z; main]: commit: now prepare
IW 0 [2019-05-22T09:24:14.405Z; main]: prepareCommit: flush
IW 0 [2019-05-22T09:24:14.405Z; main]:   index before flush _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
DW 0 [2019-05-22T09:24:14.405Z; main]: startFullFlush
IW 0 [2019-05-22T09:24:14.405Z; main]: now apply all deletes for all segments buffered updates bytesUsed=0 reader pool bytesUsed=0
BD 0 [2019-05-22T09:24:14.406Z; main]: waitApply: no deletes to apply
DW 0 [2019-05-22T09:24:14.406Z; main]: main finishFullFlush success=true
IW 0 [2019-05-22T09:24:14.406Z; main]: startCommit(): start
IW 0 [2019-05-22T09:24:14.406Z; main]:   skip startCommit(): no changes pending
IW 0 [2019-05-22T09:24:14.407Z; main]: commit: pendingCommit == null; skip
IW 0 [2019-05-22T09:24:14.407Z; main]: commit: took 2.2 msec
IW 0 [2019-05-22T09:24:14.407Z; main]: commit: done
IW 0 [2019-05-22T09:24:14.407Z; main]: rollback
IW 0 [2019-05-22T09:24:14.407Z; main]: all running merges have aborted
IW 0 [2019-05-22T09:24:14.408Z; main]: rollback: done finish merges
DW 0 [2019-05-22T09:24:14.408Z; main]: abort
DW 0 [2019-05-22T09:24:14.408Z; main]: done abort success=true
IW 0 [2019-05-22T09:24:14.409Z; main]: rollback: infos=_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]
IFD 0 [2019-05-22T09:24:14.409Z; main]: now checkpoint "_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, source=flush, timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]" [5 segments ; isCommit = false]
IFD 0 [2019-05-22T09:24:14.410Z; main]: 0 msec to checkpoint


user@dev-appsolr2535:/home/user> java -cp '/opt/common/apps/apache-solr-8.1.0/server/solr-webapp/webapp/WEB-INF/lib/*' org.apache.lucene.index.IndexUpgrader -delete-prior-commits -verbose /opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index

IW 0 [2019-05-22T09:24:25.031Z; main]: init: hit exception on init; releasing write lock
Exception in thread "main" org.apache.lucene.index.IndexFormatTooOldException: Format version is not supported (resource BufferedChecksumIndexInput(MMapIndexInput(path="/opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index/segments_505u"))): This index was initially created with Lucene 6.x while the current version is 8.1.0 and Lucene only supports reading the current and previous major versions.. This version of Lucene only supports indexes created with release 7.0 and later.
	at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:318)
	at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:289)
	at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:846)
	at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:167)
	at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:78)

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Henrik

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 22/May/19 09:45

Updated:: 08/Jun/19 15:03

Resolved:: 22/May/19 10:39