Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12063

PeerSync and Leader Election skips delete-by-id and in-place updates when using CDCR

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 7.2, 7.2.1
    • 7.3
    • CDCR
    • None

    Description

      CDCR implements it's own UpdateLog (CdcrUpdateLog) . We changed the encoding format in SOLR-11003.
      PeerSync / LeaderElection code and CDCR checkpoint API call are unable to read delete-by-id's and in-place updates if they are present in the transaction log throwing a ClassCastException as a WARN

      Here's a stack trace for the WARN.

        [beaster]   2> 27394 WARN  (qtp97093533-72) [n:127.0.0.1:44658_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateLog Unexpected log entry or corrupt log.  Entry=[2, -1594312216007409664, [B@28e6859c, true]
        [beaster]   2> java.lang.ClassCastException: java.lang.Boolean cannot be cast to [B
        [beaster]   2> 	at org.apache.solr.update.UpdateLog$RecentUpdates.update(UpdateLog.java:1443)
        [beaster]   2> 	at org.apache.solr.update.UpdateLog$RecentUpdates.<init>(UpdateLog.java:1340)
        [beaster]   2> 	at org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1513)
        [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler.handleShardCheckpointAction(CdcrRequestHandler.java:448)
        [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler.handleRequestBody(CdcrRequestHandler.java:198)
        [beaster]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
        [beaster]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2503)
        [beaster]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:711)
        [beaster]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:517)
        [beaster]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:384)
        [beaster]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
        [beaster]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
        [beaster]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
        [beaster]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
        [beaster]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
        [beaster]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
        [beaster]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
        [beaster]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
        [beaster]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
        [beaster]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
        [beaster]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
        [beaster]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
      

      Attachments

        1. SOLR-12063.patch
          8 kB
          Amrit Sarkar
        2. SOLR-12063.patch
          11 kB
          Amrit Sarkar
        3. SOLR-12063.patch
          6 kB
          Amrit Sarkar
        4. SOLR-12063.patch
          5 kB
          Amrit Sarkar
        5. SOLR-12063.patch
          0.8 kB
          Amrit Sarkar
        6. SOLR-12063.patch
          1 kB
          Amrit Sarkar
        7. test-report-PeerSyncTest
          621 kB
          Amrit Sarkar
        8. test-report-TestStressRecovery
          28.96 MB
          Amrit Sarkar

        Activity

          People

            varun Varun Thacker
            sarkaramrit2@gmail.com Amrit Sarkar
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: