Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29027

KafkaDelegationTokenSuite fails

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Structured Streaming
    • Labels:
      None
    • Environment:

      Description

      i am seeing consistent failure of KafkaDelegationTokenSuite on master

      JsonUtilsSuite:
      - parsing partitions
      - parsing partitionOffsets
      KafkaDelegationTokenSuite:
      javax.security.sasl.SaslException: Failure to initialize security context [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)]
      	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125)
      	at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85)
      	at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524)
      	at org.apache.zookeeper.server.ZooKeeperSaslServer$1.run(ZooKeeperSaslServer.java:118)
      	at org.apache.zookeeper.server.ZooKeeperSaslServer$1.run(ZooKeeperSaslServer.java:114)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:422)
      	at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:114)
      	at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:48)
      	at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100)
      	at org.apache.zookeeper.server.NIOServerCnxnFactory.createConnection(NIOServerCnxnFactory.java:156)
      	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:197)
      	at java.lang.Thread.run(Thread.java:748)
      Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)
      	at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87)
      	at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127)
      	at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193)
      	at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427)
      	at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62)
      	at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154)
      	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108)
      	... 12 more
      org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite *** ABORTED ***
        org.I0Itec.zkclient.exception.ZkAuthFailedException: Authentication failure
        at org.I0Itec.zkclient.ZkClient.waitForKeeperState(ZkClient.java:947)
        at org.I0Itec.zkclient.ZkClient.waitUntilConnected(ZkClient.java:924)
        at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1231)
        at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:157)
        at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:131)
        at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:93)
        at kafka.utils.ZkUtils$.apply(ZkUtils.scala:75)
        at org.apache.spark.sql.kafka010.KafkaTestUtils.setupEmbeddedZookeeper(KafkaTestUtils.scala:202)
        at org.apache.spark.sql.kafka010.KafkaTestUtils.setup(KafkaTestUtils.scala:243)
        at org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite.beforeAll(KafkaDelegationTokenSuite.scala:49)
        ...
      KafkaSourceOffsetSuite:
      - comparison {"t":{"0":1}} <=> {"t":{"0":2}}
      - comparison {"t":{"1":0,"0":1}} <=> {"t":{"1":1,"0":2}}
      - comparison {"t":{"0":1},"T":{"0":0}} <=> {"t":{"0":2},"T":{"0":1}}
      - comparison {"t":{"0":1}} <=> {"t":{"1":1,"0":2}}
      - comparison {"t":{"0":1}} <=> {"t":{"1":3,"0":2}}
      - basic serialization - deserialization
      - OffsetSeqLog serialization - deserialization
      - read Spark 2.1.0 offset format
      
      [INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
      [INFO] 
      [INFO] Spark Project Parent POM ........................... SUCCESS [  4.178 s]
      [INFO] Spark Project Tags ................................. SUCCESS [  9.373 s]
      [INFO] Spark Project Sketch ............................... SUCCESS [ 24.586 s]
      [INFO] Spark Project Local DB ............................. SUCCESS [  5.456 s]
      [INFO] Spark Project Networking ........................... SUCCESS [ 49.819 s]
      [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  6.096 s]
      [INFO] Spark Project Unsafe ............................... SUCCESS [ 14.714 s]
      [INFO] Spark Project Launcher ............................. SUCCESS [  5.277 s]
      [INFO] Spark Project Core ................................. SUCCESS [32:58 min]
      [INFO] Spark Project ML Local Library ..................... SUCCESS [ 41.076 s]
      [INFO] Spark Project GraphX ............................... SUCCESS [01:51 min]
      [INFO] Spark Project Streaming ............................ SUCCESS [06:43 min]
      [INFO] Spark Project Catalyst ............................. SUCCESS [15:04 min]
      [INFO] Spark Project SQL .................................. SUCCESS [  01:32 h]
      [INFO] Spark Project ML Library ........................... SUCCESS [26:48 min]
      [INFO] Spark Project Tools ................................ SUCCESS [  7.830 s]
      [INFO] Spark Project Hive ................................. SUCCESS [  01:00 h]
      [INFO] Spark Project Graph API ............................ SUCCESS [  3.378 s]
      [INFO] Spark Project Cypher ............................... SUCCESS [  3.672 s]
      [INFO] Spark Project Graph ................................ SUCCESS [  3.615 s]
      [INFO] Spark Project REPL ................................. SUCCESS [02:11 min]
      [INFO] Spark Project Assembly ............................. SUCCESS [  3.058 s]
      [INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 24.208 s]
      [INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:46 min]
      [INFO] Kafka 0.10+ Source for Structured Streaming ........ FAILURE [06:15 min]
      [INFO] Spark Project Examples ............................. SKIPPED
      [INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  2.467 s]
      [INFO] Spark Avro ......................................... SUCCESS [01:47 min]
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time:  04:11 h
      [INFO] Finished at: 2019-09-08T02:49:07-04:00
      [INFO] ------------------------------------------------------------------------
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gsomogyi Gabor Somogyi
                Reporter:
                koert koert kuipers
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: