Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36212

Add exception for Kafka readstream when decryption fails

    XMLWordPrintableJSON

Details

    • Patch

    Description

      A silent failure is possible when reading from a Kafka broker under the following circumstances:

      SDF.isStreaming = True

      SDF.printSchema() => returns expected schema

      Query results are empty.

      Issue: Tsl Decryption has failed, but there is no exception or warning.

      Request: Add a warning throw an exception when decryption fails, such that developers can efficiently diagnose the readstream problem.

       

      This is my first ticket submitted. Please notify me if I should change anything in this ticket to make it more conformant to community standards. I'm still a beginner with Spark.

      Attachments

        Activity

          People

            Unassigned Unassigned
            spark-newbie-45978 Jon LaFlamme
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 3h
                3h
                Remaining:
                Remaining Estimate - 3h
                3h
                Logged:
                Time Spent - Not Specified
                Not Specified