Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9215 Implement WAL-free Kinesis receiver that give at-least once guarantee
  3. SPARK-7138

Add method to BlockGenerator to add multiple records to BlockGenerator with single callback

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.4.0
    • DStreams
    • None

    Description

      This is to ensure that receivers that receive data in small batches (like Kinesis) and want to add them but want the callback function to be called only once.

      This is for internal use only for improvement to Kinesis Receiver that we are planning to do.

      Attachments

        Issue Links

          Activity

            People

              tdas Tathagata Das
              tdas Tathagata Das
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: