Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-47052

Separate state tracking variables from MicroBatchExecution/StreamExecution

    XMLWordPrintableJSON

Details

    Description

      To improve code clarity and maintainability, I propose that we move all the variables that track mutable state and metrics for streaming query into a separate class.  With this refactor, it would be easy to track and find all the mutable state a microbatch can have.  

      Attachments

        Issue Links

          Activity

            People

              jerrypeng Boyang Jerry Peng
              jerrypeng Boyang Jerry Peng
              Jungtaek Lim Jungtaek Lim
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: