Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6663

Add the ability to transform to/from json SerializablePipelineOptions

Details

    • Improvement
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • None
    • 2.11.0
    • runner-core
    • None

    Description

      Many runners, store both PipelineOptions and SerializablePipelineOptions in their context whereas SerializablePipelineOptions stores both Options and json serialized Options. Options can be obtain by SerializablePipelineOptions.get() but json form cannot be obtained. Similarly, we cannot create a SerializablePipelineOptions from json. It is needed in some cases (like spark structured streaming) where we cannot inject anything else than Strings into the framework.

      Attachments

        Issue Links

          Activity

            People

              echauchot Etienne Chauchot
              echauchot Etienne Chauchot
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h