Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6663

Add the ability to transform to/from json SerializablePipelineOptions

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.11.0
    • Component/s: runner-core
    • Labels:
      None

      Description

      Many runners, store both PipelineOptions and SerializablePipelineOptions in their context whereas SerializablePipelineOptions stores both Options and json serialized Options. Options can be obtain by SerializablePipelineOptions.get() but json form cannot be obtained. Similarly, we cannot create a SerializablePipelineOptions from json. It is needed in some cases (like spark structured streaming) where we cannot inject anything else than Strings into the framework.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                echauchot Etienne Chauchot
                Reporter:
                echauchot Etienne Chauchot
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h