Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7199

Better optimize Portable pipelines

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: sdk-py-core
    • Labels:

      Description

      Python has an experimental flag pre_optimize=all which does pre-optimization of python pipelines by fusing operators.

      Python optimization is expected to be better than the one in java because it has more information about the pipeline.

      Make java pipeline optimization at par with python so that the benefits can be shared by all languages.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              angoenka Ankur Goenka
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: