Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6350

Reuse same PCollectionView when created in translators

Details

    Description

      If for LeftJoin is used BroadcastHashJoinTranslator then from right side is created PCollectionView (as sideInput).

      If we use right side in multiple joins then PCollectionView  is created multiple times which is not optimal behavior.

      Eg.

      LeftJoin.of(left, right)..
      LeftJoin.of(anotherLeftPcollection, right)..
      
      

       For example it will happen when we want to solve skew Join.

      Attachments

        Issue Links

          Activity

            People

              dmvk David Morávek
              marek.simunek Marek Simunek
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m