Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12312

UnsupportedOperationException in LazyAggregateCombineFn.mergeAccumulators

Details

    Description

      Another thing that works on the direct runner but fails on Dataflow: LazyAggregateCombineFn.mergeAccumulators [1] throws an UnsupportedOperationException because the "remove" method is not implemented in CombineFns$ProjectionIterable [2]. We will have to modify the implementation of LazyAggregateCombineFn.mergeAccumulators accordingly.

      [1] https://github.com/apache/beam/blob/8a622651edb3a2054865ff411579d3e04c02629a/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/LazyAggregateCombineFn.java#L78

      [2] https://github.com/apache/beam/blob/8a622651edb3a2054865ff411579d3e04c02629a/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/CombineFns.java#L642

      Attachments

        Issue Links

          Activity

            People

              ibzib Kyle Weaver
              ibzib Kyle Weaver
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h