Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18299

Allow more aggregations on KeyValueGroupedDataset

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SQL
    • None

    Description

      The number of possible aggregations on a KeyValueGroupedDataset created by groupByKey is limited to 4, as there are only methods with a maximum of 4 parameters.

      This value should be increased or - even better - made be completely unlimited.

      Attachments

        Issue Links

          is duplicated by

          Question - A formal question. Initially added for the Legal JIRA. SPARK-28600 the method agg of KeyValueGroupedDataset has 4 TypedColumn limits

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #24993

          Activity

            People

              nooberfsh nooberfsh
              j4nu5 Matthias Niehoff
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: