Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24444

Improve pandas_udf GROUPED_MAP docs to explain column assignment

    XMLWordPrintableJSON

Details

    • Documentation
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.1, 2.4.0
    • PySpark
    • None

    Description

      There have been several bugs regarding this and a clean solution still changes some behavior.  Until this can be resolved, improve docs to explain that columns are assigned by position.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue SPARK-24324 Pandas Grouped Map UserDefinedFunction mixes column labels

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #21471 [Github] Pull Request #21471 (BryanCutler)

          Pull request #21478 [Github] Pull Request #21478 (BryanCutler)

          Activity

            People

              bryanc Bryan Cutler
              bryanc Bryan Cutler
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: