Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26829

In place standard scaler so the column remains same after transformation

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 2.3.2
    • None
    • ML
    • None

    Description

      Standard scaler and some similar transformations takes input column name and produce a new column, either accepting output column or generating new one with some random name after performing transformation.

       "inplace" flag  on true does not generate new column in output in dataframe after transformation; preserves schema of df.

      "inplace" flag on false works the way its currently working.

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            santokhsdg Santokh Singh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: