Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40087

Support multiple Column drop in R

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.3.0
    • 3.4.0
    • R
    • None
    • Support for SparkR to drop multiple "Column"

    Description

      This is a followup on SPARK-39895. The PR previously attempted to adjust implementation for R as well to match signatures but that part was removed and we only focused on getting python implementation to behave correctly.

      Change supports following operations:

      df <- select(read.json(jsonPath), "name", "age")

      df$age2 <- df$age

      df1 <- drop(df, df$age, df$name)
      expect_equal(columns(df1), c("age2"))

      df1 <- drop(df, df$age, column("random"))
      expect_equal(columns(df1), c("name", "age2"))

      df1 <- drop(df, df$age, df$name)
      expect_equal(columns(df1), c("age2"))

       

       

       

      Attachments

        Issue Links

          Activity

            People

              santosh.pingale Santosh Pingale
              santosh.pingale Santosh Pingale
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: