Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25752

Add trait to easily whitelist logical operators that produce named output from CleanupAliases

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • SQL
    • None

    Description

      The rule `CleanupAliases` cleans up aliases from logical operators that do not match a whitelist. This whitelist is hardcoded inside the rule which is cumbersome. This PR is to clean that up by making a trait `HasNamedOutput` that will be ignored by `CleanupAliases` and other ops that require aliases to be preserved in the operator should extend it.

      Attachments

        Activity

          People

            tdas Tathagata Das
            tdas Tathagata Das
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: