Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30564

Regression in the wide schema benchmark

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SQL
    • None

    Description

      New results of WideSchemaBenchmark generated in the PR: https://github.com/apache/spark/pull/27078 show regressions up to 2 times.
      Before:

      2500 select expressions                        103 /  107          0.0   102962705.0       0.1X

      https://github.com/apache/spark/pull/27078/files#diff-8d27bbf2f73a68bf0c2025f0702f7332L11
      After:

      2500 select expressions                             211            214           4          0.0   210927791.0       0.0X

      https://github.com/apache/spark/pull/27078/files#diff-8d27bbf2f73a68bf0c2025f0702f7332R11

      Attachments

        Activity

          People

            petertoth Peter Toth
            maxgekk Max Gekk
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: