Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1965

Livy SQL Interpreter: Should use df.show(1000, false) to display results

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 0.8.0
    • livy-interpreter
    • None

    Description

      Livy SQL Interpreter uses df.show( n ) which truncates string columns in result if they are more than 20 characters long.

      http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.Dataset@show(numRows:Int,truncate:Boolean):Unit
      http://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame.show

      df.show(1000, false) or df.show(1000, 1000) should be used to display results unchanged or truncated when strings are actually too long to display.
      Other option is to make it configurable. Possible values are true, false, integer > 1

      Attachments

        Issue Links

          Activity

            People

              benoyantony Benoy Antony
              sergey.mazin Sergey Mazin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: