Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34095

Spark 3.0.1 is giving WARN while running job

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.0.1
    • None
    • Java API
    • None

    Description

      I am running Spark 3.0.1 with Java11. Getting the following WARN.

       

      WARNING: An illegal reflective access operation has occurred
      WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/opt/spark/jars/spark-unsafe_2.12-3.0.1.jar) to constructor java.nio.DirectByteBuffer(long,int)
      WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
      WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
      WARNING: All illegal access operations will be denied in a future release

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              smurarka Sachit Murarka
              Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: