Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30577

StorageLevel.DISK_ONLY_2 causes the data loss

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.3.0
    • None
    • Spark Core, SQL
    • None

    Description

      As shown in the attachment,after I load the data of the hive table which is immutable and cache the data in the level of the DISK_ONLY_2,the count value of the data  is different every time.

       

      Attachments

        1. DISK_ONLY_2.png
          44 kB
          zero222

        Activity

          People

            Unassigned Unassigned
            zero222 zero222
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: