Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27416

UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines have different Oops size

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.1
    • 2.4.4, 3.0.0
    • SQL
    • None

    Description

      Actually this's follow up for https://issues.apache.org/jira/browse/SPARK-27406, https://issues.apache.org/jira/browse/SPARK-10914

      This issue is to fix the UnsafeMapData & UnsafeArrayData Kryo serialization issue when two machines have different Oops size.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-10914 UnsafeRow serialization breaks when two machines have different Oops size

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #24337

          Web Link GitHub Pull Request #24357

          Web Link GitHub Pull Request #25223

          Activity

            People

              pengbo peng bo
              pengbo peng bo
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: