Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34125

Make EventLoggingListener.codecMap thread-safe

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.4.7
    • 2.4.8
    • Spark Core
    • None

    Description

      2.x version of history server
      EventLoggingListener.codecMap is of type mutable.HashMap, which is not thread safe
      This will cause the history server to suddenly get stuck and not work.

      The 3.x version was changed to EventLogFileReader.codecMap to ConcurrentHashMap type, so there is no such problem.(SPARK-28869)

      PID 117049 0x1c939

       

       

       

       

      Attachments

        1. jstack.png
          76 kB
          dzcxzl
        2. top.png
          37 kB
          dzcxzl

        Activity

          People

            dzcxzl dzcxzl
            dzcxzl dzcxzl
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: