Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1760

Thread scalability problem with the use of SynchronizedMap

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0, 1.8.1, 1.9.0
    • 1.8.0
    • java
    • Reviewed
    • Patch, Important

    Description

      While running Adam Genomics (which uses Avro) on Apache Spark, we discovered that threads (tasks in Spark Context) block in Avro while executing the getDefaultValue(Field field) method in https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java

      Attachments

        1. AVRO-1760.patch
          1 kB
          Thomas White
        2. AVRO-1760.patch
          3 kB
          Thomas White
        3. AVRO-1760.patch
          0.9 kB
          Mulugeta Mammo
        4. AVRO-1760.pdf
          962 kB
          Mulugeta Mammo

        Issue Links

        relates to

        Bug - A problem which impairs or prevents the functions of the product. AVRO-1781 Schema.parse is not thread safe

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tomwhite Thomas White
            mulugeta Mulugeta Mammo
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment