Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-2400

Avro 1.9.0 can't resolve schemas that can be resolved in 1.8.2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 1.9.1
    • java
    • None

    Description

      The failure occurs in ResolvingGrammarGenerator when reader and writer schema have an array of records with different full names (e.g. different namespace). 

      Exception in thread "main" java.lang.ClassCastException: org.apache.avro.Resolver$ReaderUnion cannot be cast to org.apache.avro.Resolver$Container

      Avro 1.8.2 allowed this behavior but it now fails in 1.9.0. Looking at the jiras and code, I don't believe this was intentional ( AVRO-2275,  https://github.com/apache/avro/commit/39d959e1c6a1f339f03dab18289e47f27c10be7f  ).

       

      It looks like there were some attempts to keep compatibility ( https://github.com/apache/avro/blob/branch-1.9/lang/java/avro/src/main/java/org/apache/avro/Resolver.java , e.g. see the commented out check for w.getFullName() in resolve()) but this case was missed.

       

      See this simple example to reproduce. 

      https://gist.github.com/jacobtolar/c88d43ab4e8767227891e5cdc188ffad

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. AVRO-2485 ClassCastException on Nullable Map Value Schemas with Backward Compatible Changes (Field Addition)

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. AVRO-2415 Regression: Schema evolution of union containing array fails in 1.9.0

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue SPARK-27733 Upgrade to Avro 1.10.1

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. AVRO-3133 EnumAdjust.resolve should compare unqualified name rather than full name

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #526

          Activity

            People

              jtolar Jacob Tolar
              jtolar Jacob Tolar
              Votes:
              1 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: