Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3091

Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 4.2.0
    • None
    • action
    • None

    Description

      Oozie Sqoop Action which does Import as avro fails with below. avro-mapred-1.8.0-hadoop2.jar need to be included in Oozie Sqoop Sharelib

      
      2017-10-19 09:45:25,349 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
              at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:745)
              at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
              at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:422)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
              at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
      Caused by: java.lang.reflect.InvocationTargetException
              at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
              at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
              ... 7 more
      Caused by: java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper
              at org.apache.sqoop.mapreduce.AvroImportMapper.<init>(AvroImportMapper.java:43)
              ... 12 more
      Caused by: java.lang.ClassNotFoundException: org.apache.avro.mapred.AvroWrapper
              at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
              at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
              ... 13 more
      

      Attachments

        1. Oozie_Sqoop_Avro_import
          2 kB
          Prabhu Joseph
        2. OOZIE-3091.2.patch
          2 kB
          Prabhu Joseph
        3. OOZIE-3091.1.patch
          2 kB
          Prabhu Joseph

        Issue Links

          Activity

            People

              prabhujoseph Prabhu Joseph
              prabhujoseph Prabhu Joseph
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: