Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-26284

ClassCastException: java.io.PushbackInputStream cannot be cast to org.apache.hadoop.fs.Seekable when table properties contains 'skip.header.line.count' = '1' and datafiles are in UTF-16 encoding

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      ERROR : Vertex failed, vertexName=Map 4, vertexId=vertex_1648118653114_0507_2_00, diagnostics=[Vertex vertex_1648118653114_0507_2_00 [Map 4] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: <redacted> initializer failed, vertex=vertex_1648118653114_0507_2_00 [Map 4], java.lang.ClassCastException: java.io.PushbackInputStream cannot be cast to org.apache.hadoop.fs.Seekable
                    at org.apache.hadoop.fs.FSDataInputStream.getPos(FSDataInputStream.java:78)
                    at org.apache.hadoop.hive.ql.io.SkippingTextInputFormat.getCachedStartIndex(SkippingTextInputFormat.java:120)
                    at org.apache.hadoop.hive.ql.io.SkippingTextInputFormat.makeSplitInternal(SkippingTextInputFormat.java:73)
                    at org.apache.hadoop.hive.ql.io.SkippingTextInputFormat.makeSplit(SkippingTextInputFormat.java:66)
                    at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:379)
                    at org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:532)
                    at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:789)
                    at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:243)
                    at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
                    at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
                    at java.security.AccessController.doPrivileged(Native Method)              at javax.security.auth.Subject.doAs(Subject.java:422)
                    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1732)
                    at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269)
                    at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              gupta.nikhil0007 Nikhil Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: