Details
-
Bug
-
Status: Patch Available
-
Trivial
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
In case there is a viewfs configured and it ends up throwing FNFE, current codepath silently ignores the error and ends up creating an empty file.
at org.apache.hadoop.fs.viewfs.InodeTree.resolve(InodeTree.java:403) at org.apache.hadoop.fs.viewfs.ViewFileSystem.listStatus(ViewFileSystem.java:374) at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1497) at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1537) at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath(Utilities.java:2350) at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath(Utilities.java:2343) at org.apache.hadoop.hive.ql.exec.Utilities$GetInputPathsCallable.call(Utilities.java:3128) at org.apache.hadoop.hive.ql.exec.Utilities.getInputPaths(Utilities.java:3092) at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.cloneJobConf(SparkPlanGenerator.java:303) at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.generate(SparkPlanGenerator.java:226) at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.generate(SparkPlanGenerator.java:109) at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:346) at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:358) at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:323) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)