[HADOOP-14567] DistCP NullPointerException when -atomic is set but -tmp is not - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: Minor
Resolution: Unresolved
Affects Version/s: 2.7.3
Fix Version/s: None
Component/s: tools/distcp
Labels:
None
Environment:

HDP 2.5.0 kerberized cluster -> HDP 2.6.0 kerberized cluster

Description

When running distcp if using -atomic but not specifying -tmp then the following NullPointerException is encountered - removing -atomic avoids this bug:

17/06/21 16:50:59 ERROR tools.DistCp: Exception encountered
java.lang.NullPointerException
        at org.apache.hadoop.fs.Path.<init>(Path.java:104)
        at org.apache.hadoop.fs.Path.<init>(Path.java:93)
        at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:363)
        at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:247)
        at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:176)
        at org.apache.hadoop.tools.DistCp.execute(DistCp.java:155)
        at org.apache.hadoop.tools.DistCp.run(DistCp.java:128)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.tools.DistCp.main(DistCp.java:462)

Attachments

Issue Links

is depended upon by

HADOOP-15788 Improve Distcp for long-haul/cloud deployments

Open

relates to

HADOOP-14631 Distcp should add a default atomicWorkPath properties when using atomic

Open

Activity

People

Assignee:: Hongyuan Li

Reporter:: Hari Sekhon

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 22/Jun/17 08:04

Updated:: 25/Sep/18 10:53