[HDFS-8699] DFSClient hang up when there are not sufficient DataNodes in EC cluster. - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: HDFS-7285
Fix Version/s: None
Component/s: None
Labels:
None

Target Version/s:

HDFS-7285

Description

6-3 RS schema requires 9 data nodes at least to work properly. However when there are not sufficient DataNodes in EC cluster, writing file fails because of NullPointerException. And also client is hang up.

java.lang.NullPointerException
        at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1463)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:591)
        at org.apache.hadoop.hdfs.StripedDataStreamer.run(StripedDataStreamer.java:49)

DFSClient should handle insufficient DN error properly just like replication blocks.

Attachments

Issue Links

duplicates

HDFS-8220 Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

Resolved

Activity

People

Assignee:: Kai Sasaki

Reporter:: Kai Sasaki

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 30/Jun/15 08:02

Updated:: 30/Jun/15 09:33

Resolved:: 30/Jun/15 09:33