[HADOOP-15411] AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Critical
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.2.0, 3.1.1, 3.0.3
Component/s: None
Labels:
None

Target Version/s:

3.2.0, 3.1.1, 3.0.3
Hadoop Flags:

Reviewed

Description

Node manager start up fails with the following stack trace

2018-04-19 13:08:30,638 ERROR nodemanager.NodeManager (NodeManager.java:initAndStartNodeManager(921)) - Error starting NodeManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: NMWebapps failed to start.
 at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:117)
 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:919)
 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:979)
Caused by: org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:377)
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:424)
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:420)
 at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:112)
 ... 5 more
Caused by: java.io.IOException: java.util.ConcurrentModificationException
 at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:532)
 at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:117)
 at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:421)
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:333)
 ... 8 more
Caused by: java.util.ConcurrentModificationException
 at java.util.Hashtable$Enumerator.next(Hashtable.java:1383)
 at org.apache.hadoop.conf.Configuration.iterator(Configuration.java:2853)
 at org.apache.hadoop.security.AuthenticationFilterInitializer.getFilterConfigMap(AuthenticationFilterInitializer.java:73)
 at org.apache.hadoop.http.HttpServer2.getFilterProperties(HttpServer2.java:647)
 at org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:637)
 at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:525)
 ... 11 more
2018-04-19 13:08:30,639 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:getCurrentCollectorHost(291)) - No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times.