hadoop的node manager起不來怎么辦

本篇內(nèi)容介紹了“hadoop的node manager起不來怎么辦”的有關(guān)知識，在實(shí)際案例的操作過程中，不少人都會遇到這樣的困境，接下來就讓小編帶領(lǐng)大家學(xué)習(xí)一下如何處理這些情況吧！希望大家仔細(xì)閱讀，能夠?qū)W有所成！

現(xiàn)象： node manager起不來， 執(zhí)行mapreduce 程序hang住

namenode 進(jìn)程狀態(tài)查詢
[root@hadp-master sbin]# jps
8608 ResourceManager
8257 NameNode
9268 Jps
8453 SecondaryNameNode

datanode 進(jìn)程狀態(tài)查詢 ， 發(fā)現(xiàn) nodemanager 沒有起來
[root@hadp-node1 hadoop]# jps
4179 DataNode
4940 Jps

namenode 單獨(dú)起 nodemanager
[root@hadp-master sbin]# yarn nodemanager
18/01/26 03:53:54 INFO webapp.WebApps: Web app node started at 8042
18/01/26 03:53:54 INFO client.RMProxy: Connecting to ResourceManager at hadp-master/10.100.25.30:8031
18/01/26 03:53:54 INFO nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
18/01/26 03:53:54 INFO nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
18/01/26 03:53:54 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: NodeManager from hadp-master doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager. ## 提示 NodeManager 內(nèi)存不足

解決過程：

1、原虛擬機(jī)755m內(nèi)存，調(diào)大虛擬機(jī)內(nèi)存至2G

2、修改 yarn-site.xml ,添加如下參數(shù)

<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>200</value>
</property>

<property>
<name>yarn.scheduler.maximum-allocation-mb</name>
<value>1600</value>
</property>

<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>1600</value>
</property>

<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>1</value>
</property>

參數(shù) : yarn.scheduler.minimum-allocation-mb 
默認(rèn) : 1024 m 
官方解釋: The minimum allocation for every container request at the RM, in MBs. Memory requests lower than this will throw a InvalidResourceRequestException.

參數(shù) : yarn.scheduler.maximum-allocation-mb
默認(rèn) : 8192 m
官方解釋: The maximum allocation for every container request at the RM, in MBs. Memory requests higher than this will throw a InvalidResourceRequestException.

參數(shù) : yarn.nodemanager.resource.memory-mb
默認(rèn) : 8192 m
官方解釋: Amount of physical memory, in MB, that can be allocated for containers.

參數(shù) : yarn.nodemanager.resource.cpu-vcores
默認(rèn) : 8
官方解釋: Number of vcores that can be allocated for containers. This is used by the RM scheduler when allocating resources for containers. This is not used to limit the number of physical cores used by YARN containers.

“hadoop的node manager起不來怎么辦”的內(nèi)容就介紹到這里了，感謝大家的閱讀。如果想了解更多行業(yè)相關(guān)的知識可以關(guān)注億速云網(wǎng)站，小編將為大家輸出更多高質(zhì)量的實(shí)用文章！