[Hadoop] Namenode Error (localhost: ERROR: Cannot set priority of datanode process )

localhost: ERROR: Cannot set priority of datanode process

Starting namenodes on [localhost]
Starting datanodes
localhost: ERROR: Cannot set priority of datanode process 854900
Starting secondary namenodes [server_name]
2023-11-12 13:52:05,508 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting resourcemanager
Starting nodemanagers

https://stackoverflow.com/questions/46283634/localhost-error-cannot-set-priority-of-datanode-process-3215

localhost: ERROR: Cannot set priority of datanode process 32156

 

나의 경우 namenode namespace의 권한이 꼬여 있어 hadoop이 찾지 못했다. 같은 상황일 경우 namenode를 초기화 해준다. 

 

1) 모든 하둡 종료

stop-all.sh

 

2) hdfs-site.xml path 확인 (vi $HADOOP_HOME/etc/hadoop/hdfs-site.xml, $HADOOP_HOME 하둡 설치 directorypath)

     <property>
         <name>dfs.namenode.name.dir</name>
         <value>file:///home/user/hadoop-3.3.5/dfs/name</value>
     </property>
     <property>
         <name>dfs.datanode.data.dir</name>
         <value>file:///home/user/hadoop-3.3.5/dfs/data</value>

 

dfs 하위 폴더의 노드명 (data, name)이 해당 폴더에 잘 위치하는지 확인 

 

3) namenode format

stop-dfs.sh # bashrc에 HADOOP_HOME과 기타 PATH 설정시에만 가능
sudo bin/hdfs namenode -format

 

4) 폴더 권한 777 부여

sudo chmod -R 777 /home/user/hadoop-3.3.5/dfs

 

5) 재시작

start-all.sh

 

WARNING: Attempting to start all Apache Hadoop daemons as --- in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [---]
Starting datanodes
Starting secondary namenodes [---]
Starting resourcemanager
Starting nodemanagers