3
votes

Hadoop-3.1.2: Datanode et Nodemanager s'arrêtent

J'essaie d'installer Hadoop (3.1.2) sur Windows-10, mais le nœud de données et le gestionnaire de nœuds se ferme.

J'ai essayé de télécharger et de placer les fichiers winutils.exe et hadoop.dll dans le répertoire bin. J'ai également essayé de changer les autorisations des fichiers et de courir en tant qu'administrateur. Mais cela n'a pas corrigé l'erreur

Erreur d'arrêt du Datanode

2019-02-12 12:01:28,091 WARN localizer.ResourceLocalizationService: Failed to rename the local file under /tmp/hadoop-Deepb/nm-local-dir/filecache
2019-02-12 12:01:28,185 ERROR nodemanager.NodeManager: Error starting NodeManager
java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.initializeLocalDir(ResourceLocalizationService.java:1435)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.initializeLocalDirs(ResourceLocalizationService.java:1405)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceInit(ResourceLocalizationService.java:260)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:318)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:477)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:933)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:1013)
2019-02-12 12:01:28,201 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService failed in state STOPPED
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 WARN service.CompositeService: When stopping the service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl failed in state STOPPED
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 WARN service.CompositeService: When stopping the service org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 INFO service.AbstractService: Service NodeManager failed in state STOPPED
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 WARN service.AbstractService: When stopping the service NodeManager
java.lang.NullPointerException
        at java.util.concurrent.ConcurrentHashMap.replaceNode(ConcurrentHashMap.java:1106)
        at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:1097)
        at java.util.Collections$SetFromMap.remove(Collections.java:5460)
        at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.deregisterDirsChangeListener(DirectoryCollection.java:224)
        at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.deregisterLocalDirsChangeListener(LocalDirsHandlerService.java:258)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStop(ResourceLocalizationService.java:429)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStop(ContainerManagerImpl.java:703)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
        at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:487)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
        at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:28,201 INFO nodemanager.NodeManager: SHUTDOWN_MSG:

Erreur d'arrêt du Nodemanager

2019-02-12 12:01:30,856 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/D:/Installs/IT/hadoop-3.1.2/data/datanode
2019-02-12 12:01:30,888 WARN checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/D:/Installs/IT/hadoop-3.1.2/data/datanode
java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)
        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)
        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:233)
        at org.apache.hadoop.util.DiskChecker.checkDirInternal(DiskChecker.java:141)
        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:116)
        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:239)
        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:52)
        at org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$1.call(ThrottledAsyncChecker.java:142)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2019-02-12 12:01:30,888 ERROR datanode.DataNode: Exception in secureMain
org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0
        at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:231)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2776)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2691)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2733)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2877)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2901)
2019-02-12 12:01:30,888 INFO util.ExitUtil: Exiting with status 1: org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

Je sais que c'est trop demander à cause de la lourde tâche d'installation de hadoop mais toute aide serait grandement appréciée

hadoop hadoop3

0 commentaires

3 Réponses :

4
votes

J'ai écrasé tous les fichiers du répertoire bin avec ces fichiers et tout a commencé à fonctionner comme prévu

0 commentaires

2
votes

Dans C: \ BigData \ hadoop-2.9.1 \ etc \ hadoop directry, ouvrez le fichier hdfs-site.xml et définissez le namenode et l'emplacement du datanode sur

/BigData/hadoop-2.9.1/data/namenode

/BigData/hadoop-2.9.1/data/datanode

Alors

Ouvrez cmd en tant que administrateur .
Tapez et exécutez stop-all.cmd

hadoop namenode –format

start-all.cmd

0 commentaires

0
votes

La clé ici est d'exécuter les commandes start - *. cmd à partir d'une fenêtre de commande ouverte en tant qu'administrateur, et non en tant qu'utilisateur. Bien sûr, avant cela, vous devez configurer ces 4 fichiers de configuration et winutils.

0 commentaires

Articles qui pourrait vous intéresser :
Ingérer des données IMS mainframe dans Hadoop
SQL pour ignorer la ligne maximale à condition
Sqoop peut-il être utilisé pour effectuer des jointures sur l'IMPORT?
Problème d'installation de Hive 3.1.1: Impossible de trouver l'installation de hadoop: $ HADOOP_HOME ou $ HADOOP_PREFIX doit être défini ou hadoop doit être dans le chemin